-- Logs begin at Tue 2022-08-30 23:31:58 UTC, end at Wed 2022-08-31 00:54:41 UTC. -- Aug 31 00:14:20.190341 dv-cinder-852211-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 00:14:20.200130 dv-cinder-852211-6-smb devstack@keystone.service[88167]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 00:14:20 2022] *** Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: nodename: dv-cinder-852211-6-smb Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: machine: x86_64 Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: clock source: unix Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: pcre jit disabled Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: detected number of CPU cores: 4 Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: current working directory: / Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: detected binary path: /usr/bin/uwsgi-core Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: your processes number limit is 47680 Aug 31 00:14:20.202218 dv-cinder-852211-6-smb devstack@keystone.service[88167]: your memory page size is 4096 bytes Aug 31 00:14:20.203009 dv-cinder-852211-6-smb devstack@keystone.service[88167]: detected max file descriptor number: 2048 Aug 31 00:14:20.203009 dv-cinder-852211-6-smb devstack@keystone.service[88167]: lock engine: pthread robust mutexes Aug 31 00:14:20.203009 dv-cinder-852211-6-smb devstack@keystone.service[88167]: thunder lock: enabled Aug 31 00:14:20.203009 dv-cinder-852211-6-smb devstack@keystone.service[88167]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 00:14:20.203009 dv-cinder-852211-6-smb devstack@keystone.service[88167]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 00:14:20.242394 dv-cinder-852211-6-smb devstack@keystone.service[88167]: Python main interpreter initialized at 0x5571dfa909c0 Aug 31 00:14:20.242394 dv-cinder-852211-6-smb devstack@keystone.service[88167]: python threads support enabled Aug 31 00:14:20.242394 dv-cinder-852211-6-smb devstack@keystone.service[88167]: your server socket listen backlog is limited to 100 connections Aug 31 00:14:20.242394 dv-cinder-852211-6-smb devstack@keystone.service[88167]: your mercy for graceful operations on workers is 90 seconds Aug 31 00:14:20.242777 dv-cinder-852211-6-smb devstack@keystone.service[88167]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 00:14:20.242847 dv-cinder-852211-6-smb devstack@keystone.service[88167]: *** Operational MODE: preforking *** Aug 31 00:14:20.243116 dv-cinder-852211-6-smb devstack@keystone.service[88167]: *** uWSGI is running in multiple interpreter mode *** Aug 31 00:14:20.243116 dv-cinder-852211-6-smb devstack@keystone.service[88167]: spawned uWSGI master process (pid: 88167) Aug 31 00:14:20.243333 dv-cinder-852211-6-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 00:14:20.244893 dv-cinder-852211-6-smb devstack@keystone.service[88167]: spawned uWSGI worker 1 (pid: 88177, cores: 1) Aug 31 00:14:20.244893 dv-cinder-852211-6-smb devstack@keystone.service[88167]: spawned uWSGI worker 2 (pid: 88178, cores: 1) Aug 31 00:14:20.244893 dv-cinder-852211-6-smb devstack@keystone.service[88167]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 00:14:24.607744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:14:24.607744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: from cryptography.utils import int_from_bytes Aug 31 00:14:24.608572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:14:24.608572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: from cryptography.utils import int_from_bytes Aug 31 00:14:24.608688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:14:24.608688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: from cryptography.utils import int_from_bytes Aug 31 00:14:24.609097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 00:14:24.609097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: from cryptography.utils import int_from_bytes Aug 31 00:14:24.659851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:14:24.660045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:14:24.660227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] command line args: [] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:14:24.660502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:14:24.660681 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ================================================================================ {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:14:24.660775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 00:14:24.660882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 00:14:24.660969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] admin_token = **** {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.661087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] command line args: [] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 00:14:24.661234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] config_dir = [] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.661346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 00:14:24.661461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.661536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ================================================================================ {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 00:14:24.661688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] config_source = [] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.661868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] admin_token = **** {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.662013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] debug = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.662155 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] config_dir = [] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.662271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.662534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.662534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] config_source = [] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.662757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.662883 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] debug = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.663009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.663134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.663298 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.663413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.663540 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.663666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.663790 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] list_limit = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.663908 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.664032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] log_config_append = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.664032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.664251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.664376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] log_dir = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.664473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] list_limit = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.664589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] log_file = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.664702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] log_config_append = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.664816 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.664925 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.664925 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] log_dir = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.665111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.665207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] log_file = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.665311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.665421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.665534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.665700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.665822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.665938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.666060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.666060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.666277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.666277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.666630 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.666738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.666840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.666958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.667071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.667182 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.667301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.667413 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.667542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.667653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.667760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.667867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.667980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.668087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.668211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.668211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.668420 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.74/identity {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.668541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.668667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] publish_errors = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.668667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.668864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.74/identity {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.668985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.669182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] publish_errors = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.669297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.669421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.669550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.671396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.671546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.671707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.671851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] standard_threads = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.671987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.672212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.672421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.672572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.672572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.672883 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] standard_threads = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.673014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] use_journal = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.673154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.673293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] use_json = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.673440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.673566 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] use_stderr = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.673734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.673864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] use_syslog = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.674047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] use_journal = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.674183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.674328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] use_json = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.674455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.674578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] use_stderr = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.674578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] use_syslog = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.674881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.675030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 00:14:24.675273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.675407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.675534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.675662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.675799 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.675934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.676063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.676190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.676311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.676438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.676561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.676561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.676797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.676922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.676922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.677145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.677266 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.677413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.677544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.677695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.677824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.677947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.678076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.678225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.678355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.678355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.678612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.678753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.678884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.679032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.679158 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.679291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.679425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.679553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.679682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.679839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.679965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.680100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.680298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.680479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.680616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.680759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.680893 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.681025 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.681163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.681292 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.681292 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.681706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.681843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.681975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.682105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.682239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.682370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.682513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.682645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.682785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.682917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.683048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.683183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.683327 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.683459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.683597 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.683737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.683868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.683998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.684145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.684276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.684417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.684556 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.684696 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.684825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.684967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.685098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.685237 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.685369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.685500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.685670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.685859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.686030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.686208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.686375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.686592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.686796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.686959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.687133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.687304 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.687497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.687631 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.687780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.687921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.688051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.688183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.688827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.689025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.689180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.689311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.689483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.689688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.689892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.690028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.690159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.690291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.690440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.690572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.690712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.690853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.690983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.690983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.691243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.691428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.691553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.691692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.691825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.691969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.692100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.692230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.692438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.692634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.692770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.692901 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.693053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.693186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.693325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.693465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.693632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.693766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.693925 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.693925 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.694178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.694320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.694485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.694617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.694759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.694897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.695039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.695171 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.695286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.695400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.695528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.695645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.695844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.695971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.696087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.696087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.696412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.696610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.696747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.696879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.697011 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.697127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.697255 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.697372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.697488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.697799 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.697931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.698046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.698185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.698322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.698437 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.698554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.698680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.698874 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.699010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.699215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.699351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.699483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.699613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.699745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.699877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.700027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.700158 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.700290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.700421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.700552 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.700684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.700835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.700968 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.701131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.701336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.701474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.701639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.701793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.701937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.702071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.702205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.702336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.702468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.702613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.702745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.702879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.703011 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.703152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.703274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.703413 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.703548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.703669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.703786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.703967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.704621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.704758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.704878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.704995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.705108 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.705221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.705341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.705474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] auth.external = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.705703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.705824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.705941 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.705941 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.706148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.706148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.706433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.706577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] auth.password = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.706695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.706808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] auth.token = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.706915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.707024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.707571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.707703 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.707819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] auth.external = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.707934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.708050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.708165 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.708279 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.708407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.708516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.708628 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.708849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] auth.password = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.708967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.709082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] auth.token = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.709848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] credential.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.709970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.710089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.710209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.710325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.710454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.710573 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.710688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.710795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.710908 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.711021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.711144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.711280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.711408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.711550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.711680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] credential.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.711811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.711965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.712094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.712222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.712349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.712490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.712622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.712771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.712907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.713040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.713178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.713315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.713448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.713735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.713868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.714001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.714132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] federation.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.714258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.714389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.714529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.714664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.714797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.714931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.715075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.715208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.715359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.715493 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.715626 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.715757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.715886 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.716018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.716157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] federation.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.716287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.716412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.716544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.716675 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.716805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.716945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.716945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.717175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.717175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.717406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.717534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.717706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.717839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.717971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.718105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.718241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.718372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.718519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.718655 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.718786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.718918 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.719050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.719179 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.719320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.719449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.719622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.719762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.719900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.720042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.720199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.720341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.720476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.720641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.720775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.720904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.721046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.721175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.721307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.721440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.721612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.721768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.721902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.722037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.722173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.722306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.722438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.722589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.724465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.724616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.724757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.724903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.725051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.725203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.725333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.725466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.725466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.725776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.725906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.726056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.726193 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.726328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.726460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.726598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.726733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.726882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.727024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.727155 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.727289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.727425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.727566 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.727709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.727840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.727971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.728100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.728229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.728356 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.728502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.728634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.728768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.728903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.729034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.729178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.729324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.729469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.729613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.729752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.729888 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.730027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.730170 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.730292 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.730410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.730526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.730641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.730750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.730876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.730989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.731105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.731236 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.731348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.731459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.731591 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.731733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.731868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.731999 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.732131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.732262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.732410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.732560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.732695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.732831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.732967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.733103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.733263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.733401 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.733538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.733791 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.733926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.734064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.734220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.734220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.734472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.734612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.734752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.734896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.735043 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.735200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.735339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.735479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.735616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.735755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.735755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.736016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.736153 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.736288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.736422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.736557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.736706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.736841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.736976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.737110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.737255 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.737404 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.737539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.737760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.737899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.738032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.738165 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.738317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.738455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.738592 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.738728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.738865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.739004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.739156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.739156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.739386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.739505 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.739623 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.739743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.739743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.739975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.740095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.740095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.740311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.740429 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.740429 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.740664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.740789 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.740789 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.740994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.741119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.741345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.741345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.741556 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.741717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.741835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.741952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.742089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.742089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.742301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.742419 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] resource.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.742537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.742654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.742783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.742896 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.742896 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.743118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.743236 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.743236 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.743454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.743567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.743567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.743757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.743864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.743980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.744112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.744112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] role.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.744325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.744455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] role.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.744593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.744739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.744739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.745003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.745138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.745138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.745383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.745518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.745518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.745777 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.745894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.745894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.746106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] resource.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.746223 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.746223 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.746464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.746599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.746732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.746866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.747001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.747146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.747282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.747416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.747549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.747683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.747817 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.747963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.748097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.748231 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.748367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.748485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.748602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.748732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.748860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] role.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.748980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.749097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] role.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.749230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.749230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.749487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.749643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.749643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.749903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.750038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.750185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.750321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.750455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.750589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.751316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.751460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.751597 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.751716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.751838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.751959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.752075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.752187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.752321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.752458 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.752594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.752730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.752862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.752996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] token.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.753142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.753277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.753410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.753544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.753544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.753879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.754011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.754131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.754250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.754365 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.754482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.754601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.754732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.754861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.754979 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.755095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.755213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.755329 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.755458 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.755575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.755693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.755693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.755902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.756017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.756147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.756147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.756356 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.756474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.756592 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.756728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.756858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.756989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.757108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.757224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.757340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.connection = **** {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.757470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.757613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.757749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.757870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.757990 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.758108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.758224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.758340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.758469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.758586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.758704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] token.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.758822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.758937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.759052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.759182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.759299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.759418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.759537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.759655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.759773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.759903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.760020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.760020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.760231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.760231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.760443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.760443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.760669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.760788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.760907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.761024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.761141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.761270 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.761401 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.761513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.761817 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.761933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:14:24.762041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.connection = **** {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.762974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.763832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.763832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.763832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.763832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.763832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.763832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 00:14:24.763832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 00:14:24.777882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.778115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.778326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.779856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.780084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.780312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.787425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.789108 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.817178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.817414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.819532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.819770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.873059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.873233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.925885 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.926092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.926223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:24.926358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.083877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.084102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.084329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.084550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.084770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.084990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.085229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.085467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.085717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.085944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.086160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.086378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.108535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.108719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.108805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.108870 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.108982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.109092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.109208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.109322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.109432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.109547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.109681 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.109798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.109887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.110022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.121901 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.122707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.135835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.136017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.136205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.136294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.136431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.136515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.136651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.136743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.136866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.136950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.137080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.137164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.137357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.137515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 00:14:25.154409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.154597 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:14:25.154841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.154963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.155096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:14:25.155181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:14:25.155468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.155564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.155629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 00:14:25.155831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.155920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.156119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.156294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.156423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.156546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.156664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.166197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.166487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.166619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.166742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.166889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.167046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.167186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.167369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.175241 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.175405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.178214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.178337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.178503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.178592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.178789 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.178878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.179077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.179162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.179367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.179450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.179632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.179717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.179906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.180004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.180181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.180273 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.180452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.180656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.180746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.180951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.181042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.181232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.204874 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.205380 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.206491 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.206782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.206915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.207209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.211371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.211654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.211938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.212079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.212373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.212663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.218427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.218717 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.219082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.219378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.223527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.223825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.224131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.224219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.224428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.224511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.224724 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.224866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.224995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.225277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.225560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.225861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.226135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.226896 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.227216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.227487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.243250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.243541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.243646 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.243839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.247429 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.247842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.250539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.250971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.251213 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.251433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.255369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.255740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.258522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.258974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.264475 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.264475 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.264648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.264715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.264715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.264843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.264843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.264991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.265073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.265156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.265230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.265230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.279564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.279864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.280136 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.280315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.280404 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.280623 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.280897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.281167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.287976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.289050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.289667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.290644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.291204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.296568 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.296662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.296662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.296803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.296803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.296803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.296803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.297077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.297150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.297225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.297225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.297225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.297225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.306855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.307143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.307427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.307713 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.307847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.307996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.308175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.308277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.308567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.308656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.308881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.309174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.309460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.309796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.324572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.325894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.327609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.328867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.331322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.332587 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.332764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.334081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.334267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.334568 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.334854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.335693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.335991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.336280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.341378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.342727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.342870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.344217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.345885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.346182 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.350521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.350521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.350659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.350659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.350659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.350659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.354675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.354976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.355258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.356315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.356615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.356906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.362216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.362505 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.362789 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.363070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.363349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.363624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.363909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.364186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.364266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 00:14:25.364465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.364556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.364737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.364819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.365011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.365100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.365281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.365363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.365549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.365679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.365957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.366159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.366340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.366515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.366758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.367029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.367298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.367567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.367851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 00:14:25.401143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5571dfa909c0 pid: 88177 (default app) Aug 31 00:14:25.404052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5571dfa909c0 pid: 88178 (default app) Aug 31 00:14:25.404793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff290a-6850-4ea3-a992-b3cedc8ae34a None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:25.405087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff290a-6850-4ea3-a992-b3cedc8ae34a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:25.405366 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff290a-6850-4ea3-a992-b3cedc8ae34a None None] PATH_INFO: `/v3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:25.410313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1/1] 10.222.0.74 () {50 vars in 791 bytes} [Wed Aug 31 00:14:25 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:33.299431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667374ed-f5f8-4105-9def-1840b290d9cd None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:33.300000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667374ed-f5f8-4105-9def-1840b290d9cd None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:33.300000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667374ed-f5f8-4105-9def-1840b290d9cd None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:33.304326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1/2] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:33.309868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4001179-154e-411c-b957-7f137e84faa9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:33.310317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4001179-154e-411c-b957-7f137e84faa9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:33.310409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4001179-154e-411c-b957-7f137e84faa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:33.381434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: INFO dbcounter [None req-e4001179-154e-411c-b957-7f137e84faa9 None None] Registered counter for database keystone Aug 31 00:14:33.402933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG oslo_db.sqlalchemy.engines [None req-e4001179-154e-411c-b957-7f137e84faa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:14:33.409564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writer thread running {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:14:33.597421 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG passlib.handlers.bcrypt [None req-e4001179-154e-411c-b957-7f137e84faa9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88177) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:14:33.597739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG passlib.handlers.bcrypt [None req-e4001179-154e-411c-b957-7f137e84faa9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88177) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:14:33.664827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-e4001179-154e-411c-b957-7f137e84faa9 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:33.666469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e4001179-154e-411c-b957-7f137e84faa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:33.802430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 2/3] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 00:14:34.291945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667374ed-f5f8-4105-9def-1840b290d9cd None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:34.363179 dv-cinder-852211-6-smb devstack@keystone.service[88178]: INFO dbcounter [None req-667374ed-f5f8-4105-9def-1840b290d9cd None None] Registered counter for database keystone Aug 31 00:14:34.382573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG oslo_db.sqlalchemy.engines [None req-667374ed-f5f8-4105-9def-1840b290d9cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 00:14:34.389294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writer thread running {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 00:14:34.513339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667374ed-f5f8-4105-9def-1840b290d9cd None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:34.517815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f53b2c-84f2-4e1b-b39c-8b6a95528e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:34.518455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f53b2c-84f2-4e1b-b39c-8b6a95528e48 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:34.518736 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f53b2c-84f2-4e1b-b39c-8b6a95528e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:34.519009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f53b2c-84f2-4e1b-b39c-8b6a95528e48 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:34.527669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f53b2c-84f2-4e1b-b39c-8b6a95528e48 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:34.583815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: WARNING keystone.common.rbac_enforcer.enforcer [None req-89f53b2c-84f2-4e1b-b39c-8b6a95528e48 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:14:34.584134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f53b2c-84f2-4e1b-b39c-8b6a95528e48 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:34.597622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 2/4] 10.222.0.74 () {58 vars in 1324 bytes} [Wed Aug 31 00:14:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:14:34.603641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4001179-154e-411c-b957-7f137e84faa9 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:34.619112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4001179-154e-411c-b957-7f137e84faa9 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:34.623715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953b7cc-f578-40d3-9f0a-1d75ff6ff32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:34.624827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b7cc-f578-40d3-9f0a-1d75ff6ff32f admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:34.625140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b7cc-f578-40d3-9f0a-1d75ff6ff32f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:34.625428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b7cc-f578-40d3-9f0a-1d75ff6ff32f admin admin] PATH_INFO: `/v3/projects/cd01cbdba4ce42c9aba3127e81a7cb7f` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:34.627062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953b7cc-f578-40d3-9f0a-1d75ff6ff32f admin admin] RBAC: Authorizing `identity:get_project(project_id=cd01cbdba4ce42c9aba3127e81a7cb7f)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:34.680991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d953b7cc-f578-40d3-9f0a-1d75ff6ff32f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 00:14:34.681336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953b7cc-f578-40d3-9f0a-1d75ff6ff32f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:34.686146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 3/5] 10.222.0.74 () {56 vars in 1207 bytes} [Wed Aug 31 00:14:34 2022] GET /identity/v3/projects/cd01cbdba4ce42c9aba3127e81a7cb7f => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:36.674560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f605-5415-42e1-873a-99a0a71534cb None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:36.675111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f605-5415-42e1-873a-99a0a71534cb None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:36.675111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9f605-5415-42e1-873a-99a0a71534cb None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:36.679337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 3/6] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:36.685678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710fca6-bf0c-4d5f-992b-b2b98394e6f9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:36.686128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710fca6-bf0c-4d5f-992b-b2b98394e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:36.686249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710fca6-bf0c-4d5f-992b-b2b98394e6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:36.707720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-9710fca6-bf0c-4d5f-992b-b2b98394e6f9 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:36.709274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9710fca6-bf0c-4d5f-992b-b2b98394e6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:36.717276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 4/7] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 31 00:14:37.006228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9f605-5415-42e1-873a-99a0a71534cb None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:37.025403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9f605-5415-42e1-873a-99a0a71534cb None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:37.029684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9b6ef-78ca-42e7-8c11-dc21862108f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:37.030291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b6ef-78ca-42e7-8c11-dc21862108f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:37.030569 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b6ef-78ca-42e7-8c11-dc21862108f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:37.030841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9b6ef-78ca-42e7-8c11-dc21862108f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:37.039698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9b6ef-78ca-42e7-8c11-dc21862108f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:37.041471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9b6ef-78ca-42e7-8c11-dc21862108f9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:37.051751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 4/8] 10.222.0.74 () {58 vars in 1324 bytes} [Wed Aug 31 00:14:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:14:37.057692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710fca6-bf0c-4d5f-992b-b2b98394e6f9 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:37.067057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710fca6-bf0c-4d5f-992b-b2b98394e6f9 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:37.071562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab4512-8cd2-42b8-ba32-1694071c24bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:37.072199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4512-8cd2-42b8-ba32-1694071c24bf admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:37.072481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4512-8cd2-42b8-ba32-1694071c24bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:37.072759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4512-8cd2-42b8-ba32-1694071c24bf admin admin] PATH_INFO: `/v3/users/3409d9d3d7e54fb283ab6923355f5810` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:37.074160 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab4512-8cd2-42b8-ba32-1694071c24bf admin admin] RBAC: Authorizing `identity:get_user(user_id=3409d9d3d7e54fb283ab6923355f5810)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:37.075992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab4512-8cd2-42b8-ba32-1694071c24bf admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:37.077563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 5/9] 10.222.0.74 () {56 vars in 1198 bytes} [Wed Aug 31 00:14:37 2022] GET /identity/v3/users/3409d9d3d7e54fb283ab6923355f5810 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:39.082455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcaf68-13af-4474-8be0-67783da0e152 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:39.083131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcaf68-13af-4474-8be0-67783da0e152 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:39.083131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcaf68-13af-4474-8be0-67783da0e152 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:39.084568 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 5/10] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:39.090109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ca07-3880-4b87-842d-0df94704a0d1 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:39.090845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ca07-3880-4b87-842d-0df94704a0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:39.090845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00ca07-3880-4b87-842d-0df94704a0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:39.109872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8a00ca07-3880-4b87-842d-0df94704a0d1 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:39.111147 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8a00ca07-3880-4b87-842d-0df94704a0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:39.132060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d5a04-fc64-40e9-a3e4-8ce09c88f272 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:39.132349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d5a04-fc64-40e9-a3e4-8ce09c88f272 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:39.132631 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d5a04-fc64-40e9-a3e4-8ce09c88f272 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:39.134435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 6/11] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:14:39.139669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc6f27-8b49-45f2-b467-ce7767969f1c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:39.139956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc6f27-8b49-45f2-b467-ce7767969f1c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:39.140232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc6f27-8b49-45f2-b467-ce7767969f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:39.184044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG passlib.handlers.bcrypt [None req-00dc6f27-8b49-45f2-b467-ce7767969f1c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88178) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 00:14:39.184425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG passlib.handlers.bcrypt [None req-00dc6f27-8b49-45f2-b467-ce7767969f1c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88178) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 00:14:39.199762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 6/12] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:14:39.234148 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-00dc6f27-8b49-45f2-b467-ce7767969f1c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:39.236510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-00dc6f27-8b49-45f2-b467-ce7767969f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:39.354545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 7/13] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:14:39.478511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00ca07-3880-4b87-842d-0df94704a0d1 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:39.508129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:39.595476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00ca07-3880-4b87-842d-0df94704a0d1 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:39.622780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc6f27-8b49-45f2-b467-ce7767969f1c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:39.633252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736aec6-d5a8-4ca6-8c30-734e86f06eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:39.634037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736aec6-d5a8-4ca6-8c30-734e86f06eb8 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:39.634322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736aec6-d5a8-4ca6-8c30-734e86f06eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:39.634605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736aec6-d5a8-4ca6-8c30-734e86f06eb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:39.648353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736aec6-d5a8-4ca6-8c30-734e86f06eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-e736aec6-d5a8-4ca6-8c30-734e86f06eb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:14:39.657801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:14:39.658946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:14:39.659955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 7/14] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:14:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:14:39.667201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736aec6-d5a8-4ca6-8c30-734e86f06eb8 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:39.744704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc6f27-8b49-45f2-b467-ce7767969f1c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:39.747228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:39.759938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:39.779881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736aec6-d5a8-4ca6-8c30-734e86f06eb8 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:39.785236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe39a4-7b2a-467e-9698-b0f80f84b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:39.786152 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe39a4-7b2a-467e-9698-b0f80f84b51e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:39.786440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe39a4-7b2a-467e-9698-b0f80f84b51e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:39.786746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe39a4-7b2a-467e-9698-b0f80f84b51e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:39.819221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e7ac4-47b9-447a-a01b-f00eb533bd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:39.819839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e7ac4-47b9-447a-a01b-f00eb533bd82 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:39.820125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e7ac4-47b9-447a-a01b-f00eb533bd82 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:39.820406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e7ac4-47b9-447a-a01b-f00eb533bd82 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:39.821082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e7ac4-47b9-447a-a01b-f00eb533bd82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:39.821383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e7ac4-47b9-447a-a01b-f00eb533bd82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:39.822845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e7ac4-47b9-447a-a01b-f00eb533bd82 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:39.836257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 8/15] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:14:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:14:39.842051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e7ac4-47b9-447a-a01b-f00eb533bd82 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:39.864510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe39a4-7b2a-467e-9698-b0f80f84b51e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:39.866545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe39a4-7b2a-467e-9698-b0f80f84b51e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:39.950906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e7ac4-47b9-447a-a01b-f00eb533bd82 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:39.986118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 8/16] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:14:39.989339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e868136-da4d-40fc-80b3-6ab619442e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:39.990020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e868136-da4d-40fc-80b3-6ab619442e07 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:39.990306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e868136-da4d-40fc-80b3-6ab619442e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:39.990582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e868136-da4d-40fc-80b3-6ab619442e07 None admin] PATH_INFO: `/v3/users/3409d9d3d7e54fb283ab6923355f5810` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:39.991697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe39a4-7b2a-467e-9698-b0f80f84b51e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:39.991817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e868136-da4d-40fc-80b3-6ab619442e07 None admin] RBAC: Authorizing `identity:get_user(user_id=3409d9d3d7e54fb283ab6923355f5810)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:39.993218 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e868136-da4d-40fc-80b3-6ab619442e07 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:39.994772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:39.994882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 9/17] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:14:39 2022] GET /identity/v3/users/3409d9d3d7e54fb283ab6923355f5810 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:14:40.000970 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e868136-da4d-40fc-80b3-6ab619442e07 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:40.018131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:40.097590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe39a4-7b2a-467e-9698-b0f80f84b51e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:40.116191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e868136-da4d-40fc-80b3-6ab619442e07 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:40.142353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f54658-85fe-471d-8b13-c93d8475db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:40.143272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f54658-85fe-471d-8b13-c93d8475db71 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:40.143761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f54658-85fe-471d-8b13-c93d8475db71 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:40.144248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f54658-85fe-471d-8b13-c93d8475db71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:40.153512 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89337129-01bb-4977-83d1-373295c0fa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:40.154230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89337129-01bb-4977-83d1-373295c0fa45 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:40.154463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89337129-01bb-4977-83d1-373295c0fa45 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:40.154752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89337129-01bb-4977-83d1-373295c0fa45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:40.155917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89337129-01bb-4977-83d1-373295c0fa45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:40.158047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89337129-01bb-4977-83d1-373295c0fa45 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:40.160264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 10/18] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:14:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:14:40.166207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89337129-01bb-4977-83d1-373295c0fa45 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:40.171332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f54658-85fe-471d-8b13-c93d8475db71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:40.172882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f54658-85fe-471d-8b13-c93d8475db71 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-c9f54658-85fe-471d-8b13-c93d8475db71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:14:40.196402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:14:40.197466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:14:40.198565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:14:40.198565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:14:40.198565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:14:40.198565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 9/19] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:14:40.202736 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f54658-85fe-471d-8b13-c93d8475db71 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:40.260572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:40.266303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:40.283906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89337129-01bb-4977-83d1-373295c0fa45 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:40.316807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f54658-85fe-471d-8b13-c93d8475db71 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:40.329905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ea7e3-1232-454c-8beb-dd2d091e30e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:40.330527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ea7e3-1232-454c-8beb-dd2d091e30e9 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:40.330811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ea7e3-1232-454c-8beb-dd2d091e30e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:40.331087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ea7e3-1232-454c-8beb-dd2d091e30e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:40.331826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ea7e3-1232-454c-8beb-dd2d091e30e9 None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.domain.id=default, user.id=3409d9d3d7e54fb283ab6923355f5810) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:40.332140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ea7e3-1232-454c-8beb-dd2d091e30e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:40.333635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ea7e3-1232-454c-8beb-dd2d091e30e9 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:40.354059 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 11/20] 10.222.0.74 () {56 vars in 1322 bytes} [Wed Aug 31 00:14:40 2022] GET /identity/v3/role_assignments?user.id=3409d9d3d7e54fb283ab6923355f5810&scope.domain.id=default&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 233 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:14:40.354509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040aaad1-47da-4df1-a6f0-5fc60a40cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:40.355309 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040aaad1-47da-4df1-a6f0-5fc60a40cb71 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:40.355592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040aaad1-47da-4df1-a6f0-5fc60a40cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:40.355863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040aaad1-47da-4df1-a6f0-5fc60a40cb71 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:40.356549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040aaad1-47da-4df1-a6f0-5fc60a40cb71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:40.356853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040aaad1-47da-4df1-a6f0-5fc60a40cb71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:40.358354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040aaad1-47da-4df1-a6f0-5fc60a40cb71 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:40.379117 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 10/21] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:14:42.694063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae205-6fa6-43f2-a036-674aab1c0ee4 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:42.694580 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae205-6fa6-43f2-a036-674aab1c0ee4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:42.694679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae205-6fa6-43f2-a036-674aab1c0ee4 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:42.695979 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 12/22] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:42.701635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8183c6-8096-4936-9881-cb9627838766 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:42.702528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8183c6-8096-4936-9881-cb9627838766 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:42.703095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8183c6-8096-4936-9881-cb9627838766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:42.731163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-1a8183c6-8096-4936-9881-cb9627838766 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:42.732716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1a8183c6-8096-4936-9881-cb9627838766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:42.834780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 11/23] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:42.868979 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005cfd-6535-4574-9d66-d297f3a64eff None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:42.869301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005cfd-6535-4574-9d66-d297f3a64eff None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:42.869549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005cfd-6535-4574-9d66-d297f3a64eff None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:42.870933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 13/24] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:42.887624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861baf-5d34-42fa-bfd8-c72ec5c4b7d6 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:42.888230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861baf-5d34-42fa-bfd8-c72ec5c4b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:42.888704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861baf-5d34-42fa-bfd8-c72ec5c4b7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:42.923371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-1b861baf-5d34-42fa-bfd8-c72ec5c4b7d6 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:42.924948 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1b861baf-5d34-42fa-bfd8-c72ec5c4b7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:42.996261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:43.029344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 12/25] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:43.142281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a54aa-a0f6-41c8-880c-7c0f93e90286 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:43.142570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a54aa-a0f6-41c8-880c-7c0f93e90286 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:43.142903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a54aa-a0f6-41c8-880c-7c0f93e90286 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:43.144281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 14/26] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:14:43.149921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cef00c-64f4-4835-a425-8d4555e3f35d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:43.150540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cef00c-64f4-4835-a425-8d4555e3f35d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:43.151021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cef00c-64f4-4835-a425-8d4555e3f35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:43.178596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-67cef00c-64f4-4835-a425-8d4555e3f35d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:43.180132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-67cef00c-64f4-4835-a425-8d4555e3f35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:43.278593 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a54aa-a0f6-41c8-880c-7c0f93e90286 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:43.292870 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 13/27] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:43.431337 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a54aa-a0f6-41c8-880c-7c0f93e90286 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:43.469674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cef00c-64f4-4835-a425-8d4555e3f35d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:43.504075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4318a4-dc14-4466-9ffb-01ece0708863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:43.504748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4318a4-dc14-4466-9ffb-01ece0708863 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:43.505033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4318a4-dc14-4466-9ffb-01ece0708863 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:43.505305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4318a4-dc14-4466-9ffb-01ece0708863 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:43.532321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4318a4-dc14-4466-9ffb-01ece0708863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-3e4318a4-dc14-4466-9ffb-01ece0708863 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:14:43.537293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:14:43.538209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:14:43.538965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 15/28] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:14:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:14:43.540382 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95ace-7f07-4396-8018-d92dae697812 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:43.540482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95ace-7f07-4396-8018-d92dae697812 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:43.541621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95ace-7f07-4396-8018-d92dae697812 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:43.544480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 16/29] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:43.554444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95ace-7f07-4396-8018-d92dae697812 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:43.567902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:43.690322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cef00c-64f4-4835-a425-8d4555e3f35d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:43.706789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:43.733803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f8f9b-176c-4392-8305-8c1eba736380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:43.735189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8f9b-176c-4392-8305-8c1eba736380 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:43.735468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8f9b-176c-4392-8305-8c1eba736380 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:43.735740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f8f9b-176c-4392-8305-8c1eba736380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:43.739333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95ace-7f07-4396-8018-d92dae697812 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:43.749611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f8f9b-176c-4392-8305-8c1eba736380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:43.751481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f8f9b-176c-4392-8305-8c1eba736380 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-e89f8f9b-176c-4392-8305-8c1eba736380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:14:43.769239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:14:43.770254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:14:43.771087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:14:43.771087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:14:43.771087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:14:43.773058 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 14/30] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:14:43.775056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d87d-c88b-41bd-aad4-dfe825eb1a10 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:43.775684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d87d-c88b-41bd-aad4-dfe825eb1a10 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:43.776230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d87d-c88b-41bd-aad4-dfe825eb1a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:43.777650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c06cc-6a24-4676-b633-a3b737bcbee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:43.778376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c06cc-6a24-4676-b633-a3b737bcbee5 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:43.778657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c06cc-6a24-4676-b633-a3b737bcbee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:43.778933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c06cc-6a24-4676-b633-a3b737bcbee5 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:43.779627 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c06cc-6a24-4676-b633-a3b737bcbee5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:43.779931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c06cc-6a24-4676-b633-a3b737bcbee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:43.782035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c06cc-6a24-4676-b633-a3b737bcbee5 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:43.791695 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 17/31] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:43.795766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c06cc-6a24-4676-b633-a3b737bcbee5 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:43.805001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-da19d87d-c88b-41bd-aad4-dfe825eb1a10 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:43.806352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-da19d87d-c88b-41bd-aad4-dfe825eb1a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:43.873378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:43.884720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 15/32] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:43.886861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19d87d-c88b-41bd-aad4-dfe825eb1a10 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:43.914917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c06cc-6a24-4676-b633-a3b737bcbee5 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:43.986391 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3c6c7-8192-4856-bee2-b67265f28b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:43.986626 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:43.987481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3c6c7-8192-4856-bee2-b67265f28b0b None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:43.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3c6c7-8192-4856-bee2-b67265f28b0b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:43.988384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3c6c7-8192-4856-bee2-b67265f28b0b None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:43.989242 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3c6c7-8192-4856-bee2-b67265f28b0b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:43.990907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3c6c7-8192-4856-bee2-b67265f28b0b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:44.005639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19d87d-c88b-41bd-aad4-dfe825eb1a10 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:44.038301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0074c6-63ef-48ef-ab66-4dfa0df17e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:44.039026 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0074c6-63ef-48ef-ab66-4dfa0df17e0e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:44.039310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0074c6-63ef-48ef-ab66-4dfa0df17e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:44.039588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0074c6-63ef-48ef-ab66-4dfa0df17e0e None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:44.040254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0074c6-63ef-48ef-ab66-4dfa0df17e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:44.040560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0074c6-63ef-48ef-ab66-4dfa0df17e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:44.042075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0074c6-63ef-48ef-ab66-4dfa0df17e0e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:44.058746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 16/33] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:44.059614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0074c6-63ef-48ef-ab66-4dfa0df17e0e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:44.189605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0074c6-63ef-48ef-ab66-4dfa0df17e0e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:44.232702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a319c1-95e6-4185-856d-827203ff5d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:44.233354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a319c1-95e6-4185-856d-827203ff5d65 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:44.233666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a319c1-95e6-4185-856d-827203ff5d65 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:44.234540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a319c1-95e6-4185-856d-827203ff5d65 None admin] PATH_INFO: `/v3/users/3409d9d3d7e54fb283ab6923355f5810` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:44.236282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a319c1-95e6-4185-856d-827203ff5d65 None admin] RBAC: Authorizing `identity:get_user(user_id=3409d9d3d7e54fb283ab6923355f5810)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:44.237787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a319c1-95e6-4185-856d-827203ff5d65 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:44.239406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 17/34] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:14:44 2022] GET /identity/v3/users/3409d9d3d7e54fb283ab6923355f5810 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:44.240169 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a319c1-95e6-4185-856d-827203ff5d65 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:44.282163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:44.297782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 18/35] 10.222.0.74 () {60 vars in 1131 bytes} [Wed Aug 31 00:14:43 2022] POST /identity/v3/roles => generated 219 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:14:44.297782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3c6c7-8192-4856-bee2-b67265f28b0b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:44.393828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a319c1-95e6-4185-856d-827203ff5d65 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:44.443139 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f4b0e-2c9f-4e91-9668-bc45e2f2cbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:44.443775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4b0e-2c9f-4e91-9668-bc45e2f2cbc4 None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:44.444053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4b0e-2c9f-4e91-9668-bc45e2f2cbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:44.444324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f4b0e-2c9f-4e91-9668-bc45e2f2cbc4 None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:44.445035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f4b0e-2c9f-4e91-9668-bc45e2f2cbc4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:44.446587 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f4b0e-2c9f-4e91-9668-bc45e2f2cbc4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:44.478361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3c6c7-8192-4856-bee2-b67265f28b0b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:44.512805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:44.525673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e561b69-44b3-4eee-98c6-d9197e228feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:44.526456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e561b69-44b3-4eee-98c6-d9197e228feb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:44.526808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e561b69-44b3-4eee-98c6-d9197e228feb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:44.527090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e561b69-44b3-4eee-98c6-d9197e228feb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:44.528385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e561b69-44b3-4eee-98c6-d9197e228feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:44.530125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e561b69-44b3-4eee-98c6-d9197e228feb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:44.531860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 19/36] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:14:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:44.532693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e561b69-44b3-4eee-98c6-d9197e228feb None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:44.649113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e561b69-44b3-4eee-98c6-d9197e228feb None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:44.686796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c1d84-1aca-4026-95e3-04e32b907237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:44.688211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c1d84-1aca-4026-95e3-04e32b907237 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:44.688535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c1d84-1aca-4026-95e3-04e32b907237 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:44.689010 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c1d84-1aca-4026-95e3-04e32b907237 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:44.695771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 18/37] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:14:44 2022] POST /identity/v3/projects => generated 301 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:14:44.695980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c1d84-1aca-4026-95e3-04e32b907237 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:44.696060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69be60-7003-4962-984e-e0192312cded None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:44.696126 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c1d84-1aca-4026-95e3-04e32b907237 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:44.696190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69be60-7003-4962-984e-e0192312cded None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:44.696190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69be60-7003-4962-984e-e0192312cded None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:44.698147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 19/38] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:44.698484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69be60-7003-4962-984e-e0192312cded None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:44.788987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:44.792406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 20/39] 10.222.0.74 () {60 vars in 1131 bytes} [Wed Aug 31 00:14:44 2022] POST /identity/v3/roles => generated 225 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:14:44.795518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94b7b9-639b-4c19-8190-85ec8a026f56 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:44.796125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94b7b9-639b-4c19-8190-85ec8a026f56 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:44.797565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94b7b9-639b-4c19-8190-85ec8a026f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:44.828167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ae94b7b9-639b-4c19-8190-85ec8a026f56 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:44.830391 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ae94b7b9-639b-4c19-8190-85ec8a026f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:44.846930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69be60-7003-4962-984e-e0192312cded None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:44.919162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef80e00-b43e-4b9e-bd7a-913817d3a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:44.919738 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef80e00-b43e-4b9e-bd7a-913817d3a62c None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:44.919907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef80e00-b43e-4b9e-bd7a-913817d3a62c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:44.920154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef80e00-b43e-4b9e-bd7a-913817d3a62c None admin] PATH_INFO: `/v3/domains/default/users/3409d9d3d7e54fb283ab6923355f5810/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:44.924689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef80e00-b43e-4b9e-bd7a-913817d3a62c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3409d9d3d7e54fb283ab6923355f5810, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:44.926501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef80e00-b43e-4b9e-bd7a-913817d3a62c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:45.029862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 20/40] 10.222.0.74 () {58 vars in 1361 bytes} [Wed Aug 31 00:14:44 2022] PUT /identity/v3/domains/default/users/3409d9d3d7e54fb283ab6923355f5810/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:14:45.031751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd78881-6829-48e0-9727-c12c99410f67 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:45.032045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd78881-6829-48e0-9727-c12c99410f67 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:45.032792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd78881-6829-48e0-9727-c12c99410f67 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:45.033510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:45.034365 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 21/41] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:45.041067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e8b6-7e40-4774-ac3c-197abc059454 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:45.041366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e8b6-7e40-4774-ac3c-197abc059454 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:45.041726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826e8b6-7e40-4774-ac3c-197abc059454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:45.061836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 21/42] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:45.076957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-6826e8b6-7e40-4774-ac3c-197abc059454 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:45.078839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6826e8b6-7e40-4774-ac3c-197abc059454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:45.198622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 22/43] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:45.355481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94b7b9-639b-4c19-8190-85ec8a026f56 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:45.490636 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826e8b6-7e40-4774-ac3c-197abc059454 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:45.512037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94b7b9-639b-4c19-8190-85ec8a026f56 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:45.571474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01562918-eb8a-4c7e-a8ec-214fcb9f55f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:45.572497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:45.573187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01562918-eb8a-4c7e-a8ec-214fcb9f55f0 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:45.573187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01562918-eb8a-4c7e-a8ec-214fcb9f55f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:45.573462 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01562918-eb8a-4c7e-a8ec-214fcb9f55f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:45.573997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01562918-eb8a-4c7e-a8ec-214fcb9f55f0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:45.577611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01562918-eb8a-4c7e-a8ec-214fcb9f55f0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:45.620691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826e8b6-7e40-4774-ac3c-197abc059454 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:45.648842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 22/44] 10.222.0.74 () {60 vars in 1131 bytes} [Wed Aug 31 00:14:45 2022] POST /identity/v3/roles => generated 223 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:14:45.677743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e243ff-f468-4ec5-b937-82057da66399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:45.678471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e243ff-f468-4ec5-b937-82057da66399 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:45.678812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e243ff-f468-4ec5-b937-82057da66399 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:45.679135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e243ff-f468-4ec5-b937-82057da66399 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:45.685699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e243ff-f468-4ec5-b937-82057da66399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:45.689396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e243ff-f468-4ec5-b937-82057da66399 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:45.689396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 23/45] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:14:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:45.695573 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01562918-eb8a-4c7e-a8ec-214fcb9f55f0 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:45.759536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:45.863000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01562918-eb8a-4c7e-a8ec-214fcb9f55f0 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:45.915627 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e457bd0-615e-48a4-867b-29951a1e3146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:45.916246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e457bd0-615e-48a4-867b-29951a1e3146 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:45.916527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e457bd0-615e-48a4-867b-29951a1e3146 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:45.916799 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e457bd0-615e-48a4-867b-29951a1e3146 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:45.917469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e457bd0-615e-48a4-867b-29951a1e3146 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:45.919017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e457bd0-615e-48a4-867b-29951a1e3146 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:46.061707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 23/46] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:14:45 2022] POST /identity/v3/projects => generated 312 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:14:47.407847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e1d2f-17dd-4475-a0d3-f6fe9825faad None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:47.408693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e1d2f-17dd-4475-a0d3-f6fe9825faad None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:47.408843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e1d2f-17dd-4475-a0d3-f6fe9825faad None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:47.410302 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 24/47] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:47.416030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c31f0-d4b2-4ee2-937a-198f53bd1eb4 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:47.416498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c31f0-d4b2-4ee2-937a-198f53bd1eb4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:47.416629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c31f0-d4b2-4ee2-937a-198f53bd1eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:47.439300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-4c0c31f0-d4b2-4ee2-937a-198f53bd1eb4 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:47.440632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4c0c31f0-d4b2-4ee2-937a-198f53bd1eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:47.518804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 24/48] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:47.791445 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e1d2f-17dd-4475-a0d3-f6fe9825faad None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:47.910743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e1d2f-17dd-4475-a0d3-f6fe9825faad None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:47.938666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:47.947442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6619a-5291-47df-b8da-1122025d4ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:47.948089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6619a-5291-47df-b8da-1122025d4ed0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:47.948371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6619a-5291-47df-b8da-1122025d4ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:47.952340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6619a-5291-47df-b8da-1122025d4ed0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:47.962594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6619a-5291-47df-b8da-1122025d4ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-b4b6619a-5291-47df-b8da-1122025d4ed0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:14:47.970001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:14:47.973709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:14:47.974504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 25/49] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:14:47.979758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c31f0-d4b2-4ee2-937a-198f53bd1eb4 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:48.010418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:48.063937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c2a0-34fe-4045-855b-89b91dd455f5 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:48.064142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c2a0-34fe-4045-855b-89b91dd455f5 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:48.064422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c2a0-34fe-4045-855b-89b91dd455f5 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:48.065819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 26/50] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:14:48.071525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb910fa-d7fe-4d60-89e2-e7fd8de384ad None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:48.071814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb910fa-d7fe-4d60-89e2-e7fd8de384ad None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:48.072090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb910fa-d7fe-4d60-89e2-e7fd8de384ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:48.090706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-7eb910fa-d7fe-4d60-89e2-e7fd8de384ad None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:48.091918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7eb910fa-d7fe-4d60-89e2-e7fd8de384ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:48.093986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c31f0-d4b2-4ee2-937a-198f53bd1eb4 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:48.134836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cec06d-9e04-4cf8-8af7-60ad2a05fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:48.135489 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cec06d-9e04-4cf8-8af7-60ad2a05fb23 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:48.135787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cec06d-9e04-4cf8-8af7-60ad2a05fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:48.136062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cec06d-9e04-4cf8-8af7-60ad2a05fb23 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:48.136747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cec06d-9e04-4cf8-8af7-60ad2a05fb23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:48.137058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cec06d-9e04-4cf8-8af7-60ad2a05fb23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:48.138528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cec06d-9e04-4cf8-8af7-60ad2a05fb23 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:48.149110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 25/51] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:48.157783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cec06d-9e04-4cf8-8af7-60ad2a05fb23 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:48.174502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 27/52] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:14:48.270930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:48.284115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cec06d-9e04-4cf8-8af7-60ad2a05fb23 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:48.323521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5405a9-c1fd-4f6f-8de8-df4c904d1bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:48.324092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5405a9-c1fd-4f6f-8de8-df4c904d1bef None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:48.324384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5405a9-c1fd-4f6f-8de8-df4c904d1bef None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:48.324658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5405a9-c1fd-4f6f-8de8-df4c904d1bef None admin] PATH_INFO: `/v3/users/3409d9d3d7e54fb283ab6923355f5810` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:48.325909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5405a9-c1fd-4f6f-8de8-df4c904d1bef None admin] RBAC: Authorizing `identity:get_user(user_id=3409d9d3d7e54fb283ab6923355f5810)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:48.327451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5405a9-c1fd-4f6f-8de8-df4c904d1bef None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:48.329105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 26/53] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:14:48 2022] GET /identity/v3/users/3409d9d3d7e54fb283ab6923355f5810 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:14:48.334770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb910fa-d7fe-4d60-89e2-e7fd8de384ad None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:48.443818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5405a9-c1fd-4f6f-8de8-df4c904d1bef None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:48.454991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb910fa-d7fe-4d60-89e2-e7fd8de384ad None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:48.576281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5405a9-c1fd-4f6f-8de8-df4c904d1bef None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:48.584500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:48.603909 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a265244-df86-46b1-87fe-e08618a4afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:48.604561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265244-df86-46b1-87fe-e08618a4afe3 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:48.604847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265244-df86-46b1-87fe-e08618a4afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:48.605205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265244-df86-46b1-87fe-e08618a4afe3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:48.606311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a265244-df86-46b1-87fe-e08618a4afe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:48.607795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a265244-df86-46b1-87fe-e08618a4afe3 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:48.615004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 28/54] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:14:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:48.616014 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a265244-df86-46b1-87fe-e08618a4afe3 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:48.621041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c07e1c-eeec-46c5-8505-1c1be192c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:48.621704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c07e1c-eeec-46c5-8505-1c1be192c39d None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:48.621987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c07e1c-eeec-46c5-8505-1c1be192c39d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:48.622261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c07e1c-eeec-46c5-8505-1c1be192c39d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:48.623539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c07e1c-eeec-46c5-8505-1c1be192c39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:48.625101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c07e1c-eeec-46c5-8505-1c1be192c39d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:48.626717 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 27/55] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:14:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:48.632778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c07e1c-eeec-46c5-8505-1c1be192c39d None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:48.668012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:48.732409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a265244-df86-46b1-87fe-e08618a4afe3 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:48.759111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c07e1c-eeec-46c5-8505-1c1be192c39d None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:48.769981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0a863-6324-4158-8ba1-1ad08b1e1337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:48.770612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0a863-6324-4158-8ba1-1ad08b1e1337 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:48.770958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0a863-6324-4158-8ba1-1ad08b1e1337 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:48.771245 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0a863-6324-4158-8ba1-1ad08b1e1337 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:48.772011 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0a863-6324-4158-8ba1-1ad08b1e1337 None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.domain.id=default, user.id=3409d9d3d7e54fb283ab6923355f5810) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:48.772322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0a863-6324-4158-8ba1-1ad08b1e1337 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:48.773821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0a863-6324-4158-8ba1-1ad08b1e1337 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:48.782841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 29/56] 10.222.0.74 () {56 vars in 1322 bytes} [Wed Aug 31 00:14:48 2022] GET /identity/v3/role_assignments?user.id=3409d9d3d7e54fb283ab6923355f5810&scope.domain.id=default&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 530 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:48.804358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce6c1d-2f34-4fa7-b35d-f7ae80e2044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:48.805130 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce6c1d-2f34-4fa7-b35d-f7ae80e2044b None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:48.805457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce6c1d-2f34-4fa7-b35d-f7ae80e2044b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:48.805766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce6c1d-2f34-4fa7-b35d-f7ae80e2044b None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:48.806432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce6c1d-2f34-4fa7-b35d-f7ae80e2044b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:48.808003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce6c1d-2f34-4fa7-b35d-f7ae80e2044b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:48.906885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 28/57] 10.222.0.74 () {60 vars in 1140 bytes} [Wed Aug 31 00:14:48 2022] POST /identity/v3/projects => generated 298 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:14:50.876054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a160-623e-47a4-ae04-3e127639893a None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:50.876583 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a160-623e-47a4-ae04-3e127639893a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:50.876583 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a160-623e-47a4-ae04-3e127639893a None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:50.877984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 30/58] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:50.883388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fb689-b22b-4db9-a5a5-6428533c5f9e None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:50.883814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fb689-b22b-4db9-a5a5-6428533c5f9e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:50.883955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fb689-b22b-4db9-a5a5-6428533c5f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:50.902611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-798fb689-b22b-4db9-a5a5-6428533c5f9e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:50.903837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-798fb689-b22b-4db9-a5a5-6428533c5f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:50.972268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 29/59] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:51.240531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1a160-623e-47a4-ae04-3e127639893a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:51.293121 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:51.345711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1a160-623e-47a4-ae04-3e127639893a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:51.386797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b9219-6977-496c-8a43-a8072049620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:51.387871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9219-6977-496c-8a43-a8072049620b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:51.388393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9219-6977-496c-8a43-a8072049620b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:51.388988 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9219-6977-496c-8a43-a8072049620b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:51.390670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b9219-6977-496c-8a43-a8072049620b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:51.392448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b9219-6977-496c-8a43-a8072049620b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:51.394098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 31/60] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:14:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:51.399885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fb689-b22b-4db9-a5a5-6428533c5f9e None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:51.409070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:51.509533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fb689-b22b-4db9-a5a5-6428533c5f9e None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:51.546761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a0703-2dfb-43e0-bd5a-7cb2a5788a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:51.547383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a0703-2dfb-43e0-bd5a-7cb2a5788a10 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:51.547664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a0703-2dfb-43e0-bd5a-7cb2a5788a10 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:51.547942 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a0703-2dfb-43e0-bd5a-7cb2a5788a10 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:51.548598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a0703-2dfb-43e0-bd5a-7cb2a5788a10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:51.550091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a0703-2dfb-43e0-bd5a-7cb2a5788a10 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:51.645084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 30/61] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:14:51 2022] POST /identity/v3/users => generated 275 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:14:54.767866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d377-771e-46c0-aead-27d04c73050c None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:54.768898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d377-771e-46c0-aead-27d04c73050c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:54.769380 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d377-771e-46c0-aead-27d04c73050c None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:54.771252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 32/62] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:54.777090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c2be8-9834-43a4-8836-3e52a49f004f None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:54.778006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c2be8-9834-43a4-8836-3e52a49f004f None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:54.778489 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c2be8-9834-43a4-8836-3e52a49f004f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:54.811099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-b69c2be8-9834-43a4-8836-3e52a49f004f None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:54.813793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b69c2be8-9834-43a4-8836-3e52a49f004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:54.901507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:54.915535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 31/63] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:54.939088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee637e-16b5-4184-8bcb-57fea5d4e515 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:54.939428 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee637e-16b5-4184-8bcb-57fea5d4e515 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:54.939911 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee637e-16b5-4184-8bcb-57fea5d4e515 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:54.941531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 33/64] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:54.947131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832486e9-f406-48a2-963c-0431de1b3c10 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:54.947434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832486e9-f406-48a2-963c-0431de1b3c10 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:54.947775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832486e9-f406-48a2-963c-0431de1b3c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:54.976266 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-832486e9-f406-48a2-963c-0431de1b3c10 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:54.977560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-832486e9-f406-48a2-963c-0431de1b3c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:55.035120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092c01-cd92-4013-a859-f9f580a47365 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:55.035549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092c01-cd92-4013-a859-f9f580a47365 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:55.036013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092c01-cd92-4013-a859-f9f580a47365 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:55.037554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 34/65] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:55.044533 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de079871-c7d8-4e2a-a381-ca2496ae7b76 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:55.044840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de079871-c7d8-4e2a-a381-ca2496ae7b76 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:55.045125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de079871-c7d8-4e2a-a381-ca2496ae7b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:55.082231 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 32/66] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:55.090715 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-de079871-c7d8-4e2a-a381-ca2496ae7b76 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:55.091975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-de079871-c7d8-4e2a-a381-ca2496ae7b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:55.194069 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 35/67] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:14:55.359832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832486e9-f406-48a2-963c-0431de1b3c10 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:55.447599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de079871-c7d8-4e2a-a381-ca2496ae7b76 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:55.473899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832486e9-f406-48a2-963c-0431de1b3c10 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:55.500384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:55.526134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a74e4-95e0-4b30-8045-bfe2e1395030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:55.526910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a74e4-95e0-4b30-8045-bfe2e1395030 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:55.527209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a74e4-95e0-4b30-8045-bfe2e1395030 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:55.527500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a74e4-95e0-4b30-8045-bfe2e1395030 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:55.543785 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a74e4-95e0-4b30-8045-bfe2e1395030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-9c7a74e4-95e0-4b30-8045-bfe2e1395030 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:14:55.550333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:14:55.551233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:14:55.552006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 33/68] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:14:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:14:55.559790 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a74e4-95e0-4b30-8045-bfe2e1395030 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:55.573987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:55.632512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de079871-c7d8-4e2a-a381-ca2496ae7b76 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:55.674733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a74e4-95e0-4b30-8045-bfe2e1395030 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:55.675233 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eecd7-f68f-4e12-9e4b-a2c68569a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:55.675895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eecd7-f68f-4e12-9e4b-a2c68569a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:55.676178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eecd7-f68f-4e12-9e4b-a2c68569a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:55.676461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eecd7-f68f-4e12-9e4b-a2c68569a1f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:55.688901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7eecd7-f68f-4e12-9e4b-a2c68569a1f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-8c7eecd7-f68f-4e12-9e4b-a2c68569a1f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:14:55.693946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:14:55.694807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:14:55.695661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 36/69] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:14:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:14:55.696289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbc3e8-7424-4c32-91fc-a100cda12ca1 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:55.696726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbc3e8-7424-4c32-91fc-a100cda12ca1 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:55.696944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbc3e8-7424-4c32-91fc-a100cda12ca1 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:55.698438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 37/70] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:55.699993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbc3e8-7424-4c32-91fc-a100cda12ca1 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:55.714187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fe175-6648-44a0-9e5e-1dc6052511af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:55.714825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fe175-6648-44a0-9e5e-1dc6052511af None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:55.715109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fe175-6648-44a0-9e5e-1dc6052511af None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:55.715386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fe175-6648-44a0-9e5e-1dc6052511af None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:55.716067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0fe175-6648-44a0-9e5e-1dc6052511af None admin] RBAC: Adding query filter params (name=member) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:55.716372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0fe175-6648-44a0-9e5e-1dc6052511af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:55.718305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0fe175-6648-44a0-9e5e-1dc6052511af None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:55.728425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 34/71] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:14:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:14:55.729700 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2068-6ab5-4087-9e21-2ac7944b3a88 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:55.729997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2068-6ab5-4087-9e21-2ac7944b3a88 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:55.730336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2068-6ab5-4087-9e21-2ac7944b3a88 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:55.731613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 35/72] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:55.732333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a2068-6ab5-4087-9e21-2ac7944b3a88 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:55.782135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:55.811223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbc3e8-7424-4c32-91fc-a100cda12ca1 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:55.818608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:55.841817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a2068-6ab5-4087-9e21-2ac7944b3a88 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:55.846716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e764a-f4a1-462c-82b6-5ae714f71d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:55.847363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e764a-f4a1-462c-82b6-5ae714f71d2b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:55.847644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e764a-f4a1-462c-82b6-5ae714f71d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:55.847922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e764a-f4a1-462c-82b6-5ae714f71d2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:55.859384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e764a-f4a1-462c-82b6-5ae714f71d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-a70e764a-f4a1-462c-82b6-5ae714f71d2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:14:55.864303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:14:55.865199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:14:55.866025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 38/73] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:14:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:14:55.868432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36db06-e115-4c06-822c-e8c5950b4264 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:55.868684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36db06-e115-4c06-822c-e8c5950b4264 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:55.868969 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36db06-e115-4c06-822c-e8c5950b4264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:55.879421 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714449b-dc8b-43a5-afd8-913d8d26b4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:55.880048 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714449b-dc8b-43a5-afd8-913d8d26b4aa None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:55.880335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714449b-dc8b-43a5-afd8-913d8d26b4aa None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:55.880615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714449b-dc8b-43a5-afd8-913d8d26b4aa None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:55.881291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714449b-dc8b-43a5-afd8-913d8d26b4aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:55.881626 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714449b-dc8b-43a5-afd8-913d8d26b4aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:55.883603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714449b-dc8b-43a5-afd8-913d8d26b4aa None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:55.887537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0e36db06-e115-4c06-822c-e8c5950b4264 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:55.888770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0e36db06-e115-4c06-822c-e8c5950b4264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:55.891983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 36/74] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:55.894519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714449b-dc8b-43a5-afd8-913d8d26b4aa None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:55.961740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 39/75] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:55.966912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880f88-2845-4648-8767-5589631e73bf None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:55.967203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880f88-2845-4648-8767-5589631e73bf None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:55.967488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59880f88-2845-4648-8767-5589631e73bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:55.987171 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-59880f88-2845-4648-8767-5589631e73bf None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:55.988387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-59880f88-2845-4648-8767-5589631e73bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:56.005033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714449b-dc8b-43a5-afd8-913d8d26b4aa None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:56.012641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:56.042585 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa31ba-3996-4164-a515-15e3c96b5ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:56.043155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa31ba-3996-4164-a515-15e3c96b5ca2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:56.043447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa31ba-3996-4164-a515-15e3c96b5ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:56.043727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa31ba-3996-4164-a515-15e3c96b5ca2 None admin] PATH_INFO: `/v3/users/179076a3421248bdafab3719775f8040` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:56.065800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa31ba-3996-4164-a515-15e3c96b5ca2 None admin] RBAC: Authorizing `identity:get_user(user_id=179076a3421248bdafab3719775f8040)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:56.073743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 40/76] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:14:56.073743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880f88-2845-4648-8767-5589631e73bf None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:56.073966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa31ba-3996-4164-a515-15e3c96b5ca2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:56.073966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 37/77] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:14:55 2022] GET /identity/v3/users/179076a3421248bdafab3719775f8040 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:56.073966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa31ba-3996-4164-a515-15e3c96b5ca2 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:56.111775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:56.205623 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59880f88-2845-4648-8767-5589631e73bf None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:56.219755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa31ba-3996-4164-a515-15e3c96b5ca2 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:56.247242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9061e-f8a5-49e5-aee7-7f4f2bb550d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:56.247866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9061e-f8a5-49e5-aee7-7f4f2bb550d7 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:56.248149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9061e-f8a5-49e5-aee7-7f4f2bb550d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:56.248429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9061e-f8a5-49e5-aee7-7f4f2bb550d7 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:56.249220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9061e-f8a5-49e5-aee7-7f4f2bb550d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:56.249528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9061e-f8a5-49e5-aee7-7f4f2bb550d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:56.250980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9061e-f8a5-49e5-aee7-7f4f2bb550d7 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:56.268750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 41/78] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:14:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:56.268750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9061e-f8a5-49e5-aee7-7f4f2bb550d7 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:56.275146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fec8f-39f2-4b18-a8a5-15d01316049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:56.276476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fec8f-39f2-4b18-a8a5-15d01316049c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:56.276939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fec8f-39f2-4b18-a8a5-15d01316049c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:56.277362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fec8f-39f2-4b18-a8a5-15d01316049c None admin] PATH_INFO: `/v3/users/3409d9d3d7e54fb283ab6923355f5810` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:56.279111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fec8f-39f2-4b18-a8a5-15d01316049c None admin] RBAC: Authorizing `identity:get_user(user_id=3409d9d3d7e54fb283ab6923355f5810)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:56.282369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fec8f-39f2-4b18-a8a5-15d01316049c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:56.285059 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 38/79] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:14:56 2022] GET /identity/v3/users/3409d9d3d7e54fb283ab6923355f5810 => generated 247 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:56.286233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fec8f-39f2-4b18-a8a5-15d01316049c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:56.331756 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:56.379871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:56.395078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9061e-f8a5-49e5-aee7-7f4f2bb550d7 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:56.416975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fec8f-39f2-4b18-a8a5-15d01316049c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:56.438166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae458e-86a0-4ba8-a38c-05477cdc3ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:56.438787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae458e-86a0-4ba8-a38c-05477cdc3ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:56.439078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae458e-86a0-4ba8-a38c-05477cdc3ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:56.439358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae458e-86a0-4ba8-a38c-05477cdc3ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:56.453757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6d8b8-216f-474c-b6c5-2cc16544925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:56.454408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6d8b8-216f-474c-b6c5-2cc16544925e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:56.454697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6d8b8-216f-474c-b6c5-2cc16544925e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:56.454981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6d8b8-216f-474c-b6c5-2cc16544925e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:56.456177 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6d8b8-216f-474c-b6c5-2cc16544925e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:56.457625 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6d8b8-216f-474c-b6c5-2cc16544925e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:56.459226 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 39/80] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:14:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:56.460063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6d8b8-216f-474c-b6c5-2cc16544925e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:56.512472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae458e-86a0-4ba8-a38c-05477cdc3ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:56.514007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae458e-86a0-4ba8-a38c-05477cdc3ff6 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:56.563735 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:56.567223 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6d8b8-216f-474c-b6c5-2cc16544925e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:56.604485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689fc80-b569-4160-8867-9ea95feba2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:56.605139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689fc80-b569-4160-8867-9ea95feba2bb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:56.605356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:56.605454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689fc80-b569-4160-8867-9ea95feba2bb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:56.605737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689fc80-b569-4160-8867-9ea95feba2bb None admin] PATH_INFO: `/v3/users/179076a3421248bdafab3719775f8040` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:56.606924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689fc80-b569-4160-8867-9ea95feba2bb None admin] RBAC: Authorizing `identity:get_user(user_id=179076a3421248bdafab3719775f8040)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:56.608973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689fc80-b569-4160-8867-9ea95feba2bb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:56.610669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 40/81] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:14:56 2022] GET /identity/v3/users/179076a3421248bdafab3719775f8040 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:56.611464 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689fc80-b569-4160-8867-9ea95feba2bb None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:56.624660 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 42/82] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:14:56.625529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae458e-86a0-4ba8-a38c-05477cdc3ff6 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:56.725085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689fc80-b569-4160-8867-9ea95feba2bb None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:56.742376 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae458e-86a0-4ba8-a38c-05477cdc3ff6 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:56.760797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1271e-224b-4171-9ae8-1dfcf523a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:56.761426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1271e-224b-4171-9ae8-1dfcf523a679 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:56.761950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1271e-224b-4171-9ae8-1dfcf523a679 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:56.762151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1271e-224b-4171-9ae8-1dfcf523a679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:56.780713 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6fa7-b74b-4eb3-9642-814c790f6017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:56.781367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6fa7-b74b-4eb3-9642-814c790f6017 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:56.781689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6fa7-b74b-4eb3-9642-814c790f6017 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:56.781974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6fa7-b74b-4eb3-9642-814c790f6017 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:56.792370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e6fa7-b74b-4eb3-9642-814c790f6017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-079e6fa7-b74b-4eb3-9642-814c790f6017 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:14:56.797849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:14:56.798815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:14:56.799921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 43/83] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:14:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:14:56.802013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:56.804808 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6fa7-b74b-4eb3-9642-814c790f6017 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:56.838492 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1271e-224b-4171-9ae8-1dfcf523a679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:56.839603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1271e-224b-4171-9ae8-1dfcf523a679 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:56.859796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:56.914018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6fa7-b74b-4eb3-9642-814c790f6017 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:56.947563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 41/84] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:14:56.948427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1271e-224b-4171-9ae8-1dfcf523a679 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:56.954702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8893b4-c29d-4310-a03f-148b20cd3cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:56.956095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8893b4-c29d-4310-a03f-148b20cd3cef None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:56.956280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8893b4-c29d-4310-a03f-148b20cd3cef None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:56.956782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8893b4-c29d-4310-a03f-148b20cd3cef None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:56.958045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8893b4-c29d-4310-a03f-148b20cd3cef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:56.960208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8893b4-c29d-4310-a03f-148b20cd3cef None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:57.018817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:57.046210 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 44/85] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:14:56 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:14:57.047258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8893b4-c29d-4310-a03f-148b20cd3cef None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:57.064459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1271e-224b-4171-9ae8-1dfcf523a679 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:57.128445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed640f-dfa0-4507-93bb-eae412ec3545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:57.129379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed640f-dfa0-4507-93bb-eae412ec3545 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:57.129878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed640f-dfa0-4507-93bb-eae412ec3545 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:57.130333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed640f-dfa0-4507-93bb-eae412ec3545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:57.219903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8893b4-c29d-4310-a03f-148b20cd3cef None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:57.222703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:57.234987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed640f-dfa0-4507-93bb-eae412ec3545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:57.237902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed640f-dfa0-4507-93bb-eae412ec3545 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:57.263095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbc4dc-9c85-4576-8a8d-373c368d9c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:57.263741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbc4dc-9c85-4576-8a8d-373c368d9c76 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:57.264020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbc4dc-9c85-4576-8a8d-373c368d9c76 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:57.264298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbc4dc-9c85-4576-8a8d-373c368d9c76 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:57.265640 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbc4dc-9c85-4576-8a8d-373c368d9c76 None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:57.268584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbc4dc-9c85-4576-8a8d-373c368d9c76 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:57.269321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 45/86] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:14:57 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:57.270104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbc4dc-9c85-4576-8a8d-373c368d9c76 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:57.329963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:57.377326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 42/87] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:14:57.383026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed640f-dfa0-4507-93bb-eae412ec3545 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:57.410027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbc4dc-9c85-4576-8a8d-373c368d9c76 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:57.451967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1a173-662e-4f3f-a9fb-54e68b26a102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:57.453407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1a173-662e-4f3f-a9fb-54e68b26a102 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:57.453866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1a173-662e-4f3f-a9fb-54e68b26a102 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:57.454289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1a173-662e-4f3f-a9fb-54e68b26a102 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:57.455241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1a173-662e-4f3f-a9fb-54e68b26a102 None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:57.455731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1a173-662e-4f3f-a9fb-54e68b26a102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:57.457370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1a173-662e-4f3f-a9fb-54e68b26a102 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:57.477611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 46/88] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:14:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:57.477611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1a173-662e-4f3f-a9fb-54e68b26a102 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:57.506788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed640f-dfa0-4507-93bb-eae412ec3545 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:57.518959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:57.550770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2f49b-bbd6-4d3a-8041-73eacad7e12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:57.551438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2f49b-bbd6-4d3a-8041-73eacad7e12d None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:57.551725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2f49b-bbd6-4d3a-8041-73eacad7e12d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:57.551998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2f49b-bbd6-4d3a-8041-73eacad7e12d None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:57.553251 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2f49b-bbd6-4d3a-8041-73eacad7e12d None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:57.554816 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2f49b-bbd6-4d3a-8041-73eacad7e12d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:57.556840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 43/89] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:14:57 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:57.557800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2f49b-bbd6-4d3a-8041-73eacad7e12d None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:57.597644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1a173-662e-4f3f-a9fb-54e68b26a102 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:57.599003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:57.639115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466d29-2ecc-4113-b867-7e2e83e53cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:57.640289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466d29-2ecc-4113-b867-7e2e83e53cfb None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:57.640682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466d29-2ecc-4113-b867-7e2e83e53cfb None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:57.640968 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466d29-2ecc-4113-b867-7e2e83e53cfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:57.641859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466d29-2ecc-4113-b867-7e2e83e53cfb None admin] RBAC: Adding query filter params (role.id=bec3ab91aff841e286162327678e1cc6, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b, user.id=179076a3421248bdafab3719775f8040) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:57.642181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466d29-2ecc-4113-b867-7e2e83e53cfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:57.643659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466d29-2ecc-4113-b867-7e2e83e53cfb None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:57.650578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 47/90] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:14:57 2022] GET /identity/v3/role_assignments?user.id=179076a3421248bdafab3719775f8040&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=bec3ab91aff841e286162327678e1cc6 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:57.651269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466d29-2ecc-4113-b867-7e2e83e53cfb None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:57.714756 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2f49b-bbd6-4d3a-8041-73eacad7e12d None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:57.813911 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:57.822352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466d29-2ecc-4113-b867-7e2e83e53cfb None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:57.827825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea15c2-8142-421b-89d7-4fab7d936026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:57.829193 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea15c2-8142-421b-89d7-4fab7d936026 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:57.829684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea15c2-8142-421b-89d7-4fab7d936026 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:57.830106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea15c2-8142-421b-89d7-4fab7d936026 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:57.831502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea15c2-8142-421b-89d7-4fab7d936026 None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:57.833125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea15c2-8142-421b-89d7-4fab7d936026 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:57.835049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 44/91] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:14:57 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:57.835976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea15c2-8142-421b-89d7-4fab7d936026 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:57.906379 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebba55-fcbf-4629-a337-f4e9e33604cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:57.907759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebba55-fcbf-4629-a337-f4e9e33604cf None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:57.908190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebba55-fcbf-4629-a337-f4e9e33604cf None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:57.908646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebba55-fcbf-4629-a337-f4e9e33604cf None admin] PATH_INFO: `/v3/users/179076a3421248bdafab3719775f8040` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:57.910087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebba55-fcbf-4629-a337-f4e9e33604cf None admin] RBAC: Authorizing `identity:get_user(user_id=179076a3421248bdafab3719775f8040)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:57.912054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebba55-fcbf-4629-a337-f4e9e33604cf None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:57.914671 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 48/92] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:14:57 2022] GET /identity/v3/users/179076a3421248bdafab3719775f8040 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:57.915659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebba55-fcbf-4629-a337-f4e9e33604cf None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:58.043556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebba55-fcbf-4629-a337-f4e9e33604cf None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:58.086704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793f5eb-7a31-42ed-9c16-968735f6fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:58.087571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793f5eb-7a31-42ed-9c16-968735f6fe05 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:58.088001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793f5eb-7a31-42ed-9c16-968735f6fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:58.088633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793f5eb-7a31-42ed-9c16-968735f6fe05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:58.089989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793f5eb-7a31-42ed-9c16-968735f6fe05 None admin] RBAC: Adding query filter params (role.id=20d736bdf9df414f9e9b2ae27c77c071, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b, user.id=179076a3421248bdafab3719775f8040) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:58.090628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793f5eb-7a31-42ed-9c16-968735f6fe05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:58.092329 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793f5eb-7a31-42ed-9c16-968735f6fe05 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:58.095781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea15c2-8142-421b-89d7-4fab7d936026 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:58.100582 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 49/93] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:14:57 2022] GET /identity/v3/role_assignments?user.id=179076a3421248bdafab3719775f8040&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=20d736bdf9df414f9e9b2ae27c77c071 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:58.101320 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:58.104159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793f5eb-7a31-42ed-9c16-968735f6fe05 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:58.168839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:58.213792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e3419-97f6-4e09-a1b9-cca0bf686365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:58.214430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e3419-97f6-4e09-a1b9-cca0bf686365 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:58.214714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e3419-97f6-4e09-a1b9-cca0bf686365 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:58.214990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e3419-97f6-4e09-a1b9-cca0bf686365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:58.215734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e3419-97f6-4e09-a1b9-cca0bf686365 None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b, user.id=3409d9d3d7e54fb283ab6923355f5810) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:58.216042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e3419-97f6-4e09-a1b9-cca0bf686365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:58.217554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e3419-97f6-4e09-a1b9-cca0bf686365 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:58.235551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 45/94] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:14:57 2022] GET /identity/v3/role_assignments?user.id=3409d9d3d7e54fb283ab6923355f5810&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 259 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:58.295679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793f5eb-7a31-42ed-9c16-968735f6fe05 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:58.359118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b1f22-3324-47aa-af92-6865335ddfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:58.360080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1f22-3324-47aa-af92-6865335ddfac None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:58.360577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1f22-3324-47aa-af92-6865335ddfac None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:58.361044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1f22-3324-47aa-af92-6865335ddfac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:58.456323 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b1f22-3324-47aa-af92-6865335ddfac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:58.458307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b1f22-3324-47aa-af92-6865335ddfac None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:58.504930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:58.584938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 50/95] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:14:58.590673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e3419-97f6-4e09-a1b9-cca0bf686365 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:58.719132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e3419-97f6-4e09-a1b9-cca0bf686365 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:58.770859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab0ca8-6d1a-480c-97d6-c4c0e22406ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:58.771529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab0ca8-6d1a-480c-97d6-c4c0e22406ae None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:58.771795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab0ca8-6d1a-480c-97d6-c4c0e22406ae None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:58.772070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab0ca8-6d1a-480c-97d6-c4c0e22406ae None admin] PATH_INFO: `/v3/projects/3d670c30e85a481386f42fa2d7543eb3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:58.773229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab0ca8-6d1a-480c-97d6-c4c0e22406ae None admin] RBAC: Authorizing `identity:get_project(project_id=3d670c30e85a481386f42fa2d7543eb3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:58.775458 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab0ca8-6d1a-480c-97d6-c4c0e22406ae None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:58.777535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 46/96] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:14:58 2022] GET /identity/v3/projects/3d670c30e85a481386f42fa2d7543eb3 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:58.784379 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b1f22-3324-47aa-af92-6865335ddfac None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:14:58.919954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b1f22-3324-47aa-af92-6865335ddfac None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:14:58.955250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:14:58.961286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c99b5-8894-4b49-9c01-9034ecb70c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:14:58.961946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c99b5-8894-4b49-9c01-9034ecb70c8f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:58.962226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c99b5-8894-4b49-9c01-9034ecb70c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:58.962500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c99b5-8894-4b49-9c01-9034ecb70c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:58.963242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c99b5-8894-4b49-9c01-9034ecb70c8f None admin] RBAC: Adding query filter params (role.id=bec3ab91aff841e286162327678e1cc6, scope.project.id=3d670c30e85a481386f42fa2d7543eb3, user.id=179076a3421248bdafab3719775f8040) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:14:58.963550 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c99b5-8894-4b49-9c01-9034ecb70c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:14:58.965009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c99b5-8894-4b49-9c01-9034ecb70c8f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:14:58.972485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 51/97] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:14:58 2022] GET /identity/v3/role_assignments?user.id=179076a3421248bdafab3719775f8040&scope.project.id=3d670c30e85a481386f42fa2d7543eb3&role.id=bec3ab91aff841e286162327678e1cc6 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:14:59.823901 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cf966-5b21-4d36-856e-ee6f212c3c62 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:59.824414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cf966-5b21-4d36-856e-ee6f212c3c62 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:59.824518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cf966-5b21-4d36-856e-ee6f212c3c62 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:59.825978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 47/98] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:14:59.832576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500290b4-1bed-47bc-8161-b68ed446d89c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:14:59.832870 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500290b4-1bed-47bc-8161-b68ed446d89c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:14:59.833155 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500290b4-1bed-47bc-8161-b68ed446d89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:14:59.860871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-500290b4-1bed-47bc-8161-b68ed446d89c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:14:59.862173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-500290b4-1bed-47bc-8161-b68ed446d89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:14:59.974911 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 52/99] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:00.030608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496ebc5-9139-49c9-bac6-d36ead51f9aa None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:00.031565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496ebc5-9139-49c9-bac6-d36ead51f9aa None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:00.032089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496ebc5-9139-49c9-bac6-d36ead51f9aa None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:00.033780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 48/100] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:00.039610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02418f03-37db-49a0-aaa8-037bd39ab5b4 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:00.040242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02418f03-37db-49a0-aaa8-037bd39ab5b4 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:00.040722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02418f03-37db-49a0-aaa8-037bd39ab5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:00.060403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-02418f03-37db-49a0-aaa8-037bd39ab5b4 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:00.062089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-02418f03-37db-49a0-aaa8-037bd39ab5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:00.144265 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 53/101] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:00.498392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496ebc5-9139-49c9-bac6-d36ead51f9aa None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:00.521193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02418f03-37db-49a0-aaa8-037bd39ab5b4 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:00.580915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:00.631689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:00.710215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02418f03-37db-49a0-aaa8-037bd39ab5b4 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:00.739711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496ebc5-9139-49c9-bac6-d36ead51f9aa None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:00.755075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921f9fe-0d23-488b-a6df-e1df5e8e36a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:00.756161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921f9fe-0d23-488b-a6df-e1df5e8e36a2 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:00.756453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921f9fe-0d23-488b-a6df-e1df5e8e36a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:00.756906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921f9fe-0d23-488b-a6df-e1df5e8e36a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:00.770646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921f9fe-0d23-488b-a6df-e1df5e8e36a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-6921f9fe-0d23-488b-a6df-e1df5e8e36a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:00.777634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:00.778707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:00.779588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:00.782912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 54/102] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:00.784474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080328-eb49-4612-854b-760f3b85bb0b None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:00.784955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080328-eb49-4612-854b-760f3b85bb0b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:00.785366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080328-eb49-4612-854b-760f3b85bb0b None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:00.787011 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 55/103] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:00.793731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901acf1-7cc2-4953-932f-28811e88d388 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:00.794513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901acf1-7cc2-4953-932f-28811e88d388 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:00.794940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901acf1-7cc2-4953-932f-28811e88d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:00.820637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed62c6-49b2-460a-bd9c-48519ac581aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:00.821535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed62c6-49b2-460a-bd9c-48519ac581aa None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:00.822010 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed62c6-49b2-460a-bd9c-48519ac581aa None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:00.822423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed62c6-49b2-460a-bd9c-48519ac581aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:00.827359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed62c6-49b2-460a-bd9c-48519ac581aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:00.829463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed62c6-49b2-460a-bd9c-48519ac581aa None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:00.832487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-f901acf1-7cc2-4953-932f-28811e88d388 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:00.833875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f901acf1-7cc2-4953-932f-28811e88d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:00.836239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 49/104] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:00.837162 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed62c6-49b2-460a-bd9c-48519ac581aa None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:00.992111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 56/105] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:00.993695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901acf1-7cc2-4953-932f-28811e88d388 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:01.035602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed62c6-49b2-460a-bd9c-48519ac581aa None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:01.036855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:01.080386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af16066-b5d6-4d43-92d5-19d3d3de900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:01.081027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af16066-b5d6-4d43-92d5-19d3d3de900a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.081313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af16066-b5d6-4d43-92d5-19d3d3de900a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.081615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af16066-b5d6-4d43-92d5-19d3d3de900a None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.082304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af16066-b5d6-4d43-92d5-19d3d3de900a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:01.082614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af16066-b5d6-4d43-92d5-19d3d3de900a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:01.084176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af16066-b5d6-4d43-92d5-19d3d3de900a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:01.097266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:01.098921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 50/106] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:01.102424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45753c-f206-41bf-87a7-c1c8727d58b9 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.102717 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45753c-f206-41bf-87a7-c1c8727d58b9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.102997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45753c-f206-41bf-87a7-c1c8727d58b9 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.106361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 51/107] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:01.109955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45753c-f206-41bf-87a7-c1c8727d58b9 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:01.213298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901acf1-7cc2-4953-932f-28811e88d388 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:01.241290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45753c-f206-41bf-87a7-c1c8727d58b9 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:01.278712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381edc1-b4e9-4a7f-9939-71a75cba33a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:01.279471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381edc1-b4e9-4a7f-9939-71a75cba33a5 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.280343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381edc1-b4e9-4a7f-9939-71a75cba33a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.280795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381edc1-b4e9-4a7f-9939-71a75cba33a5 None admin] PATH_INFO: `/v3/users/ea43c97f6ab94d598a03b4220a9d943c` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.297024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381edc1-b4e9-4a7f-9939-71a75cba33a5 None admin] RBAC: Authorizing `identity:get_user(user_id=ea43c97f6ab94d598a03b4220a9d943c)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:01.298559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381edc1-b4e9-4a7f-9939-71a75cba33a5 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:01.301017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 52/108] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:01 2022] GET /identity/v3/users/ea43c97f6ab94d598a03b4220a9d943c => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:01.302458 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c001-3e85-4c6c-8ad3-946965e862a7 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.302811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c001-3e85-4c6c-8ad3-946965e862a7 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.303097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c001-3e85-4c6c-8ad3-946965e862a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.308375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98d5ba-1586-4661-a5cc-aede8e35adef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:01.309024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d5ba-1586-4661-a5cc-aede8e35adef None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.309313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d5ba-1586-4661-a5cc-aede8e35adef None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.309610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d5ba-1586-4661-a5cc-aede8e35adef None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.310292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98d5ba-1586-4661-a5cc-aede8e35adef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:01.312160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98d5ba-1586-4661-a5cc-aede8e35adef None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:01.323000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-5df8c001-3e85-4c6c-8ad3-946965e862a7 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:01.324589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5df8c001-3e85-4c6c-8ad3-946965e862a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:01.345222 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:01.396483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 53/109] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:01.397255 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c001-3e85-4c6c-8ad3-946965e862a7 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:01.429547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 57/110] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:15:00 2022] POST /identity/v3/projects => generated 302 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:01.432835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98d5ba-1586-4661-a5cc-aede8e35adef None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:01.568869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:01.576063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98d5ba-1586-4661-a5cc-aede8e35adef None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:01.579447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c001-3e85-4c6c-8ad3-946965e862a7 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:01.621617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db59af7-1293-40fc-ae08-3812aa739fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:01.622557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db59af7-1293-40fc-ae08-3812aa739fab None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.623615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db59af7-1293-40fc-ae08-3812aa739fab None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.624791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db59af7-1293-40fc-ae08-3812aa739fab None admin] PATH_INFO: `/v3/roles/member` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.639173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db59af7-1293-40fc-ae08-3812aa739fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-2db59af7-1293-40fc-ae08-3812aa739fab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:01.645191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:01.646340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:01.647295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:01.649897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 58/111] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:01.651863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829df9-59cf-47d7-8594-4794ff5404d9 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.652306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829df9-59cf-47d7-8594-4794ff5404d9 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.653047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829df9-59cf-47d7-8594-4794ff5404d9 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.654614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 59/112] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:01.661821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49829df9-59cf-47d7-8594-4794ff5404d9 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:01.672797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a2d92-5316-4bd0-afb9-67df7eceafca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:01.673436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a2d92-5316-4bd0-afb9-67df7eceafca None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.678611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a2d92-5316-4bd0-afb9-67df7eceafca None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.678611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a2d92-5316-4bd0-afb9-67df7eceafca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.730410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:01.803971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a2d92-5316-4bd0-afb9-67df7eceafca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:01.807222 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a2d92-5316-4bd0-afb9-67df7eceafca None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:01.818097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49829df9-59cf-47d7-8594-4794ff5404d9 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:01.901931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae137678-8da9-4bd5-b034-d6dc68714f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:01.902908 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae137678-8da9-4bd5-b034-d6dc68714f4c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.903409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae137678-8da9-4bd5-b034-d6dc68714f4c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.903947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae137678-8da9-4bd5-b034-d6dc68714f4c None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.904887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae137678-8da9-4bd5-b034-d6dc68714f4c None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:01.905387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae137678-8da9-4bd5-b034-d6dc68714f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:01.907214 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae137678-8da9-4bd5-b034-d6dc68714f4c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:01.916920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 60/113] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:01.918747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58d3f-7316-41b1-baf3-ca5b4b9945ad None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:01.919234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58d3f-7316-41b1-baf3-ca5b4b9945ad None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:01.919720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58d3f-7316-41b1-baf3-ca5b4b9945ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:01.935782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 54/114] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:01.937206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a2d92-5316-4bd0-afb9-67df7eceafca None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:01.942666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-50e58d3f-7316-41b1-baf3-ca5b4b9945ad None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:01.944190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-50e58d3f-7316-41b1-baf3-ca5b4b9945ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:01.959609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:02.007184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:02.023340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 61/115] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:02.024099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e58d3f-7316-41b1-baf3-ca5b4b9945ad None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:02.067518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a2d92-5316-4bd0-afb9-67df7eceafca None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:02.122058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f3a6a-64f6-433b-bab5-4d6da9407cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:02.123682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f3a6a-64f6-433b-bab5-4d6da9407cad None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.124443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f3a6a-64f6-433b-bab5-4d6da9407cad None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.125196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f3a6a-64f6-433b-bab5-4d6da9407cad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.138873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f3a6a-64f6-433b-bab5-4d6da9407cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-6e1f3a6a-64f6-433b-bab5-4d6da9407cad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:02.145444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:02.146571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:02.147543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:02.149497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 55/116] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:02.151440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be228b-839a-4fa4-9106-e03d33fa6f87 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.151891 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be228b-839a-4fa4-9106-e03d33fa6f87 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.152331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be228b-839a-4fa4-9106-e03d33fa6f87 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.153858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 56/117] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:02.155884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be228b-839a-4fa4-9106-e03d33fa6f87 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:02.179223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e58d3f-7316-41b1-baf3-ca5b4b9945ad None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:02.226833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fd7ab-fa4a-440d-a413-a6fb78b6c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:02.228226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fd7ab-fa4a-440d-a413-a6fb78b6c241 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.228778 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fd7ab-fa4a-440d-a413-a6fb78b6c241 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.229185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fd7ab-fa4a-440d-a413-a6fb78b6c241 None admin] PATH_INFO: `/v3/users/179076a3421248bdafab3719775f8040` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.231038 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fd7ab-fa4a-440d-a413-a6fb78b6c241 None admin] RBAC: Authorizing `identity:get_user(user_id=179076a3421248bdafab3719775f8040)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:02.233525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fd7ab-fa4a-440d-a413-a6fb78b6c241 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:02.236011 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 62/118] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:02 2022] GET /identity/v3/users/179076a3421248bdafab3719775f8040 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:02.237268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fd7ab-fa4a-440d-a413-a6fb78b6c241 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:02.262315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:02.282261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be228b-839a-4fa4-9106-e03d33fa6f87 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:02.302927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:02.327720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff8dfa-f5c5-442d-8719-bb482954a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:02.328688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8dfa-f5c5-442d-8719-bb482954a0e6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.329195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8dfa-f5c5-442d-8719-bb482954a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.329474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8dfa-f5c5-442d-8719-bb482954a0e6 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.330948 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff8dfa-f5c5-442d-8719-bb482954a0e6 None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:02.332674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff8dfa-f5c5-442d-8719-bb482954a0e6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:02.339224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 57/119] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:02 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:02.339224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c392e9c-095a-42b9-bead-15b60481b279 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.339224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c392e9c-095a-42b9-bead-15b60481b279 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.339224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c392e9c-095a-42b9-bead-15b60481b279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.354749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0c392e9c-095a-42b9-bead-15b60481b279 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:02.355966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0c392e9c-095a-42b9-bead-15b60481b279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:02.369797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fd7ab-fa4a-440d-a413-a6fb78b6c241 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:02.408472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a999d3c-9bc9-4f97-902a-556e5e8fd498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:02.409292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999d3c-9bc9-4f97-902a-556e5e8fd498 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.409605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999d3c-9bc9-4f97-902a-556e5e8fd498 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.409872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a999d3c-9bc9-4f97-902a-556e5e8fd498 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.411108 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a999d3c-9bc9-4f97-902a-556e5e8fd498 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:02.411812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a999d3c-9bc9-4f97-902a-556e5e8fd498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:02.413569 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a999d3c-9bc9-4f97-902a-556e5e8fd498 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:02.424336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 63/120] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:02.425057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a999d3c-9bc9-4f97-902a-556e5e8fd498 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:02.441240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 58/121] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:02.454816 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c392e9c-095a-42b9-bead-15b60481b279 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:02.523382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:02.548522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a999d3c-9bc9-4f97-902a-556e5e8fd498 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:02.590176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c392e9c-095a-42b9-bead-15b60481b279 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:02.596999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddc837-b9b5-46a9-af93-7a47e2de7f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:02.597914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddc837-b9b5-46a9-af93-7a47e2de7f55 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.598269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddc837-b9b5-46a9-af93-7a47e2de7f55 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.598618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddc837-b9b5-46a9-af93-7a47e2de7f55 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.599903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddc837-b9b5-46a9-af93-7a47e2de7f55 None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:02.601485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddc837-b9b5-46a9-af93-7a47e2de7f55 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:02.603358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 64/122] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:02 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:02.608333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddc837-b9b5-46a9-af93-7a47e2de7f55 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:02.613072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:02.644045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e3d8e-887e-43a4-9b50-c3ee9318d62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:02.644711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3d8e-887e-43a4-9b50-c3ee9318d62a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.647278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3d8e-887e-43a4-9b50-c3ee9318d62a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.647477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3d8e-887e-43a4-9b50-c3ee9318d62a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.661424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e3d8e-887e-43a4-9b50-c3ee9318d62a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-bf8e3d8e-887e-43a4-9b50-c3ee9318d62a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:02.666511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:02.667442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:02.668205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 59/123] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:02.668836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e3d8e-887e-43a4-9b50-c3ee9318d62a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:02.750709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddc837-b9b5-46a9-af93-7a47e2de7f55 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:02.792186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742a933-7e9d-4182-82f9-fc63f3ba91b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:02.792825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742a933-7e9d-4182-82f9-fc63f3ba91b0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.793115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742a933-7e9d-4182-82f9-fc63f3ba91b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.793392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742a933-7e9d-4182-82f9-fc63f3ba91b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.794206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742a933-7e9d-4182-82f9-fc63f3ba91b0 None admin] RBAC: Adding query filter params (role.id=c532e20495e749c28c0e9211e8264453, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b, user.id=ea43c97f6ab94d598a03b4220a9d943c) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:02.794518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742a933-7e9d-4182-82f9-fc63f3ba91b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:02.796830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742a933-7e9d-4182-82f9-fc63f3ba91b0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:02.799090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e3d8e-887e-43a4-9b50-c3ee9318d62a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:02.803978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 65/124] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:02 2022] GET /identity/v3/role_assignments?user.id=ea43c97f6ab94d598a03b4220a9d943c&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=c532e20495e749c28c0e9211e8264453 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:02.811814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742a933-7e9d-4182-82f9-fc63f3ba91b0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:02.830846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:02.842523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4325a37-c75a-4bfc-ac1f-cb26a83037db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:02.853461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4325a37-c75a-4bfc-ac1f-cb26a83037db None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:02.853461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4325a37-c75a-4bfc-ac1f-cb26a83037db None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:02.853461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4325a37-c75a-4bfc-ac1f-cb26a83037db None admin] PATH_INFO: `/v3/users/179076a3421248bdafab3719775f8040` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:02.853461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4325a37-c75a-4bfc-ac1f-cb26a83037db None admin] RBAC: Authorizing `identity:get_user(user_id=179076a3421248bdafab3719775f8040)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:02.853461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4325a37-c75a-4bfc-ac1f-cb26a83037db None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:02.853461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 60/125] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:02 2022] GET /identity/v3/users/179076a3421248bdafab3719775f8040 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:02.853912 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4325a37-c75a-4bfc-ac1f-cb26a83037db None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:02.921428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:02.985094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742a933-7e9d-4182-82f9-fc63f3ba91b0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:03.009120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4325a37-c75a-4bfc-ac1f-cb26a83037db None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:03.027684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56ab5f-79f2-46bd-80f3-cd0d9dbeabab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:03.029197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ab5f-79f2-46bd-80f3-cd0d9dbeabab None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:03.030692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ab5f-79f2-46bd-80f3-cd0d9dbeabab None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:03.031160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ab5f-79f2-46bd-80f3-cd0d9dbeabab None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/users/179076a3421248bdafab3719775f8040/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:03.034958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56ab5f-79f2-46bd-80f3-cd0d9dbeabab None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b8f41a4823488faa3818650e1d3d0b, user_id=179076a3421248bdafab3719775f8040, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:03.036648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56ab5f-79f2-46bd-80f3-cd0d9dbeabab None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:03.054061 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1227a-97c3-4f34-934d-f1f6d915acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:03.054762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1227a-97c3-4f34-934d-f1f6d915acc3 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:03.056645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1227a-97c3-4f34-934d-f1f6d915acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:03.056645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1227a-97c3-4f34-934d-f1f6d915acc3 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:03.056645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1227a-97c3-4f34-934d-f1f6d915acc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:03.056645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1227a-97c3-4f34-934d-f1f6d915acc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:03.057948 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1227a-97c3-4f34-934d-f1f6d915acc3 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:03.067990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 61/126] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:03.073237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1227a-97c3-4f34-934d-f1f6d915acc3 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:03.117028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 66/127] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:15:02 2022] PUT /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/users/179076a3421248bdafab3719775f8040/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:03.118447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56ab5f-79f2-46bd-80f3-cd0d9dbeabab None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:03.252866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1227a-97c3-4f34-934d-f1f6d915acc3 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:03.255676 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:03.285653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:03.330825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395f79-6836-42d3-8d67-75354da5a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:03.331973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395f79-6836-42d3-8d67-75354da5a85a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:03.332385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395f79-6836-42d3-8d67-75354da5a85a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:03.332774 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395f79-6836-42d3-8d67-75354da5a85a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:03.344122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56ab5f-79f2-46bd-80f3-cd0d9dbeabab None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:03.344723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71395f79-6836-42d3-8d67-75354da5a85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-71395f79-6836-42d3-8d67-75354da5a85a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:03.349980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:03.351033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:03.351989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:03.353937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 62/128] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:03.354740 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395f79-6836-42d3-8d67-75354da5a85a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:03.387411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b318327-2512-4bdb-bdce-d7eb6ea749c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:03.388356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318327-2512-4bdb-bdce-d7eb6ea749c0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:03.388804 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318327-2512-4bdb-bdce-d7eb6ea749c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:03.389416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318327-2512-4bdb-bdce-d7eb6ea749c0 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:03.391162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b318327-2512-4bdb-bdce-d7eb6ea749c0 None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:03.392787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b318327-2512-4bdb-bdce-d7eb6ea749c0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:03.394902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 67/129] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:03 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:03.395960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b318327-2512-4bdb-bdce-d7eb6ea749c0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:03.468815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395f79-6836-42d3-8d67-75354da5a85a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:03.511105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ac6b5-271e-4e63-bd10-74b91d58826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:03.511487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac6b5-271e-4e63-bd10-74b91d58826e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:03.511869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac6b5-271e-4e63-bd10-74b91d58826e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:03.512220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac6b5-271e-4e63-bd10-74b91d58826e None admin] PATH_INFO: `/v3/users/3409d9d3d7e54fb283ab6923355f5810` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:03.513596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ac6b5-271e-4e63-bd10-74b91d58826e None admin] RBAC: Authorizing `identity:get_user(user_id=3409d9d3d7e54fb283ab6923355f5810)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:03.515401 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ac6b5-271e-4e63-bd10-74b91d58826e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:03.517565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 63/130] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:03 2022] GET /identity/v3/users/3409d9d3d7e54fb283ab6923355f5810 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:03.517565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ac6b5-271e-4e63-bd10-74b91d58826e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:03.531807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b318327-2512-4bdb-bdce-d7eb6ea749c0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:03.552530 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:03.571972 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda72a8-c9dd-4f62-942a-18b20cae800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:03.572894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda72a8-c9dd-4f62-942a-18b20cae800d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:03.573465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda72a8-c9dd-4f62-942a-18b20cae800d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:03.573940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda72a8-c9dd-4f62-942a-18b20cae800d None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:03.574787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda72a8-c9dd-4f62-942a-18b20cae800d None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:03.575316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda72a8-c9dd-4f62-942a-18b20cae800d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:03.577591 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda72a8-c9dd-4f62-942a-18b20cae800d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:03.584954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:03.590311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 68/131] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:03.591513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda72a8-c9dd-4f62-942a-18b20cae800d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:03.634679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ac6b5-271e-4e63-bd10-74b91d58826e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:03.673701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baefb6-5df7-400a-83d6-a66c855c8a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:03.674449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baefb6-5df7-400a-83d6-a66c855c8a8c None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:03.674746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baefb6-5df7-400a-83d6-a66c855c8a8c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:03.675024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baefb6-5df7-400a-83d6-a66c855c8a8c None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/users/179076a3421248bdafab3719775f8040/roles/20d736bdf9df414f9e9b2ae27c77c071` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:03.677602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74baefb6-5df7-400a-83d6-a66c855c8a8c None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b8f41a4823488faa3818650e1d3d0b, user_id=179076a3421248bdafab3719775f8040, role_id=20d736bdf9df414f9e9b2ae27c77c071)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:03.678858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74baefb6-5df7-400a-83d6-a66c855c8a8c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:03.709504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda72a8-c9dd-4f62-942a-18b20cae800d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:03.745211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c53f8-cd92-48e2-861f-0213ec01933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:03.745877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c53f8-cd92-48e2-861f-0213ec01933f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:03.746164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c53f8-cd92-48e2-861f-0213ec01933f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:03.746433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c53f8-cd92-48e2-861f-0213ec01933f None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:03.747550 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c53f8-cd92-48e2-861f-0213ec01933f None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:03.749551 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c53f8-cd92-48e2-861f-0213ec01933f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:03.751787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 69/132] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:03 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:03.752585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c53f8-cd92-48e2-861f-0213ec01933f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:03.804881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 64/133] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:15:03 2022] PUT /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/users/179076a3421248bdafab3719775f8040/roles/20d736bdf9df414f9e9b2ae27c77c071 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:03.806615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70d14-ae17-48da-97c4-248b39e13bd8 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:03.807204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70d14-ae17-48da-97c4-248b39e13bd8 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:03.807844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70d14-ae17-48da-97c4-248b39e13bd8 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:03.809778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 65/134] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:03.811474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca70d14-ae17-48da-97c4-248b39e13bd8 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:03.877813 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:03.947469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c53f8-cd92-48e2-861f-0213ec01933f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:04.006572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:04.019479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62dd47-b8b3-4dc5-ab83-dd19181a0aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:04.020163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62dd47-b8b3-4dc5-ab83-dd19181a0aa7 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:04.020510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62dd47-b8b3-4dc5-ab83-dd19181a0aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:04.020800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62dd47-b8b3-4dc5-ab83-dd19181a0aa7 None admin] PATH_INFO: `/v3/users/179076a3421248bdafab3719775f8040` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:04.021994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca70d14-ae17-48da-97c4-248b39e13bd8 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:04.022483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62dd47-b8b3-4dc5-ab83-dd19181a0aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=179076a3421248bdafab3719775f8040)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:04.023539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62dd47-b8b3-4dc5-ab83-dd19181a0aa7 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:04.026835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 70/135] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:03 2022] GET /identity/v3/users/179076a3421248bdafab3719775f8040 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:04.028043 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858b74-4e30-4aae-b1bc-6dc5d7aabca3 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:04.028537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858b74-4e30-4aae-b1bc-6dc5d7aabca3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:04.028607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858b74-4e30-4aae-b1bc-6dc5d7aabca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:04.051804 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-86858b74-4e30-4aae-b1bc-6dc5d7aabca3 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:04.053216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-86858b74-4e30-4aae-b1bc-6dc5d7aabca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:04.078196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b75854-f31c-464b-b522-01ccfc7ef3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:04.078478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b75854-f31c-464b-b522-01ccfc7ef3e5 None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:04.079072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b75854-f31c-464b-b522-01ccfc7ef3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:04.080388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b75854-f31c-464b-b522-01ccfc7ef3e5 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/users/3409d9d3d7e54fb283ab6923355f5810/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:04.082939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b75854-f31c-464b-b522-01ccfc7ef3e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b8f41a4823488faa3818650e1d3d0b, user_id=3409d9d3d7e54fb283ab6923355f5810, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:04.084240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b75854-f31c-464b-b522-01ccfc7ef3e5 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:04.143086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 71/136] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:04.144271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858b74-4e30-4aae-b1bc-6dc5d7aabca3 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:04.161741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 66/137] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:15:03 2022] PUT /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/users/3409d9d3d7e54fb283ab6923355f5810/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:04.262675 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:04.309810 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858b74-4e30-4aae-b1bc-6dc5d7aabca3 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:04.355920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2004a-bd32-45a6-be71-2020ba294346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:04.356880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2004a-bd32-45a6-be71-2020ba294346 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:04.357364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2004a-bd32-45a6-be71-2020ba294346 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:04.358489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2004a-bd32-45a6-be71-2020ba294346 None admin] PATH_INFO: `/v3/projects/3d670c30e85a481386f42fa2d7543eb3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:04.360021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2004a-bd32-45a6-be71-2020ba294346 None admin] RBAC: Authorizing `identity:get_project(project_id=3d670c30e85a481386f42fa2d7543eb3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:04.361712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2004a-bd32-45a6-be71-2020ba294346 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:04.363588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 72/138] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:04 2022] GET /identity/v3/projects/3d670c30e85a481386f42fa2d7543eb3 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:04.369773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b75854-f31c-464b-b522-01ccfc7ef3e5 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:04.496365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b75854-f31c-464b-b522-01ccfc7ef3e5 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:04.540796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52740b3c-9e97-4e08-b748-79f57d875702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:04.541851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52740b3c-9e97-4e08-b748-79f57d875702 None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:04.542445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52740b3c-9e97-4e08-b748-79f57d875702 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:04.542938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52740b3c-9e97-4e08-b748-79f57d875702 None admin] PATH_INFO: `/v3/projects/3d670c30e85a481386f42fa2d7543eb3/users/179076a3421248bdafab3719775f8040/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:04.545452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52740b3c-9e97-4e08-b748-79f57d875702 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d670c30e85a481386f42fa2d7543eb3, user_id=179076a3421248bdafab3719775f8040, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:04.551271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52740b3c-9e97-4e08-b748-79f57d875702 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:04.635168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 67/139] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:15:04 2022] PUT /identity/v3/projects/3d670c30e85a481386f42fa2d7543eb3/users/179076a3421248bdafab3719775f8040/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:04.640373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2004a-bd32-45a6-be71-2020ba294346 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:04.761809 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2004a-bd32-45a6-be71-2020ba294346 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:04.819966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f74024-a29e-48cd-a051-bddef95446e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:04.820709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74024-a29e-48cd-a051-bddef95446e6 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:04.821090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74024-a29e-48cd-a051-bddef95446e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:04.821601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74024-a29e-48cd-a051-bddef95446e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:04.825844 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f74024-a29e-48cd-a051-bddef95446e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:04.827499 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f74024-a29e-48cd-a051-bddef95446e6 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:04.829878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 73/140] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:04.836784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52740b3c-9e97-4e08-b748-79f57d875702 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:04.859240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:04.976589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52740b3c-9e97-4e08-b748-79f57d875702 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:05.014276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af12d-8f51-4a0b-b217-c97e5082663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:05.014907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af12d-8f51-4a0b-b217-c97e5082663f None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:05.015295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af12d-8f51-4a0b-b217-c97e5082663f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:05.015581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af12d-8f51-4a0b-b217-c97e5082663f None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:05.016340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34af12d-8f51-4a0b-b217-c97e5082663f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:05.017874 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34af12d-8f51-4a0b-b217-c97e5082663f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:05.124580 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 68/141] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:15:04 2022] POST /identity/v3/users => generated 283 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:05.337801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578de72-df7b-4f59-b108-7a3fd0ba193e None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:05.338322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578de72-df7b-4f59-b108-7a3fd0ba193e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:05.338429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578de72-df7b-4f59-b108-7a3fd0ba193e None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:05.339724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 74/142] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:05.345686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6909-ac98-4f86-a438-b7478feaa885 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:05.345972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6909-ac98-4f86-a438-b7478feaa885 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:05.346255 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6909-ac98-4f86-a438-b7478feaa885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:05.370870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a87f6909-ac98-4f86-a438-b7478feaa885 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:05.371924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a87f6909-ac98-4f86-a438-b7478feaa885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:05.447322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:05.459756 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 69/143] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:05.997417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578de72-df7b-4f59-b108-7a3fd0ba193e None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:06.000664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:06.113415 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578de72-df7b-4f59-b108-7a3fd0ba193e None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:06.152354 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92239-e916-4b51-933a-1092592f788e None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:06.153342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92239-e916-4b51-933a-1092592f788e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:06.153958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb92239-e916-4b51-933a-1092592f788e None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:06.156447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 70/144] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:15:06.157643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c62c1-d38d-4f18-8c7d-1bbd050ed2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:06.157643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c62c1-d38d-4f18-8c7d-1bbd050ed2f7 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:06.157643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c62c1-d38d-4f18-8c7d-1bbd050ed2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:06.157906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c62c1-d38d-4f18-8c7d-1bbd050ed2f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:06.162385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cfb35-a3e1-4041-a809-3f1c0c5ba240 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:06.163158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cfb35-a3e1-4041-a809-3f1c0c5ba240 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:06.163643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cfb35-a3e1-4041-a809-3f1c0c5ba240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:06.182419 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c62c1-d38d-4f18-8c7d-1bbd050ed2f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-d36c62c1-d38d-4f18-8c7d-1bbd050ed2f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:06.188491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:06.189392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:06.190222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:06.192489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 75/145] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:06.199218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c62c1-d38d-4f18-8c7d-1bbd050ed2f7 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:06.204033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-fd2cfb35-a3e1-4041-a809-3f1c0c5ba240 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:06.209124 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-fd2cfb35-a3e1-4041-a809-3f1c0c5ba240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:06.333562 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:06.347823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 71/146] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:06.414764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c62c1-d38d-4f18-8c7d-1bbd050ed2f7 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:06.479867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe1719-950c-4caa-a174-698835547a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:06.480499 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe1719-950c-4caa-a174-698835547a8b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:06.480773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe1719-950c-4caa-a174-698835547a8b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:06.481043 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe1719-950c-4caa-a174-698835547a8b None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:06.481747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe1719-950c-4caa-a174-698835547a8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:06.482051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe1719-950c-4caa-a174-698835547a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:06.483465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe1719-950c-4caa-a174-698835547a8b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:06.497721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 76/147] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:06.503618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cfb35-a3e1-4041-a809-3f1c0c5ba240 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:06.528694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb52c3-33e4-48fb-8005-398f88f242e5 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:06.529004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb52c3-33e4-48fb-8005-398f88f242e5 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:06.529251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb52c3-33e4-48fb-8005-398f88f242e5 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:06.531228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 77/148] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:15:06.536416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74266-d784-4adf-b591-917fb7946b39 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:06.536701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74266-d784-4adf-b591-917fb7946b39 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:06.536973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74266-d784-4adf-b591-917fb7946b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:06.558806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-1da74266-d784-4adf-b591-917fb7946b39 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:06.558806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1da74266-d784-4adf-b591-917fb7946b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:06.644379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cfb35-a3e1-4041-a809-3f1c0c5ba240 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:06.678073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:06.688948 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d3c50-4c94-44f5-8b85-46a12d61627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:06.690006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d3c50-4c94-44f5-8b85-46a12d61627f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:06.698139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d3c50-4c94-44f5-8b85-46a12d61627f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:06.698139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d3c50-4c94-44f5-8b85-46a12d61627f None admin] PATH_INFO: `/v3/users/ea43c97f6ab94d598a03b4220a9d943c` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:06.698139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d3c50-4c94-44f5-8b85-46a12d61627f None admin] RBAC: Authorizing `identity:get_user(user_id=ea43c97f6ab94d598a03b4220a9d943c)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:06.698139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d3c50-4c94-44f5-8b85-46a12d61627f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:06.698139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 72/149] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:06 2022] GET /identity/v3/users/ea43c97f6ab94d598a03b4220a9d943c => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:06.702785 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d3c50-4c94-44f5-8b85-46a12d61627f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:06.724016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 78/150] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:06.825976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d3c50-4c94-44f5-8b85-46a12d61627f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:06.842703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da74266-d784-4adf-b591-917fb7946b39 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:06.862877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32518e1f-79a8-4bab-88e0-3732f0ebb333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:06.863523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518e1f-79a8-4bab-88e0-3732f0ebb333 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:06.863805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518e1f-79a8-4bab-88e0-3732f0ebb333 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:06.864080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518e1f-79a8-4bab-88e0-3732f0ebb333 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:06.865215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32518e1f-79a8-4bab-88e0-3732f0ebb333 None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:06.866701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32518e1f-79a8-4bab-88e0-3732f0ebb333 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:06.868665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 73/151] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:06 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:06.882743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32518e1f-79a8-4bab-88e0-3732f0ebb333 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:06.934017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:06.972610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:06.999677 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da74266-d784-4adf-b591-917fb7946b39 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:07.024723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32518e1f-79a8-4bab-88e0-3732f0ebb333 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:07.055561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1d6dd-9068-49f0-856d-2389f740a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:07.056217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d6dd-9068-49f0-856d-2389f740a918 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:07.056498 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d6dd-9068-49f0-856d-2389f740a918 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:07.056772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d6dd-9068-49f0-856d-2389f740a918 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:07.081191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1d6dd-9068-49f0-856d-2389f740a918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-c6a1d6dd-9068-49f0-856d-2389f740a918 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:07.086821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:07.087703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:07.088476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 79/152] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:07.090609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bbcb6-9abe-49c6-81c7-95f5cd1bb236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:07.091573 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bbcb6-9abe-49c6-81c7-95f5cd1bb236 None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:07.092691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bbcb6-9abe-49c6-81c7-95f5cd1bb236 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:07.093285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bbcb6-9abe-49c6-81c7-95f5cd1bb236 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/users/ea43c97f6ab94d598a03b4220a9d943c/roles/c532e20495e749c28c0e9211e8264453` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:07.096126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1d6dd-9068-49f0-856d-2389f740a918 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:07.102501 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bbcb6-9abe-49c6-81c7-95f5cd1bb236 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b8f41a4823488faa3818650e1d3d0b, user_id=ea43c97f6ab94d598a03b4220a9d943c, role_id=c532e20495e749c28c0e9211e8264453)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:07.104257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bbcb6-9abe-49c6-81c7-95f5cd1bb236 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:07.208598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 74/153] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:15:06 2022] PUT /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/users/ea43c97f6ab94d598a03b4220a9d943c/roles/c532e20495e749c28c0e9211e8264453 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:15:07.239203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1d6dd-9068-49f0-856d-2389f740a918 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:07.259216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:07.265539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fefe1-e93b-45b5-a89f-2a43516cce8c None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:07.266142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fefe1-e93b-45b5-a89f-2a43516cce8c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:07.266688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fefe1-e93b-45b5-a89f-2a43516cce8c None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:07.268633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 75/154] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:07.273850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5aa3a-2c7d-4ecf-81c1-114be4f581e2 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:07.282407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5aa3a-2c7d-4ecf-81c1-114be4f581e2 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:07.282407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5aa3a-2c7d-4ecf-81c1-114be4f581e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:07.285506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b134a-0635-44b9-99a0-44a0e28f0e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:07.286143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b134a-0635-44b9-99a0-44a0e28f0e65 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:07.286419 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b134a-0635-44b9-99a0-44a0e28f0e65 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:07.286682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b134a-0635-44b9-99a0-44a0e28f0e65 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:07.287367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b134a-0635-44b9-99a0-44a0e28f0e65 None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:07.287667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b134a-0635-44b9-99a0-44a0e28f0e65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:07.289106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b134a-0635-44b9-99a0-44a0e28f0e65 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:07.299765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 80/155] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:07.306910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b134a-0635-44b9-99a0-44a0e28f0e65 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:07.314552 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-aea5aa3a-2c7d-4ecf-81c1-114be4f581e2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:07.316209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-aea5aa3a-2c7d-4ecf-81c1-114be4f581e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:07.442709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b134a-0635-44b9-99a0-44a0e28f0e65 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:07.497083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5102fb4-0048-4b9c-bdd9-560d7e1ba3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:07.497751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5102fb4-0048-4b9c-bdd9-560d7e1ba3b5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:07.498028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5102fb4-0048-4b9c-bdd9-560d7e1ba3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:07.498520 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5102fb4-0048-4b9c-bdd9-560d7e1ba3b5 None admin] PATH_INFO: `/v3/users/179076a3421248bdafab3719775f8040` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:07.500753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 76/156] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:07.501712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5102fb4-0048-4b9c-bdd9-560d7e1ba3b5 None admin] RBAC: Authorizing `identity:get_user(user_id=179076a3421248bdafab3719775f8040)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:07.502108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5aa3a-2c7d-4ecf-81c1-114be4f581e2 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:07.504995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5102fb4-0048-4b9c-bdd9-560d7e1ba3b5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:07.504995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 81/157] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:07 2022] GET /identity/v3/users/179076a3421248bdafab3719775f8040 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:07.510893 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5102fb4-0048-4b9c-bdd9-560d7e1ba3b5 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:07.578010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:07.613989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:07.644225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5102fb4-0048-4b9c-bdd9-560d7e1ba3b5 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:07.702681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc0557-2942-4a2f-a2a9-299196e9bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:07.703304 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc0557-2942-4a2f-a2a9-299196e9bc20 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:07.703580 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc0557-2942-4a2f-a2a9-299196e9bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:07.703852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc0557-2942-4a2f-a2a9-299196e9bc20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:07.720014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5aa3a-2c7d-4ecf-81c1-114be4f581e2 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:07.800890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc0557-2942-4a2f-a2a9-299196e9bc20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:07.802317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc0557-2942-4a2f-a2a9-299196e9bc20 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:07.812857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09c1b-4f12-4398-b202-1ab2158f27f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:07.813958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09c1b-4f12-4398-b202-1ab2158f27f7 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:07.814459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09c1b-4f12-4398-b202-1ab2158f27f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:07.814987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09c1b-4f12-4398-b202-1ab2158f27f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:07.848685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc09c1b-4f12-4398-b202-1ab2158f27f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:07.856728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-dbc09c1b-4f12-4398-b202-1ab2158f27f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:07.859431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:07.860312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:07.861091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:07.863476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 77/158] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:07.869377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09c1b-4f12-4398-b202-1ab2158f27f7 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:07.937608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 82/159] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:15:07.940031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc0557-2942-4a2f-a2a9-299196e9bc20 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:08.012675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09c1b-4f12-4398-b202-1ab2158f27f7 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:08.027682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:08.059768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3829a-d7dc-4fc0-b52c-6a034f4f77ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:08.060965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3829a-d7dc-4fc0-b52c-6a034f4f77ff None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.061558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3829a-d7dc-4fc0-b52c-6a034f4f77ff None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.062092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3829a-d7dc-4fc0-b52c-6a034f4f77ff None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.063005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3829a-d7dc-4fc0-b52c-6a034f4f77ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:08.063539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3829a-d7dc-4fc0-b52c-6a034f4f77ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:08.065208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3829a-d7dc-4fc0-b52c-6a034f4f77ff None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:08.077061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc0557-2942-4a2f-a2a9-299196e9bc20 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:08.079878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 78/160] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:08.085278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3829a-d7dc-4fc0-b52c-6a034f4f77ff None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:08.142920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd146e2b-f868-4709-92ee-89e6e1cfe35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:08.143572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd146e2b-f868-4709-92ee-89e6e1cfe35e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.143851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd146e2b-f868-4709-92ee-89e6e1cfe35e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.144124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd146e2b-f868-4709-92ee-89e6e1cfe35e None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.149596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd146e2b-f868-4709-92ee-89e6e1cfe35e None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:08.149596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd146e2b-f868-4709-92ee-89e6e1cfe35e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:08.149596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 83/161] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:07 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:08.150449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd146e2b-f868-4709-92ee-89e6e1cfe35e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:08.171744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:08.246250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3829a-d7dc-4fc0-b52c-6a034f4f77ff None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:08.316961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae39d-a47a-40b4-a7dc-b911e2050b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:08.317514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae39d-a47a-40b4-a7dc-b911e2050b96 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.317821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae39d-a47a-40b4-a7dc-b911e2050b96 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.318092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ae39d-a47a-40b4-a7dc-b911e2050b96 None admin] PATH_INFO: `/v3/users/179076a3421248bdafab3719775f8040` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.322355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ae39d-a47a-40b4-a7dc-b911e2050b96 None admin] RBAC: Authorizing `identity:get_user(user_id=179076a3421248bdafab3719775f8040)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:08.323856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ae39d-a47a-40b4-a7dc-b911e2050b96 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:08.325455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 79/162] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:08 2022] GET /identity/v3/users/179076a3421248bdafab3719775f8040 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:08.326523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae39d-a47a-40b4-a7dc-b911e2050b96 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:08.328386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd146e2b-f868-4709-92ee-89e6e1cfe35e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:08.399521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:08.403154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac171f89-52fc-470f-b368-2e26a0a2d1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:08.403792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac171f89-52fc-470f-b368-2e26a0a2d1a2 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.404068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac171f89-52fc-470f-b368-2e26a0a2d1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.404862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac171f89-52fc-470f-b368-2e26a0a2d1a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.425585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac171f89-52fc-470f-b368-2e26a0a2d1a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-ac171f89-52fc-470f-b368-2e26a0a2d1a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:08.430797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:08.431663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:08.432508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:08.433198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 84/163] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:08.439331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70652ae4-021c-4b91-8280-bbc5a97fb2f0 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.439619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70652ae4-021c-4b91-8280-bbc5a97fb2f0 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.440093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70652ae4-021c-4b91-8280-bbc5a97fb2f0 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.442356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 85/164] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:08.443388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70652ae4-021c-4b91-8280-bbc5a97fb2f0 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:08.490183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ae39d-a47a-40b4-a7dc-b911e2050b96 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:08.526451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdd710-ec44-429e-90ab-f8831a3deb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:08.527066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdd710-ec44-429e-90ab-f8831a3deb93 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.527344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdd710-ec44-429e-90ab-f8831a3deb93 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.527614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdd710-ec44-429e-90ab-f8831a3deb93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.528335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdd710-ec44-429e-90ab-f8831a3deb93 None admin] RBAC: Adding query filter params (role.id=bec3ab91aff841e286162327678e1cc6, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b, user.id=179076a3421248bdafab3719775f8040) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:08.528644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdd710-ec44-429e-90ab-f8831a3deb93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:08.530723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bdd710-ec44-429e-90ab-f8831a3deb93 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:08.536893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 80/165] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:08 2022] GET /identity/v3/role_assignments?user.id=179076a3421248bdafab3719775f8040&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=bec3ab91aff841e286162327678e1cc6 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:08.537701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdd710-ec44-429e-90ab-f8831a3deb93 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:08.656857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdd710-ec44-429e-90ab-f8831a3deb93 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:08.664913 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:08.669988 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:08.695807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e704ff-e12f-4c74-9d10-83113f931b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:08.696676 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e704ff-e12f-4c74-9d10-83113f931b25 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.697118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e704ff-e12f-4c74-9d10-83113f931b25 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.697536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e704ff-e12f-4c74-9d10-83113f931b25 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.699033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e704ff-e12f-4c74-9d10-83113f931b25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:08.699522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e704ff-e12f-4c74-9d10-83113f931b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:08.701889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e704ff-e12f-4c74-9d10-83113f931b25 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:08.714561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 81/166] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:08.721192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df47208-9ad9-4ba0-9f2a-cef29bb48463 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.722066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df47208-9ad9-4ba0-9f2a-cef29bb48463 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.722903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df47208-9ad9-4ba0-9f2a-cef29bb48463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.726841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70652ae4-021c-4b91-8280-bbc5a97fb2f0 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:08.756995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-5df47208-9ad9-4ba0-9f2a-cef29bb48463 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:08.758716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5df47208-9ad9-4ba0-9f2a-cef29bb48463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:08.812223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715a0e0-7cf1-4346-bec7-daaaf0ece5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:08.812853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a0e0-7cf1-4346-bec7-daaaf0ece5d4 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:08.813140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a0e0-7cf1-4346-bec7-daaaf0ece5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:08.818219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715a0e0-7cf1-4346-bec7-daaaf0ece5d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:08.875099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 82/167] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:08.876017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df47208-9ad9-4ba0-9f2a-cef29bb48463 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:09.009515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715a0e0-7cf1-4346-bec7-daaaf0ece5d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:09.011053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715a0e0-7cf1-4346-bec7-daaaf0ece5d4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:09.032280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:09.041300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df47208-9ad9-4ba0-9f2a-cef29bb48463 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:09.085379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b517bf-c395-4ba2-a701-dc9a4c7f8204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:09.086074 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b517bf-c395-4ba2-a701-dc9a4c7f8204 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:09.086364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b517bf-c395-4ba2-a701-dc9a4c7f8204 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:09.086635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b517bf-c395-4ba2-a701-dc9a4c7f8204 None admin] PATH_INFO: `/v3/users/3409d9d3d7e54fb283ab6923355f5810` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:09.088939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b517bf-c395-4ba2-a701-dc9a4c7f8204 None admin] RBAC: Authorizing `identity:get_user(user_id=3409d9d3d7e54fb283ab6923355f5810)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:09.090433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b517bf-c395-4ba2-a701-dc9a4c7f8204 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:09.092568 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 83/168] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:08 2022] GET /identity/v3/users/3409d9d3d7e54fb283ab6923355f5810 => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:09.098499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b517bf-c395-4ba2-a701-dc9a4c7f8204 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:09.189931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:09.225438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 86/169] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:09.232444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715a0e0-7cf1-4346-bec7-daaaf0ece5d4 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:09.271495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b517bf-c395-4ba2-a701-dc9a4c7f8204 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:09.342958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e519c-66b2-45fb-b791-1c963752815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:09.343585 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e519c-66b2-45fb-b791-1c963752815d None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:09.343866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e519c-66b2-45fb-b791-1c963752815d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:09.344138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e519c-66b2-45fb-b791-1c963752815d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:09.361092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715a0e0-7cf1-4346-bec7-daaaf0ece5d4 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:09.397504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:09.429763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46277933-71ea-49eb-ac44-84cc3dac975e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:09.430769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46277933-71ea-49eb-ac44-84cc3dac975e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:09.431250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46277933-71ea-49eb-ac44-84cc3dac975e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:09.431746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46277933-71ea-49eb-ac44-84cc3dac975e None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:09.434644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46277933-71ea-49eb-ac44-84cc3dac975e None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:09.436513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46277933-71ea-49eb-ac44-84cc3dac975e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:09.438539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 87/170] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:09 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:09.444545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46277933-71ea-49eb-ac44-84cc3dac975e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:09.456752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e519c-66b2-45fb-b791-1c963752815d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:09.458264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e519c-66b2-45fb-b791-1c963752815d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:09.497447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:09.638303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46277933-71ea-49eb-ac44-84cc3dac975e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:09.670481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 84/171] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:09.671435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e519c-66b2-45fb-b791-1c963752815d None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:09.722852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92029d71-71ad-4632-9d6b-31c2a44ec9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:09.723765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92029d71-71ad-4632-9d6b-31c2a44ec9b7 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:09.723765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92029d71-71ad-4632-9d6b-31c2a44ec9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:09.724057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92029d71-71ad-4632-9d6b-31c2a44ec9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:09.724733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92029d71-71ad-4632-9d6b-31c2a44ec9b7 None admin] RBAC: Adding query filter params (role.id=20d736bdf9df414f9e9b2ae27c77c071, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b, user.id=179076a3421248bdafab3719775f8040) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:09.725047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92029d71-71ad-4632-9d6b-31c2a44ec9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:09.726527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92029d71-71ad-4632-9d6b-31c2a44ec9b7 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:09.739581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 88/172] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:09 2022] GET /identity/v3/role_assignments?user.id=179076a3421248bdafab3719775f8040&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=20d736bdf9df414f9e9b2ae27c77c071 => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:09.740378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92029d71-71ad-4632-9d6b-31c2a44ec9b7 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:09.847825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:09.902880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92029d71-71ad-4632-9d6b-31c2a44ec9b7 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:09.906986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e519c-66b2-45fb-b791-1c963752815d None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:09.910891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:09.947325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1c942-7821-4307-be31-5e82e72642f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:09.947979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1c942-7821-4307-be31-5e82e72642f5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:09.948259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1c942-7821-4307-be31-5e82e72642f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:09.948532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1c942-7821-4307-be31-5e82e72642f5 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:09.953144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1c942-7821-4307-be31-5e82e72642f5 None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:09.954681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1c942-7821-4307-be31-5e82e72642f5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:09.956424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 89/173] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:09 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:09.959281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99131ed8-ce85-42ec-b969-0cf29308440d None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:09.959561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99131ed8-ce85-42ec-b969-0cf29308440d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:09.959830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99131ed8-ce85-42ec-b969-0cf29308440d None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:09.961143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 90/174] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:09.963945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc7dc2-f429-489b-be70-2ff9798a2b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:09.964586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc7dc2-f429-489b-be70-2ff9798a2b82 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:09.964860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc7dc2-f429-489b-be70-2ff9798a2b82 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:09.965126 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc7dc2-f429-489b-be70-2ff9798a2b82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:09.966516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99131ed8-ce85-42ec-b969-0cf29308440d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:09.992690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc7dc2-f429-489b-be70-2ff9798a2b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-bfdc7dc2-f429-489b-be70-2ff9798a2b82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:09.998100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:09.999067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:09.999889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:10.001826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 85/175] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:10.004355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662f12-0837-42d1-b3de-3928b067499e None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.007008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662f12-0837-42d1-b3de-3928b067499e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.007291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2662f12-0837-42d1-b3de-3928b067499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.044907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-b2662f12-0837-42d1-b3de-3928b067499e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:10.046600 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b2662f12-0837-42d1-b3de-3928b067499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:10.176544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 86/176] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:10.177606 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2662f12-0837-42d1-b3de-3928b067499e None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:10.197532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99131ed8-ce85-42ec-b969-0cf29308440d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:10.234642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdccc2-8a67-4ff7-bc20-3d1e3fe202f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:10.235257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdccc2-8a67-4ff7-bc20-3d1e3fe202f8 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.235534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdccc2-8a67-4ff7-bc20-3d1e3fe202f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.235807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdccc2-8a67-4ff7-bc20-3d1e3fe202f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.236540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdccc2-8a67-4ff7-bc20-3d1e3fe202f8 None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b, user.id=3409d9d3d7e54fb283ab6923355f5810) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:10.236876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdccc2-8a67-4ff7-bc20-3d1e3fe202f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:10.238311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdccc2-8a67-4ff7-bc20-3d1e3fe202f8 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:10.244815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 91/177] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:09 2022] GET /identity/v3/role_assignments?user.id=3409d9d3d7e54fb283ab6923355f5810&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:10.246130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce08c1-b05e-4233-929b-282696db6c2e None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.246414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce08c1-b05e-4233-929b-282696db6c2e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.246684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce08c1-b05e-4233-929b-282696db6c2e None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.247887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 92/178] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:10.254180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acad392-ac05-4319-9705-9a095ca56f60 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.254462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acad392-ac05-4319-9705-9a095ca56f60 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.255197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acad392-ac05-4319-9705-9a095ca56f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.259118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:10.274666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2acad392-ac05-4319-9705-9a095ca56f60 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:10.275916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2acad392-ac05-4319-9705-9a095ca56f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:10.308074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:10.315942 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2662f12-0837-42d1-b3de-3928b067499e None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:10.351149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 93/179] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:10.356227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3fd33-8c28-438f-afb3-50328cb7654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:10.357015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3fd33-8c28-438f-afb3-50328cb7654b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.358093 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3fd33-8c28-438f-afb3-50328cb7654b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.358775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3fd33-8c28-438f-afb3-50328cb7654b None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.359605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3fd33-8c28-438f-afb3-50328cb7654b None admin] RBAC: Adding query filter params (name=member) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:10.360075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3fd33-8c28-438f-afb3-50328cb7654b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:10.361800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3fd33-8c28-438f-afb3-50328cb7654b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:10.371489 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 87/180] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:10.378071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acad392-ac05-4319-9705-9a095ca56f60 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:10.510607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acad392-ac05-4319-9705-9a095ca56f60 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:10.546741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76ffd2-703a-4856-9e98-85dcdc596b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:10.547381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76ffd2-703a-4856-9e98-85dcdc596b6a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.547659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76ffd2-703a-4856-9e98-85dcdc596b6a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.547933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76ffd2-703a-4856-9e98-85dcdc596b6a None admin] PATH_INFO: `/v3/users/179076a3421248bdafab3719775f8040` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.549071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76ffd2-703a-4856-9e98-85dcdc596b6a None admin] RBAC: Authorizing `identity:get_user(user_id=179076a3421248bdafab3719775f8040)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:10.550547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76ffd2-703a-4856-9e98-85dcdc596b6a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:10.552128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 94/181] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:10 2022] GET /identity/v3/users/179076a3421248bdafab3719775f8040 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:10.557939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3fd33-8c28-438f-afb3-50328cb7654b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:10.596419 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3888a6f-189f-404b-a503-50c751741adb None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.596719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3888a6f-189f-404b-a503-50c751741adb None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.596964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3888a6f-189f-404b-a503-50c751741adb None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.598435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 95/182] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:15:10.603655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75248b-4c74-490a-8f5f-0133f02f98cb None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.603932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75248b-4c74-490a-8f5f-0133f02f98cb None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.604206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75248b-4c74-490a-8f5f-0133f02f98cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.622291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-8a75248b-4c74-490a-8f5f-0133f02f98cb None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:10.624073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8a75248b-4c74-490a-8f5f-0133f02f98cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:10.666349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:10.675486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3fd33-8c28-438f-afb3-50328cb7654b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:10.702443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:10.718159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 96/183] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:10.719082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139d715-f01f-4a22-ad15-78fda8bece0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:10.719757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d715-f01f-4a22-ad15-78fda8bece0c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.720037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d715-f01f-4a22-ad15-78fda8bece0c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.720379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139d715-f01f-4a22-ad15-78fda8bece0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.746409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75248b-4c74-490a-8f5f-0133f02f98cb None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:10.826657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139d715-f01f-4a22-ad15-78fda8bece0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:10.828443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139d715-f01f-4a22-ad15-78fda8bece0c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:10.865476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75248b-4c74-490a-8f5f-0133f02f98cb None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:10.912068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744e8d6-d810-4a30-9a40-765203edcdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:10.912703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744e8d6-d810-4a30-9a40-765203edcdb2 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:10.912979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744e8d6-d810-4a30-9a40-765203edcdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:10.913252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744e8d6-d810-4a30-9a40-765203edcdb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:10.924670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744e8d6-d810-4a30-9a40-765203edcdb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-d744e8d6-d810-4a30-9a40-765203edcdb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:10.929514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:10.930621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 97/184] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:10.931552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744e8d6-d810-4a30-9a40-765203edcdb2 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:10.940359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 88/185] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:10.941234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139d715-f01f-4a22-ad15-78fda8bece0c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:10.964132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:10.969952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:11.043858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744e8d6-d810-4a30-9a40-765203edcdb2 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.050922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139d715-f01f-4a22-ad15-78fda8bece0c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.080915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a3a97-9c02-4512-b53f-b2014e11e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.081473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a3a97-9c02-4512-b53f-b2014e11e05d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.081783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a3a97-9c02-4512-b53f-b2014e11e05d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.082058 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a3a97-9c02-4512-b53f-b2014e11e05d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.084988 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59e3cc-02e6-4448-8505-a827e2fc14b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.085615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59e3cc-02e6-4448-8505-a827e2fc14b6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.085900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59e3cc-02e6-4448-8505-a827e2fc14b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.086172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59e3cc-02e6-4448-8505-a827e2fc14b6 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.086839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59e3cc-02e6-4448-8505-a827e2fc14b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:11.087138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59e3cc-02e6-4448-8505-a827e2fc14b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:11.088514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59e3cc-02e6-4448-8505-a827e2fc14b6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:11.092255 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a3a97-9c02-4512-b53f-b2014e11e05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:11.096588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 89/186] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:11.097187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59e3cc-02e6-4448-8505-a827e2fc14b6 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-af5a3a97-9c02-4512-b53f-b2014e11e05d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:11.097435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:11.098337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:11.099276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 98/187] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:11.099985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969524b-35d6-4853-936f-2b2370e41e16 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.100104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969524b-35d6-4853-936f-2b2370e41e16 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.100386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969524b-35d6-4853-936f-2b2370e41e16 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.101630 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 99/188] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:11.103725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969524b-35d6-4853-936f-2b2370e41e16 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:11.183129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:11.190934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:11.202216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59e3cc-02e6-4448-8505-a827e2fc14b6 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.206775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969524b-35d6-4853-936f-2b2370e41e16 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.239086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec1a5f-acac-418d-9a00-dde4ed8392b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.239708 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec1a5f-acac-418d-9a00-dde4ed8392b7 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.239985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec1a5f-acac-418d-9a00-dde4ed8392b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.240252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec1a5f-acac-418d-9a00-dde4ed8392b7 None admin] PATH_INFO: `/v3/projects/3d670c30e85a481386f42fa2d7543eb3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.241412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec1a5f-acac-418d-9a00-dde4ed8392b7 None admin] RBAC: Authorizing `identity:get_project(project_id=3d670c30e85a481386f42fa2d7543eb3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:11.242046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b58dd4-912e-4904-9228-150f0933d1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.242680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b58dd4-912e-4904-9228-150f0933d1fc None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.242844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec1a5f-acac-418d-9a00-dde4ed8392b7 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:11.242964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b58dd4-912e-4904-9228-150f0933d1fc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.243240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b58dd4-912e-4904-9228-150f0933d1fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.244351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b58dd4-912e-4904-9228-150f0933d1fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:11.244605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 90/189] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:11 2022] GET /identity/v3/projects/3d670c30e85a481386f42fa2d7543eb3 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:11.245354 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec1a5f-acac-418d-9a00-dde4ed8392b7 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:11.245879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b58dd4-912e-4904-9228-150f0933d1fc None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:11.249618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 100/190] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:11.249618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b58dd4-912e-4904-9228-150f0933d1fc None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:11.352702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec1a5f-acac-418d-9a00-dde4ed8392b7 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.353974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b58dd4-912e-4904-9228-150f0933d1fc None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.386818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f83d1c-4505-4d80-8fb4-e426963b7e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.387446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83d1c-4505-4d80-8fb4-e426963b7e4e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.387728 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83d1c-4505-4d80-8fb4-e426963b7e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.388002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f83d1c-4505-4d80-8fb4-e426963b7e4e None admin] PATH_INFO: `/v3/users/2056e20cd3b24b25851969145a51ab14` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.390065 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69082a-7cbc-4236-b867-f815de17dfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.390676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69082a-7cbc-4236-b867-f815de17dfdf None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.390959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69082a-7cbc-4236-b867-f815de17dfdf None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.391240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69082a-7cbc-4236-b867-f815de17dfdf None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.391906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69082a-7cbc-4236-b867-f815de17dfdf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:11.392212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69082a-7cbc-4236-b867-f815de17dfdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:11.393602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69082a-7cbc-4236-b867-f815de17dfdf None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:11.401427 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 101/191] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:11.401909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f83d1c-4505-4d80-8fb4-e426963b7e4e None admin] RBAC: Authorizing `identity:get_user(user_id=2056e20cd3b24b25851969145a51ab14)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:11.403364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f83d1c-4505-4d80-8fb4-e426963b7e4e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:11.405304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 91/192] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:11 2022] GET /identity/v3/users/2056e20cd3b24b25851969145a51ab14 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:11.406303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f83d1c-4505-4d80-8fb4-e426963b7e4e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:11.407104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5108-ba17-4f77-a4fb-79c24ebb4bfd None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.407393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5108-ba17-4f77-a4fb-79c24ebb4bfd None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.407668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e5108-ba17-4f77-a4fb-79c24ebb4bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.414793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:11.427992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-420e5108-ba17-4f77-a4fb-79c24ebb4bfd None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:11.429177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-420e5108-ba17-4f77-a4fb-79c24ebb4bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:11.439087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:11.495494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 102/193] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:11.496324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e5108-ba17-4f77-a4fb-79c24ebb4bfd None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:11.511856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f83d1c-4505-4d80-8fb4-e426963b7e4e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.547612 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf3e8-a289-48c4-b923-f2d0eb176a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.548206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf3e8-a289-48c4-b923-f2d0eb176a2e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.548482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf3e8-a289-48c4-b923-f2d0eb176a2e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.548757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decf3e8-a289-48c4-b923-f2d0eb176a2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.549477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf3e8-a289-48c4-b923-f2d0eb176a2e None admin] RBAC: Adding query filter params (role.id=bec3ab91aff841e286162327678e1cc6, scope.project.id=3d670c30e85a481386f42fa2d7543eb3, user.id=179076a3421248bdafab3719775f8040) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:11.549899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf3e8-a289-48c4-b923-f2d0eb176a2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:11.551240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decf3e8-a289-48c4-b923-f2d0eb176a2e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:11.557245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 92/194] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:11 2022] GET /identity/v3/role_assignments?user.id=179076a3421248bdafab3719775f8040&scope.project.id=3d670c30e85a481386f42fa2d7543eb3&role.id=bec3ab91aff841e286162327678e1cc6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:11.558174 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf3e8-a289-48c4-b923-f2d0eb176a2e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:11.619339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e5108-ba17-4f77-a4fb-79c24ebb4bfd None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.661818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4f3bb-b24c-4661-89e3-8f5d8b5062b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.662480 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4f3bb-b24c-4661-89e3-8f5d8b5062b7 None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.662763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4f3bb-b24c-4661-89e3-8f5d8b5062b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.663039 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4f3bb-b24c-4661-89e3-8f5d8b5062b7 None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.663805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4f3bb-b24c-4661-89e3-8f5d8b5062b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:11.665739 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4f3bb-b24c-4661-89e3-8f5d8b5062b7 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:11.673995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:11.711131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decf3e8-a289-48c4-b923-f2d0eb176a2e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.747846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600057e-acdb-4609-a555-296c49e3067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.749477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600057e-acdb-4609-a555-296c49e3067d None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.749955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600057e-acdb-4609-a555-296c49e3067d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.750363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600057e-acdb-4609-a555-296c49e3067d None admin] PATH_INFO: `/v3/users/2056e20cd3b24b25851969145a51ab14` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.751675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600057e-acdb-4609-a555-296c49e3067d None admin] RBAC: Authorizing `identity:get_user(user_id=2056e20cd3b24b25851969145a51ab14)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:11.753135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600057e-acdb-4609-a555-296c49e3067d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:11.755068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 93/195] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:11 2022] GET /identity/v3/users/2056e20cd3b24b25851969145a51ab14 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:11.755853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600057e-acdb-4609-a555-296c49e3067d None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:11.773345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:11.778594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 103/196] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:15:11 2022] POST /identity/v3/users => generated 297 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:11.779750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4f3bb-b24c-4661-89e3-8f5d8b5062b7 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:11.886189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600057e-acdb-4609-a555-296c49e3067d None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.927506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4f3bb-b24c-4661-89e3-8f5d8b5062b7 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:11.929607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e83e0f-3be4-4e76-9e4b-f0c02e9e1c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.930229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83e0f-3be4-4e76-9e4b-f0c02e9e1c49 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.930516 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83e0f-3be4-4e76-9e4b-f0c02e9e1c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.931313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e83e0f-3be4-4e76-9e4b-f0c02e9e1c49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:11.941530 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:11.967973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a210ad2-5d58-4b0a-85b1-4e91584cef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:11.968590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210ad2-5d58-4b0a-85b1-4e91584cef08 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:11.968872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210ad2-5d58-4b0a-85b1-4e91584cef08 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:11.969146 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a210ad2-5d58-4b0a-85b1-4e91584cef08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:12.020158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e83e0f-3be4-4e76-9e4b-f0c02e9e1c49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:12.021804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e83e0f-3be4-4e76-9e4b-f0c02e9e1c49 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:12.051719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:12.054363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a210ad2-5d58-4b0a-85b1-4e91584cef08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:12.055800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a210ad2-5d58-4b0a-85b1-4e91584cef08 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:12.142498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 94/197] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:12.143279 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e83e0f-3be4-4e76-9e4b-f0c02e9e1c49 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:12.190666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 104/198] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:12.191541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a210ad2-5d58-4b0a-85b1-4e91584cef08 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:12.194321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:12.269109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e83e0f-3be4-4e76-9e4b-f0c02e9e1c49 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:12.312683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c1fe9-fdf1-48b3-8465-090b501b5680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:12.313868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c1fe9-fdf1-48b3-8465-090b501b5680 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:12.314152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c1fe9-fdf1-48b3-8465-090b501b5680 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:12.314426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c1fe9-fdf1-48b3-8465-090b501b5680 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:12.318501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:12.322253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a210ad2-5d58-4b0a-85b1-4e91584cef08 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:12.328747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c1fe9-fdf1-48b3-8465-090b501b5680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-7a0c1fe9-fdf1-48b3-8465-090b501b5680 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:12.334852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:12.336001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 95/199] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:12.336917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c1fe9-fdf1-48b3-8465-090b501b5680 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:12.366046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ba6b0-fdb2-4675-bd31-61d5768f5f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:12.366987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba6b0-fdb2-4675-bd31-61d5768f5f27 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:12.367648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba6b0-fdb2-4675-bd31-61d5768f5f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:12.368131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ba6b0-fdb2-4675-bd31-61d5768f5f27 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:12.369438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ba6b0-fdb2-4675-bd31-61d5768f5f27 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:12.371242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ba6b0-fdb2-4675-bd31-61d5768f5f27 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:12.373438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 105/200] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:12 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:12.374973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ba6b0-fdb2-4675-bd31-61d5768f5f27 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:12.479534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:12.484171 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c1fe9-fdf1-48b3-8465-090b501b5680 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:12.499746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ba6b0-fdb2-4675-bd31-61d5768f5f27 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:12.524010 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bcfcc-ffd1-45fd-a944-aa3be88ad76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:12.524343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bcfcc-ffd1-45fd-a944-aa3be88ad76a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:12.524558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bcfcc-ffd1-45fd-a944-aa3be88ad76a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:12.524839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bcfcc-ffd1-45fd-a944-aa3be88ad76a None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:12.526040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bcfcc-ffd1-45fd-a944-aa3be88ad76a None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:12.528371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bcfcc-ffd1-45fd-a944-aa3be88ad76a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:12.533539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 96/201] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:12 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:12.533539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bcfcc-ffd1-45fd-a944-aa3be88ad76a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:12.543957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640f760-8816-487a-babc-c79729c93ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:12.545561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f760-8816-487a-babc-c79729c93ee5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:12.546402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f760-8816-487a-babc-c79729c93ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:12.546935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f760-8816-487a-babc-c79729c93ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:12.547808 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640f760-8816-487a-babc-c79729c93ee5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:12.548313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640f760-8816-487a-babc-c79729c93ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:12.550061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640f760-8816-487a-babc-c79729c93ee5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:12.561944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 106/202] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:12.563206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640f760-8816-487a-babc-c79729c93ee5 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:12.598289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:12.643544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bcfcc-ffd1-45fd-a944-aa3be88ad76a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:12.676572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640f760-8816-487a-babc-c79729c93ee5 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:12.680397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b7dc-77b0-43db-985a-7fbd2823e58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:12.680540 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b7dc-77b0-43db-985a-7fbd2823e58c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:12.680779 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b7dc-77b0-43db-985a-7fbd2823e58c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:12.681057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3b7dc-77b0-43db-985a-7fbd2823e58c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:12.681840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3b7dc-77b0-43db-985a-7fbd2823e58c None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909, user.id=2056e20cd3b24b25851969145a51ab14) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:12.682155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3b7dc-77b0-43db-985a-7fbd2823e58c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:12.683610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3b7dc-77b0-43db-985a-7fbd2823e58c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:12.690174 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 97/203] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:12 2022] GET /identity/v3/role_assignments?user.id=2056e20cd3b24b25851969145a51ab14&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:12.690953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b7dc-77b0-43db-985a-7fbd2823e58c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:12.719878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1e1c1-f147-4fba-8965-f2861403a391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:12.720907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1e1c1-f147-4fba-8965-f2861403a391 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:12.721400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1e1c1-f147-4fba-8965-f2861403a391 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:12.721916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1e1c1-f147-4fba-8965-f2861403a391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:12.722858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1e1c1-f147-4fba-8965-f2861403a391 None admin] RBAC: Adding query filter params (role.id=20d736bdf9df414f9e9b2ae27c77c071, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909, user.id=2056e20cd3b24b25851969145a51ab14) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:12.723393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1e1c1-f147-4fba-8965-f2861403a391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:12.725049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1e1c1-f147-4fba-8965-f2861403a391 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:12.731539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 107/204] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:12 2022] GET /identity/v3/role_assignments?user.id=2056e20cd3b24b25851969145a51ab14&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=20d736bdf9df414f9e9b2ae27c77c071 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:12.766947 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:12.850630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3b7dc-77b0-43db-985a-7fbd2823e58c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:12.906849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec7e10-89a7-406e-a4a4-9c3bf9200f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:12.907838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7e10-89a7-406e-a4a4-9c3bf9200f8c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:12.908309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7e10-89a7-406e-a4a4-9c3bf9200f8c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:12.908768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec7e10-89a7-406e-a4a4-9c3bf9200f8c None admin] PATH_INFO: `/v3/users/ea43c97f6ab94d598a03b4220a9d943c` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:12.910228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec7e10-89a7-406e-a4a4-9c3bf9200f8c None admin] RBAC: Authorizing `identity:get_user(user_id=ea43c97f6ab94d598a03b4220a9d943c)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:12.911935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec7e10-89a7-406e-a4a4-9c3bf9200f8c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:12.913786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 98/205] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:12 2022] GET /identity/v3/users/ea43c97f6ab94d598a03b4220a9d943c => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:12.920806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1e1c1-f147-4fba-8965-f2861403a391 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:13.040546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:13.048824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1e1c1-f147-4fba-8965-f2861403a391 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:13.086287 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b6149-be72-41d1-8634-8d4eb4d47e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:13.087241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b6149-be72-41d1-8634-8d4eb4d47e02 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:13.087712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b6149-be72-41d1-8634-8d4eb4d47e02 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:13.088305 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b6149-be72-41d1-8634-8d4eb4d47e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:13.167157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b6149-be72-41d1-8634-8d4eb4d47e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:13.168659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b6149-be72-41d1-8634-8d4eb4d47e02 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:13.263347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:13.276622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 108/206] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:13.283356 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec7e10-89a7-406e-a4a4-9c3bf9200f8c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:13.444395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:13.448576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec7e10-89a7-406e-a4a4-9c3bf9200f8c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:13.493688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86fe11-3b90-4368-84ac-dacc66f9ecda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:13.494311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86fe11-3b90-4368-84ac-dacc66f9ecda None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:13.494584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86fe11-3b90-4368-84ac-dacc66f9ecda None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:13.494852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86fe11-3b90-4368-84ac-dacc66f9ecda None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:13.498732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86fe11-3b90-4368-84ac-dacc66f9ecda None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:13.500197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86fe11-3b90-4368-84ac-dacc66f9ecda None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:13.502243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 99/207] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:13 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:13.507721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b6149-be72-41d1-8634-8d4eb4d47e02 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:13.620772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b6149-be72-41d1-8634-8d4eb4d47e02 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:13.661137 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c9027-0683-4a71-8f21-e611459e7c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:13.661784 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9027-0683-4a71-8f21-e611459e7c2e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:13.662068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9027-0683-4a71-8f21-e611459e7c2e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:13.662341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c9027-0683-4a71-8f21-e611459e7c2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:13.663081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c9027-0683-4a71-8f21-e611459e7c2e None admin] RBAC: Adding query filter params (role.id=c532e20495e749c28c0e9211e8264453, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b, user.id=ea43c97f6ab94d598a03b4220a9d943c) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:13.663389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c9027-0683-4a71-8f21-e611459e7c2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:13.664828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c9027-0683-4a71-8f21-e611459e7c2e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:13.671868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 109/208] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:13 2022] GET /identity/v3/role_assignments?user.id=ea43c97f6ab94d598a03b4220a9d943c&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=c532e20495e749c28c0e9211e8264453 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:14.033597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875273cb-23c1-4dc9-935b-c6b5cd80073a None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.033984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875273cb-23c1-4dc9-935b-c6b5cd80073a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.034254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875273cb-23c1-4dc9-935b-c6b5cd80073a None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.035518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 100/209] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:14.040629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a535a-2ad0-4b32-a64c-a94759089b93 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.041147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a535a-2ad0-4b32-a64c-a94759089b93 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.041301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a535a-2ad0-4b32-a64c-a94759089b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.062371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-3f5a535a-2ad0-4b32-a64c-a94759089b93 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:14.063590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-3f5a535a-2ad0-4b32-a64c-a94759089b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:14.133080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:14.147321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 110/210] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:14.227902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046794d-f6f5-448f-84fd-7290dc097f1a None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.228206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046794d-f6f5-448f-84fd-7290dc097f1a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.228454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046794d-f6f5-448f-84fd-7290dc097f1a None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.230175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 101/211] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:14.235844 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65deb02-460d-4c31-af49-46eae203e21d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.236384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65deb02-460d-4c31-af49-46eae203e21d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.236384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65deb02-460d-4c31-af49-46eae203e21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.256548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-c65deb02-460d-4c31-af49-46eae203e21d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:14.258418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c65deb02-460d-4c31-af49-46eae203e21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:14.329917 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 111/212] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:14.442545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046794d-f6f5-448f-84fd-7290dc097f1a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:14.549047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046794d-f6f5-448f-84fd-7290dc097f1a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:14.584178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaabdc7-6348-4d4a-ad43-c2f10dbf1a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:14.584816 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaabdc7-6348-4d4a-ad43-c2f10dbf1a53 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.585094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaabdc7-6348-4d4a-ad43-c2f10dbf1a53 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.585370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaabdc7-6348-4d4a-ad43-c2f10dbf1a53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.596169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaabdc7-6348-4d4a-ad43-c2f10dbf1a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-eaaabdc7-6348-4d4a-ad43-c2f10dbf1a53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:14.601133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:14.602132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:14.602953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 102/213] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:14.608937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65deb02-460d-4c31-af49-46eae203e21d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:14.626414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaabdc7-6348-4d4a-ad43-c2f10dbf1a53 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:14.656354 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:14.720996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65deb02-460d-4c31-af49-46eae203e21d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:14.734956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaabdc7-6348-4d4a-ad43-c2f10dbf1a53 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:14.739673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:14.757983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc141ff7-4479-4c98-ab7d-42ccd99440f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:14.758596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc141ff7-4479-4c98-ab7d-42ccd99440f5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.758872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc141ff7-4479-4c98-ab7d-42ccd99440f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.759141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc141ff7-4479-4c98-ab7d-42ccd99440f5 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.759800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc141ff7-4479-4c98-ab7d-42ccd99440f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:14.760111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc141ff7-4479-4c98-ab7d-42ccd99440f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:14.761470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc141ff7-4479-4c98-ab7d-42ccd99440f5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:14.770474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 112/214] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:14.776095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc141ff7-4479-4c98-ab7d-42ccd99440f5 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:14.776664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7012d-e9c1-4f23-8851-7e357f2ed194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:14.777526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7012d-e9c1-4f23-8851-7e357f2ed194 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.778031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7012d-e9c1-4f23-8851-7e357f2ed194 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.778522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7012d-e9c1-4f23-8851-7e357f2ed194 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.780792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7012d-e9c1-4f23-8851-7e357f2ed194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:14.782523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7012d-e9c1-4f23-8851-7e357f2ed194 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:14.789217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 103/215] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:14.790437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7012d-e9c1-4f23-8851-7e357f2ed194 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:14.897492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc141ff7-4479-4c98-ab7d-42ccd99440f5 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:14.901546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:14.909942 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7012d-e9c1-4f23-8851-7e357f2ed194 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:14.936176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16a98f-9af3-4f87-98dc-960f4f3dcfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:14.937696 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a98f-9af3-4f87-98dc-960f4f3dcfcb None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.938240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a98f-9af3-4f87-98dc-960f4f3dcfcb None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.938727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a98f-9af3-4f87-98dc-960f4f3dcfcb None admin] PATH_INFO: `/v3/users/048a2105fcd3490b8bb6bcf866c1d3e0` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.948451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe76cf6-d714-4603-8656-b82c44f3cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:14.949220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76cf6-d714-4603-8656-b82c44f3cee9 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:14.949349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76cf6-d714-4603-8656-b82c44f3cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:14.949638 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe76cf6-d714-4603-8656-b82c44f3cee9 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:14.950306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe76cf6-d714-4603-8656-b82c44f3cee9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:14.952466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe76cf6-d714-4603-8656-b82c44f3cee9 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:14.959022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16a98f-9af3-4f87-98dc-960f4f3dcfcb None admin] RBAC: Authorizing `identity:get_user(user_id=048a2105fcd3490b8bb6bcf866c1d3e0)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:14.960876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16a98f-9af3-4f87-98dc-960f4f3dcfcb None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:14.963064 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 113/216] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:14 2022] GET /identity/v3/users/048a2105fcd3490b8bb6bcf866c1d3e0 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:14.969154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16a98f-9af3-4f87-98dc-960f4f3dcfcb None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:15.012295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:15.037614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 104/217] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:15:14 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:15.037614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6e1d-de06-43f6-ae8d-f12033d3ce35 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.037614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6e1d-de06-43f6-ae8d-f12033d3ce35 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.037614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6e1d-de06-43f6-ae8d-f12033d3ce35 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.037614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 105/218] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:15.039378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c73834-032c-48bb-8d8b-c79b2ad0626c None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.039779 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c73834-032c-48bb-8d8b-c79b2ad0626c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.039966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c73834-032c-48bb-8d8b-c79b2ad0626c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.062644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-94c73834-032c-48bb-8d8b-c79b2ad0626c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:15.063952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-94c73834-032c-48bb-8d8b-c79b2ad0626c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:15.112098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16a98f-9af3-4f87-98dc-960f4f3dcfcb None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:15.153219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 106/219] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:15.160691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a930ed-78ee-4945-b42f-6e90408e8fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:15.161319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a930ed-78ee-4945-b42f-6e90408e8fdd None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.161638 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a930ed-78ee-4945-b42f-6e90408e8fdd None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.161921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a930ed-78ee-4945-b42f-6e90408e8fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.240137 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a930ed-78ee-4945-b42f-6e90408e8fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:15.241677 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a930ed-78ee-4945-b42f-6e90408e8fdd None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:15.268642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354518e-13ff-47fc-898e-5147fcf8e4a6 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.268929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354518e-13ff-47fc-898e-5147fcf8e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.269157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354518e-13ff-47fc-898e-5147fcf8e4a6 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.270550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 107/220] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:15.277546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24454102-fe8e-44cc-884b-c065db034fd1 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.277938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24454102-fe8e-44cc-884b-c065db034fd1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.278278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24454102-fe8e-44cc-884b-c065db034fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.283471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:15.302815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-24454102-fe8e-44cc-884b-c065db034fd1 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:15.303895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-24454102-fe8e-44cc-884b-c065db034fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:15.361163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 114/221] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:15.366529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a930ed-78ee-4945-b42f-6e90408e8fdd None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:15.391680 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 108/222] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:15.450097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24454102-fe8e-44cc-884b-c065db034fd1 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:15.465484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:15.490627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a930ed-78ee-4945-b42f-6e90408e8fdd None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:15.531372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4eb61-9f04-4fdf-9932-b4948d63cf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:15.531957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4eb61-9f04-4fdf-9932-b4948d63cf49 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.532247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4eb61-9f04-4fdf-9932-b4948d63cf49 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.532531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4eb61-9f04-4fdf-9932-b4948d63cf49 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.533868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4eb61-9f04-4fdf-9932-b4948d63cf49 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:15.535937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4eb61-9f04-4fdf-9932-b4948d63cf49 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:15.541642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 115/223] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:15 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:15.543809 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4eb61-9f04-4fdf-9932-b4948d63cf49 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:15.554565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:15.584063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24454102-fe8e-44cc-884b-c065db034fd1 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:15.631457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac54cca-a442-474b-9ab4-97037db1c58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:15.632106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54cca-a442-474b-9ab4-97037db1c58e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.632389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54cca-a442-474b-9ab4-97037db1c58e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.633492 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54cca-a442-474b-9ab4-97037db1c58e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.645976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac54cca-a442-474b-9ab4-97037db1c58e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-3ac54cca-a442-474b-9ab4-97037db1c58e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:15.652499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:15.653425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:15.655335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 109/224] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:15.660497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac54cca-a442-474b-9ab4-97037db1c58e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:15.673425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4eb61-9f04-4fdf-9932-b4948d63cf49 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:15.717716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d51268-3def-4ba7-9cbe-b8740748f2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:15.718733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d51268-3def-4ba7-9cbe-b8740748f2ee None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.719452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d51268-3def-4ba7-9cbe-b8740748f2ee None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.719870 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d51268-3def-4ba7-9cbe-b8740748f2ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.720833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d51268-3def-4ba7-9cbe-b8740748f2ee None admin] RBAC: Adding query filter params (role.id=bec3ab91aff841e286162327678e1cc6, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909, user.id=048a2105fcd3490b8bb6bcf866c1d3e0) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:15.721287 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d51268-3def-4ba7-9cbe-b8740748f2ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:15.723492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d51268-3def-4ba7-9cbe-b8740748f2ee None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:15.737846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 116/225] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:15 2022] GET /identity/v3/role_assignments?user.id=048a2105fcd3490b8bb6bcf866c1d3e0&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=bec3ab91aff841e286162327678e1cc6 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:15.760218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d51268-3def-4ba7-9cbe-b8740748f2ee None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:15.760439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:15.825339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac54cca-a442-474b-9ab4-97037db1c58e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:15.892695 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7939b2-4539-466e-b150-680968be82a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:15.893333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7939b2-4539-466e-b150-680968be82a9 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:15.893631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7939b2-4539-466e-b150-680968be82a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:15.893910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7939b2-4539-466e-b150-680968be82a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:15.895552 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7939b2-4539-466e-b150-680968be82a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:15.895552 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7939b2-4539-466e-b150-680968be82a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:15.897383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7939b2-4539-466e-b150-680968be82a9 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:15.901159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:15.917535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 110/226] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:15.923588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7939b2-4539-466e-b150-680968be82a9 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:15.966163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d51268-3def-4ba7-9cbe-b8740748f2ee None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.033258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc02302-ef6d-445c-9aef-e553e43b7f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.033935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc02302-ef6d-445c-9aef-e553e43b7f5b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.034215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc02302-ef6d-445c-9aef-e553e43b7f5b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.035173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc02302-ef6d-445c-9aef-e553e43b7f5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.050870 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc02302-ef6d-445c-9aef-e553e43b7f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-ddc02302-ef6d-445c-9aef-e553e43b7f5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:16.056598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:16.057532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:16.058421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 117/227] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:16.066733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc02302-ef6d-445c-9aef-e553e43b7f5b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:16.086595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7939b2-4539-466e-b150-680968be82a9 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.121497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae05c4-12a4-422e-a108-5ab5d7d58be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.122330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae05c4-12a4-422e-a108-5ab5d7d58be4 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.122611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae05c4-12a4-422e-a108-5ab5d7d58be4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.122910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae05c4-12a4-422e-a108-5ab5d7d58be4 None admin] PATH_INFO: `/v3/users/2056e20cd3b24b25851969145a51ab14` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.124148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae05c4-12a4-422e-a108-5ab5d7d58be4 None admin] RBAC: Authorizing `identity:get_user(user_id=2056e20cd3b24b25851969145a51ab14)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:16.125617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae05c4-12a4-422e-a108-5ab5d7d58be4 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:16.127621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 111/228] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:15 2022] GET /identity/v3/users/2056e20cd3b24b25851969145a51ab14 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:16.127960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:16.133275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae05c4-12a4-422e-a108-5ab5d7d58be4 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:16.240058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae05c4-12a4-422e-a108-5ab5d7d58be4 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.262847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc02302-ef6d-445c-9aef-e553e43b7f5b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.276622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea12bb-1caf-46b6-9651-149b60b45be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.277387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea12bb-1caf-46b6-9651-149b60b45be8 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.277808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea12bb-1caf-46b6-9651-149b60b45be8 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.278196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea12bb-1caf-46b6-9651-149b60b45be8 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.280017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea12bb-1caf-46b6-9651-149b60b45be8 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:16.281831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea12bb-1caf-46b6-9651-149b60b45be8 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:16.283910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 112/229] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:16 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:16.289708 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea12bb-1caf-46b6-9651-149b60b45be8 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:16.317268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:16.336205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa23ac-fb61-4615-96b8-b4357d816c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.336881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa23ac-fb61-4615-96b8-b4357d816c4e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.337165 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa23ac-fb61-4615-96b8-b4357d816c4e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.337494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa23ac-fb61-4615-96b8-b4357d816c4e None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.338200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa23ac-fb61-4615-96b8-b4357d816c4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:16.338724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa23ac-fb61-4615-96b8-b4357d816c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:16.339891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa23ac-fb61-4615-96b8-b4357d816c4e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:16.356712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 118/230] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:16.363314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa23ac-fb61-4615-96b8-b4357d816c4e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:16.393994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:16.402787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea12bb-1caf-46b6-9651-149b60b45be8 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.447176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e5ed7-f058-4b78-ab69-38cd41bacc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.448224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5ed7-f058-4b78-ab69-38cd41bacc9e None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.448709 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5ed7-f058-4b78-ab69-38cd41bacc9e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.449215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5ed7-f058-4b78-ab69-38cd41bacc9e None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/users/2056e20cd3b24b25851969145a51ab14/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.451668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e5ed7-f058-4b78-ab69-38cd41bacc9e None admin] RBAC: Authorizing `identity:create_grant(project_id=2d6a4068250844a5a5f88b9f1f3c7909, user_id=2056e20cd3b24b25851969145a51ab14, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:16.453424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e5ed7-f058-4b78-ab69-38cd41bacc9e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:16.525603 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa23ac-fb61-4615-96b8-b4357d816c4e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.784503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d73f8e-4879-434b-b6cf-bdfdad319506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.784503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d73f8e-4879-434b-b6cf-bdfdad319506 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.784503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d73f8e-4879-434b-b6cf-bdfdad319506 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.784503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d73f8e-4879-434b-b6cf-bdfdad319506 None admin] PATH_INFO: `/v3/users/2056e20cd3b24b25851969145a51ab14` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.785312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d73f8e-4879-434b-b6cf-bdfdad319506 None admin] RBAC: Authorizing `identity:get_user(user_id=2056e20cd3b24b25851969145a51ab14)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:16.785312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d73f8e-4879-434b-b6cf-bdfdad319506 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:16.785312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 119/231] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:16 2022] GET /identity/v3/users/2056e20cd3b24b25851969145a51ab14 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:16.785312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d73f8e-4879-434b-b6cf-bdfdad319506 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:16.785312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:16.785312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d73f8e-4879-434b-b6cf-bdfdad319506 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.786161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab8ba-6581-47cf-86f0-95fb00d8bbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.786161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab8ba-6581-47cf-86f0-95fb00d8bbc4 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.786161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab8ba-6581-47cf-86f0-95fb00d8bbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.786161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab8ba-6581-47cf-86f0-95fb00d8bbc4 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.786710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afab8ba-6581-47cf-86f0-95fb00d8bbc4 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:16.786710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afab8ba-6581-47cf-86f0-95fb00d8bbc4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:16.786710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 120/232] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:16 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:16.786710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab8ba-6581-47cf-86f0-95fb00d8bbc4 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:16.787214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 113/233] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:15:16 2022] PUT /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/users/2056e20cd3b24b25851969145a51ab14/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:15:16.858129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab8ba-6581-47cf-86f0-95fb00d8bbc4 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:16.901602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:16.911349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf90ca-0e1d-4165-b8c1-e431e2c13f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:16.912049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf90ca-0e1d-4165-b8c1-e431e2c13f12 None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:16.912331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf90ca-0e1d-4165-b8c1-e431e2c13f12 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:16.912607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf90ca-0e1d-4165-b8c1-e431e2c13f12 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/users/2056e20cd3b24b25851969145a51ab14/roles/20d736bdf9df414f9e9b2ae27c77c071` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:16.914873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf90ca-0e1d-4165-b8c1-e431e2c13f12 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d6a4068250844a5a5f88b9f1f3c7909, user_id=2056e20cd3b24b25851969145a51ab14, role_id=20d736bdf9df414f9e9b2ae27c77c071)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:16.916494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf90ca-0e1d-4165-b8c1-e431e2c13f12 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:17.043716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 121/234] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:15:16 2022] PUT /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/users/2056e20cd3b24b25851969145a51ab14/roles/20d736bdf9df414f9e9b2ae27c77c071 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:15:17.623559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3bb3-0f79-43ac-805c-9aaa2cd03f3b None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:17.624271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3bb3-0f79-43ac-805c-9aaa2cd03f3b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:17.624754 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3bb3-0f79-43ac-805c-9aaa2cd03f3b None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:17.626550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 114/235] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:17.632253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae39e1-0748-465b-b53a-7ac923bec42a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:17.633122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae39e1-0748-465b-b53a-7ac923bec42a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:17.633633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae39e1-0748-465b-b53a-7ac923bec42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:17.673350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-ecae39e1-0748-465b-b53a-7ac923bec42a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:17.674945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ecae39e1-0748-465b-b53a-7ac923bec42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:17.727327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3dc2f-ea26-440c-8aac-c3469449c8fd None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:17.727675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3dc2f-ea26-440c-8aac-c3469449c8fd None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:17.727884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3dc2f-ea26-440c-8aac-c3469449c8fd None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:17.729238 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 115/236] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:17.739189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab09435-8f4f-4635-a3c6-011353ec4dd3 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:17.739470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab09435-8f4f-4635-a3c6-011353ec4dd3 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:17.739743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab09435-8f4f-4635-a3c6-011353ec4dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:17.761974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 122/237] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:17.785550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-eab09435-8f4f-4635-a3c6-011353ec4dd3 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:17.786843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-eab09435-8f4f-4635-a3c6-011353ec4dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:17.889630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 116/238] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:18.070253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2e36-7398-4998-a043-325fbcd2a55f None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:18.070711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2e36-7398-4998-a043-325fbcd2a55f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:18.070839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2e36-7398-4998-a043-325fbcd2a55f None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:18.072465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 123/239] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:18.077929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8839-df79-4fac-acba-91d18ca4f7e2 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:18.078220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8839-df79-4fac-acba-91d18ca4f7e2 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:18.078498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e8839-df79-4fac-acba-91d18ca4f7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:18.106544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-399e8839-df79-4fac-acba-91d18ca4f7e2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:18.108424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-399e8839-df79-4fac-acba-91d18ca4f7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:18.144526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c2e36-7398-4998-a043-325fbcd2a55f None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:18.172305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:18.193609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 117/240] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:18.291149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c2e36-7398-4998-a043-325fbcd2a55f None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:18.310205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:18.323087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e8839-df79-4fac-acba-91d18ca4f7e2 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:18.330446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b011e41-6d96-4d1c-bed2-ebbf3aeeacd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:18.331085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b011e41-6d96-4d1c-bed2-ebbf3aeeacd1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:18.331363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b011e41-6d96-4d1c-bed2-ebbf3aeeacd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:18.331635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b011e41-6d96-4d1c-bed2-ebbf3aeeacd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:18.332761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b011e41-6d96-4d1c-bed2-ebbf3aeeacd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:18.334462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b011e41-6d96-4d1c-bed2-ebbf3aeeacd1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:18.336364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 124/241] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:18.345776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b011e41-6d96-4d1c-bed2-ebbf3aeeacd1 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:18.473357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b011e41-6d96-4d1c-bed2-ebbf3aeeacd1 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:18.548941 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c092e-ce27-4260-8fc8-71ba4c8c188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:18.549764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c092e-ce27-4260-8fc8-71ba4c8c188c None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:18.550047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c092e-ce27-4260-8fc8-71ba4c8c188c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:18.551148 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c092e-ce27-4260-8fc8-71ba4c8c188c None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:18.551812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c092e-ce27-4260-8fc8-71ba4c8c188c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:18.553938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c092e-ce27-4260-8fc8-71ba4c8c188c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:18.556961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e8839-df79-4fac-acba-91d18ca4f7e2 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:18.600943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93746a-bbed-42c8-bcfd-6893ea34b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:18.601624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93746a-bbed-42c8-bcfd-6893ea34b359 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:18.601908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93746a-bbed-42c8-bcfd-6893ea34b359 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:18.602177 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93746a-bbed-42c8-bcfd-6893ea34b359 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:18.613819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93746a-bbed-42c8-bcfd-6893ea34b359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-7c93746a-bbed-42c8-bcfd-6893ea34b359 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:18.618925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:18.619864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 118/242] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:18.621151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93746a-bbed-42c8-bcfd-6893ea34b359 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:18.659156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 125/243] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:15:18 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:18.660785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c092e-ce27-4260-8fc8-71ba4c8c188c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:18.710067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:18.761972 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:18.834096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93746a-bbed-42c8-bcfd-6893ea34b359 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:18.864241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c092e-ce27-4260-8fc8-71ba4c8c188c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:18.893459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b3ca4-d564-481f-85c5-97b05662065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:18.897802 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b3ca4-d564-481f-85c5-97b05662065f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:18.898321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b3ca4-d564-481f-85c5-97b05662065f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:18.898763 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b3ca4-d564-481f-85c5-97b05662065f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:18.913076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b3ca4-d564-481f-85c5-97b05662065f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:18.915645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acff7af-ae48-41aa-96ca-3d131b620ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:18.916362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acff7af-ae48-41aa-96ca-3d131b620ee1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:18.916737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acff7af-ae48-41aa-96ca-3d131b620ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:18.917925 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acff7af-ae48-41aa-96ca-3d131b620ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:18.918723 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acff7af-ae48-41aa-96ca-3d131b620ee1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:18.919123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acff7af-ae48-41aa-96ca-3d131b620ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-799b3ca4-d564-481f-85c5-97b05662065f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:18.919902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:18.921239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:18.922370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:18.923585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acff7af-ae48-41aa-96ca-3d131b620ee1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:18.924811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 119/244] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:18.930962 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b3ca4-d564-481f-85c5-97b05662065f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:18.939727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 126/245] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:18.941085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acff7af-ae48-41aa-96ca-3d131b620ee1 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:19.043098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b3ca4-d564-481f-85c5-97b05662065f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:19.053326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acff7af-ae48-41aa-96ca-3d131b620ee1 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:19.056793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:19.057086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:19.085632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b0ac6-0fd5-4052-a605-a41f1538c2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:19.086264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0ac6-0fd5-4052-a605-a41f1538c2f9 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:19.086544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0ac6-0fd5-4052-a605-a41f1538c2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:19.086814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b0ac6-0fd5-4052-a605-a41f1538c2f9 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:19.087487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b0ac6-0fd5-4052-a605-a41f1538c2f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:19.087794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b0ac6-0fd5-4052-a605-a41f1538c2f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:19.089188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b0ac6-0fd5-4052-a605-a41f1538c2f9 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:19.099269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 120/246] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:19.106024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5853c3-04b2-4b50-a79e-abbbbe8abacd None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:19.106024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5853c3-04b2-4b50-a79e-abbbbe8abacd None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:19.106206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b83ea2-6bcb-4136-9536-822f9f36b384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:19.106306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5853c3-04b2-4b50-a79e-abbbbe8abacd None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:19.106383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b83ea2-6bcb-4136-9536-822f9f36b384 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:19.106383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b83ea2-6bcb-4136-9536-822f9f36b384 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:19.106503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 121/247] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:19.107506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5853c3-04b2-4b50-a79e-abbbbe8abacd None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:19.107805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b83ea2-6bcb-4136-9536-822f9f36b384 None admin] PATH_INFO: `/v3/users/4df3a673ee6e4a5dbf431386032c2281` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:19.125334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b83ea2-6bcb-4136-9536-822f9f36b384 None admin] RBAC: Authorizing `identity:get_user(user_id=4df3a673ee6e4a5dbf431386032c2281)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:19.126852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b83ea2-6bcb-4136-9536-822f9f36b384 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:19.128630 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 127/248] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:18 2022] GET /identity/v3/users/4df3a673ee6e4a5dbf431386032c2281 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:19.135003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ce957-1ab3-416a-958c-438fe76fd7e5 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:19.135003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ce957-1ab3-416a-958c-438fe76fd7e5 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:19.135216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ce957-1ab3-416a-958c-438fe76fd7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:19.155619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-f94ce957-1ab3-416a-958c-438fe76fd7e5 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:19.157035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f94ce957-1ab3-416a-958c-438fe76fd7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:19.244959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 128/249] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:19.246312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ce957-1ab3-416a-958c-438fe76fd7e5 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:19.261902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5853c3-04b2-4b50-a79e-abbbbe8abacd None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:19.333344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485f231-0fbf-4393-beb7-f4f778f3b2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:19.337167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485f231-0fbf-4393-beb7-f4f778f3b2b1 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:19.337733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485f231-0fbf-4393-beb7-f4f778f3b2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:19.338265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485f231-0fbf-4393-beb7-f4f778f3b2b1 None admin] PATH_INFO: `/v3/users/048a2105fcd3490b8bb6bcf866c1d3e0` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:19.339814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485f231-0fbf-4393-beb7-f4f778f3b2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=048a2105fcd3490b8bb6bcf866c1d3e0)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:19.341604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485f231-0fbf-4393-beb7-f4f778f3b2b1 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:19.343555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 122/250] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:19 2022] GET /identity/v3/users/048a2105fcd3490b8bb6bcf866c1d3e0 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:19.349194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485f231-0fbf-4393-beb7-f4f778f3b2b1 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:19.397310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:19.408516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ce957-1ab3-416a-958c-438fe76fd7e5 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:19.441527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:19.454088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e55a8-256b-439b-b9f6-c9ee22865e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:19.454712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e55a8-256b-439b-b9f6-c9ee22865e2f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:19.454992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e55a8-256b-439b-b9f6-c9ee22865e2f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:19.455270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e55a8-256b-439b-b9f6-c9ee22865e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:19.517618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485f231-0fbf-4393-beb7-f4f778f3b2b1 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:19.540891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e55a8-256b-439b-b9f6-c9ee22865e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:19.542513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e55a8-256b-439b-b9f6-c9ee22865e2f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:19.555204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65987e95-65b7-46e6-a05b-e282d10ca1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:19.555850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65987e95-65b7-46e6-a05b-e282d10ca1bb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:19.556132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65987e95-65b7-46e6-a05b-e282d10ca1bb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:19.556406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65987e95-65b7-46e6-a05b-e282d10ca1bb None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:19.557664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65987e95-65b7-46e6-a05b-e282d10ca1bb None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:19.559258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65987e95-65b7-46e6-a05b-e282d10ca1bb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:19.561814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 123/251] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:19 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:19.563013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef4fa-b04d-4114-aa40-2287103b97ae None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:19.563296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef4fa-b04d-4114-aa40-2287103b97ae None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:19.563565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eef4fa-b04d-4114-aa40-2287103b97ae None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:19.564911 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 124/252] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:19.569535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eef4fa-b04d-4114-aa40-2287103b97ae None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:19.646543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:19.657354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 129/253] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:19.658959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72192e15-3a9d-4837-a82d-ac1b3007ea58 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:19.659266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72192e15-3a9d-4837-a82d-ac1b3007ea58 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:19.659926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72192e15-3a9d-4837-a82d-ac1b3007ea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:19.685862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eef4fa-b04d-4114-aa40-2287103b97ae None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:19.686934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-72192e15-3a9d-4837-a82d-ac1b3007ea58 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:19.689736 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-72192e15-3a9d-4837-a82d-ac1b3007ea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:19.695799 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:19.726402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900d141-3ff2-462e-8349-0eb446107c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:19.727152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d141-3ff2-462e-8349-0eb446107c14 None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:19.727442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d141-3ff2-462e-8349-0eb446107c14 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:19.728191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900d141-3ff2-462e-8349-0eb446107c14 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/users/048a2105fcd3490b8bb6bcf866c1d3e0/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:19.730804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900d141-3ff2-462e-8349-0eb446107c14 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d6a4068250844a5a5f88b9f1f3c7909, user_id=048a2105fcd3490b8bb6bcf866c1d3e0, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:19.732372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900d141-3ff2-462e-8349-0eb446107c14 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:19.769701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 130/254] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:19.770863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72192e15-3a9d-4837-a82d-ac1b3007ea58 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:19.825153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 125/255] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:15:19 2022] PUT /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/users/048a2105fcd3490b8bb6bcf866c1d3e0/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:19.826886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900d141-3ff2-462e-8349-0eb446107c14 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:19.953370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72192e15-3a9d-4837-a82d-ac1b3007ea58 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:19.994268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:20.026858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f29e-74d3-4d5b-b083-1497fc18ac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:20.027554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f29e-74d3-4d5b-b083-1497fc18ac3f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:20.027839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f29e-74d3-4d5b-b083-1497fc18ac3f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:20.028192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5f29e-74d3-4d5b-b083-1497fc18ac3f None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:20.033669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5f29e-74d3-4d5b-b083-1497fc18ac3f None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:20.033669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5f29e-74d3-4d5b-b083-1497fc18ac3f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:20.035381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 131/256] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:19 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:20.041189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f29e-74d3-4d5b-b083-1497fc18ac3f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:20.085398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900d141-3ff2-462e-8349-0eb446107c14 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:20.155694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676682a-6f1d-45ea-b775-0eb5707a52cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:20.156338 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676682a-6f1d-45ea-b775-0eb5707a52cd None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:20.156617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676682a-6f1d-45ea-b775-0eb5707a52cd None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:20.156888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676682a-6f1d-45ea-b775-0eb5707a52cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:20.159160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5f29e-74d3-4d5b-b083-1497fc18ac3f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:20.175347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676682a-6f1d-45ea-b775-0eb5707a52cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-d676682a-6f1d-45ea-b775-0eb5707a52cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:20.180358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:20.181294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:20.182131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 126/257] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:20.189835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676682a-6f1d-45ea-b775-0eb5707a52cd None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:20.217215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93be71-4036-493d-99e8-3d2475588587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:20.218518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93be71-4036-493d-99e8-3d2475588587 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:20.219019 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93be71-4036-493d-99e8-3d2475588587 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:20.219610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93be71-4036-493d-99e8-3d2475588587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:20.220668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93be71-4036-493d-99e8-3d2475588587 None admin] RBAC: Adding query filter params (role.id=c532e20495e749c28c0e9211e8264453, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909, user.id=4df3a673ee6e4a5dbf431386032c2281) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:20.221196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93be71-4036-493d-99e8-3d2475588587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:20.226344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:20.227971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93be71-4036-493d-99e8-3d2475588587 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:20.241607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 132/258] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:20 2022] GET /identity/v3/role_assignments?user.id=4df3a673ee6e4a5dbf431386032c2281&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=c532e20495e749c28c0e9211e8264453 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:20.252563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93be71-4036-493d-99e8-3d2475588587 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:20.305824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676682a-6f1d-45ea-b775-0eb5707a52cd None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:20.314094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:20.352503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331b50b-bdc0-4ab1-9a5b-ee1b4a6f2bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:20.353108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331b50b-bdc0-4ab1-9a5b-ee1b4a6f2bc2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:20.353390 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331b50b-bdc0-4ab1-9a5b-ee1b4a6f2bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:20.353760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331b50b-bdc0-4ab1-9a5b-ee1b4a6f2bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:20.354454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331b50b-bdc0-4ab1-9a5b-ee1b4a6f2bc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:20.354762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331b50b-bdc0-4ab1-9a5b-ee1b4a6f2bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:20.356204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331b50b-bdc0-4ab1-9a5b-ee1b4a6f2bc2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:20.366538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 127/259] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:20.372430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331b50b-bdc0-4ab1-9a5b-ee1b4a6f2bc2 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:20.404857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93be71-4036-493d-99e8-3d2475588587 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:20.470426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadeff9-2e90-4b15-9766-8a9625d6a265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:20.471417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadeff9-2e90-4b15-9766-8a9625d6a265 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:20.471919 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadeff9-2e90-4b15-9766-8a9625d6a265 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:20.472390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadeff9-2e90-4b15-9766-8a9625d6a265 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:20.488790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadeff9-2e90-4b15-9766-8a9625d6a265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-acadeff9-2e90-4b15-9766-8a9625d6a265 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:20.499767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:20.500835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:20.501668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:20.504091 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 133/260] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:20.509515 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:20.510661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadeff9-2e90-4b15-9766-8a9625d6a265 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:20.534672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331b50b-bdc0-4ab1-9a5b-ee1b4a6f2bc2 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:20.597788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4bfde-110c-4d52-b684-d679b44cc9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:20.598439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4bfde-110c-4d52-b684-d679b44cc9b1 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:20.598721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4bfde-110c-4d52-b684-d679b44cc9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:20.598995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4bfde-110c-4d52-b684-d679b44cc9b1 None admin] PATH_INFO: `/v3/users/2056e20cd3b24b25851969145a51ab14` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:20.601170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4bfde-110c-4d52-b684-d679b44cc9b1 None admin] RBAC: Authorizing `identity:get_user(user_id=2056e20cd3b24b25851969145a51ab14)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:20.602665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4bfde-110c-4d52-b684-d679b44cc9b1 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:20.604433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 128/261] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:20 2022] GET /identity/v3/users/2056e20cd3b24b25851969145a51ab14 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:20.619139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4bfde-110c-4d52-b684-d679b44cc9b1 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:20.724758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadeff9-2e90-4b15-9766-8a9625d6a265 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:20.754945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:20.790390 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4bfde-110c-4d52-b684-d679b44cc9b1 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:20.800536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adba219-796f-47dc-aaca-9d0dab87fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:20.801487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adba219-796f-47dc-aaca-9d0dab87fe84 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:20.802061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adba219-796f-47dc-aaca-9d0dab87fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:20.802502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adba219-796f-47dc-aaca-9d0dab87fe84 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:20.803338 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adba219-796f-47dc-aaca-9d0dab87fe84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:20.803824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adba219-796f-47dc-aaca-9d0dab87fe84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:20.805499 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adba219-796f-47dc-aaca-9d0dab87fe84 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:20.823999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 134/262] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:20.828448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f6afd-0145-4bb1-bfb1-43bf98343cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:20.829104 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f6afd-0145-4bb1-bfb1-43bf98343cca None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:20.829461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f6afd-0145-4bb1-bfb1-43bf98343cca None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:20.829857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f6afd-0145-4bb1-bfb1-43bf98343cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:20.831151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adba219-796f-47dc-aaca-9d0dab87fe84 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:20.857668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:20.906490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f6afd-0145-4bb1-bfb1-43bf98343cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:20.907966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f6afd-0145-4bb1-bfb1-43bf98343cca None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:21.015465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 129/263] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:21.020785 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f6afd-0145-4bb1-bfb1-43bf98343cca None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:21.109992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:21.132472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f6afd-0145-4bb1-bfb1-43bf98343cca None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:21.163575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adba219-796f-47dc-aaca-9d0dab87fe84 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:21.171591 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3258ba-3a39-415a-9fcb-4e366cde6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:21.172249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3258ba-3a39-415a-9fcb-4e366cde6a04 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:21.172534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3258ba-3a39-415a-9fcb-4e366cde6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:21.172809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3258ba-3a39-415a-9fcb-4e366cde6a04 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:21.174033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3258ba-3a39-415a-9fcb-4e366cde6a04 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:21.175520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3258ba-3a39-415a-9fcb-4e366cde6a04 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:21.177448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 130/264] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:21 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:21.183747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3258ba-3a39-415a-9fcb-4e366cde6a04 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:21.297067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3258ba-3a39-415a-9fcb-4e366cde6a04 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:21.311080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cef15-292f-4519-ab72-20abe76fe9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:21.311743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cef15-292f-4519-ab72-20abe76fe9f1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:21.312021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cef15-292f-4519-ab72-20abe76fe9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:21.312293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cef15-292f-4519-ab72-20abe76fe9f1 None admin] PATH_INFO: `/v3/users/2056e20cd3b24b25851969145a51ab14` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:21.318267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cef15-292f-4519-ab72-20abe76fe9f1 None admin] RBAC: Authorizing `identity:get_user(user_id=2056e20cd3b24b25851969145a51ab14)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:21.319731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cef15-292f-4519-ab72-20abe76fe9f1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:21.321693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 135/265] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:20 2022] GET /identity/v3/users/2056e20cd3b24b25851969145a51ab14 => generated 283 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:21.327296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cef15-292f-4519-ab72-20abe76fe9f1 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:21.333988 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa2a59-ac22-4098-9ce9-7dddc685b36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:21.334607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa2a59-ac22-4098-9ce9-7dddc685b36c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:21.334945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa2a59-ac22-4098-9ce9-7dddc685b36c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:21.335226 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa2a59-ac22-4098-9ce9-7dddc685b36c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:21.335956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa2a59-ac22-4098-9ce9-7dddc685b36c None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909, user.id=2056e20cd3b24b25851969145a51ab14) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:21.336271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa2a59-ac22-4098-9ce9-7dddc685b36c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:21.336748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:21.345914 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa2a59-ac22-4098-9ce9-7dddc685b36c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:21.353652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 131/266] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:21 2022] GET /identity/v3/role_assignments?user.id=2056e20cd3b24b25851969145a51ab14&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:21.445067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:21.459998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789ec23-b273-4611-9448-ad0ed9a77208 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:21.460637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789ec23-b273-4611-9448-ad0ed9a77208 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:21.461081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789ec23-b273-4611-9448-ad0ed9a77208 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:21.463102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 132/267] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:21.470110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fef7d9-5ad0-4271-873a-a3ded076dfcd None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:21.470703 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fef7d9-5ad0-4271-873a-a3ded076dfcd None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:21.471183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fef7d9-5ad0-4271-873a-a3ded076dfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:21.493010 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-d3fef7d9-5ad0-4271-873a-a3ded076dfcd None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:21.494702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d3fef7d9-5ad0-4271-873a-a3ded076dfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:21.556354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cef15-292f-4519-ab72-20abe76fe9f1 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:21.594396 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 133/268] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:21.613613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bba24b-c269-4a6d-812b-8ca907f53925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:21.614632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bba24b-c269-4a6d-812b-8ca907f53925 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:21.615140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bba24b-c269-4a6d-812b-8ca907f53925 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:21.615614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bba24b-c269-4a6d-812b-8ca907f53925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:21.713140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bba24b-c269-4a6d-812b-8ca907f53925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:21.714642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bba24b-c269-4a6d-812b-8ca907f53925 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:21.771717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:21.839306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 136/269] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:21.845209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fef7d9-5ad0-4271-873a-a3ded076dfcd None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:21.956223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bba24b-c269-4a6d-812b-8ca907f53925 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:21.996612 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fef7d9-5ad0-4271-873a-a3ded076dfcd None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:22.029437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:22.062920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0c9a8-fbd5-4136-9573-a726e6c66070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:22.063578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0c9a8-fbd5-4136-9573-a726e6c66070 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:22.063865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0c9a8-fbd5-4136-9573-a726e6c66070 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:22.064144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0c9a8-fbd5-4136-9573-a726e6c66070 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:22.065383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0c9a8-fbd5-4136-9573-a726e6c66070 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:22.067938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0c9a8-fbd5-4136-9573-a726e6c66070 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:22.071319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 134/270] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:21 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:22.080016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0c9a8-fbd5-4136-9573-a726e6c66070 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:22.130877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bba24b-c269-4a6d-812b-8ca907f53925 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:22.203510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682fc3b-50d2-45d9-8cfc-34b14608a054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:22.204161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682fc3b-50d2-45d9-8cfc-34b14608a054 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:22.204442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682fc3b-50d2-45d9-8cfc-34b14608a054 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:22.204714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682fc3b-50d2-45d9-8cfc-34b14608a054 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:22.230559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682fc3b-50d2-45d9-8cfc-34b14608a054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-0682fc3b-50d2-45d9-8cfc-34b14608a054 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:22.236781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:22.237714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:22.238543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 137/271] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:22.245787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682fc3b-50d2-45d9-8cfc-34b14608a054 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:22.251517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:22.279885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0c9a8-fbd5-4136-9573-a726e6c66070 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:22.347857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55cb5e-3ab8-4de8-a1df-cc265aeb551b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:22.348476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55cb5e-3ab8-4de8-a1df-cc265aeb551b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:22.348759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55cb5e-3ab8-4de8-a1df-cc265aeb551b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:22.349035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55cb5e-3ab8-4de8-a1df-cc265aeb551b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:22.349788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55cb5e-3ab8-4de8-a1df-cc265aeb551b None admin] RBAC: Adding query filter params (role.id=20d736bdf9df414f9e9b2ae27c77c071, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909, user.id=2056e20cd3b24b25851969145a51ab14) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:22.350108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55cb5e-3ab8-4de8-a1df-cc265aeb551b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:22.351562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55cb5e-3ab8-4de8-a1df-cc265aeb551b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:22.367442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 135/272] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:22 2022] GET /identity/v3/role_assignments?user.id=2056e20cd3b24b25851969145a51ab14&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=20d736bdf9df414f9e9b2ae27c77c071 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:22.409386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682fc3b-50d2-45d9-8cfc-34b14608a054 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:22.462164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72a337-8bbf-4dd6-b5b7-e57ab9e69958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:22.462792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72a337-8bbf-4dd6-b5b7-e57ab9e69958 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:22.463071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72a337-8bbf-4dd6-b5b7-e57ab9e69958 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:22.463345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72a337-8bbf-4dd6-b5b7-e57ab9e69958 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:22.464027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72a337-8bbf-4dd6-b5b7-e57ab9e69958 None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:22.464329 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72a337-8bbf-4dd6-b5b7-e57ab9e69958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:22.465772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72a337-8bbf-4dd6-b5b7-e57ab9e69958 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:22.475496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 138/273] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:22.481294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55cb5e-3ab8-4de8-a1df-cc265aeb551b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:22.531916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12106e-46f1-4e1e-a9a3-4fde4602e9d7 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:22.532252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12106e-46f1-4e1e-a9a3-4fde4602e9d7 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:22.532470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12106e-46f1-4e1e-a9a3-4fde4602e9d7 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:22.534000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 139/274] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:22.540475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c6a5-965e-487d-bc11-0e6db0475c9d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:22.540760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c6a5-965e-487d-bc11-0e6db0475c9d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:22.541037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c6a5-965e-487d-bc11-0e6db0475c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:22.567439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:22.580754 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2751c6a5-965e-487d-bc11-0e6db0475c9d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:22.582033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2751c6a5-965e-487d-bc11-0e6db0475c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:22.640480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55cb5e-3ab8-4de8-a1df-cc265aeb551b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:22.653480 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:22.665186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 140/275] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:22.666488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3ae77-b8ce-4dd9-9fb3-832050b19c93 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:22.666772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3ae77-b8ce-4dd9-9fb3-832050b19c93 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:22.667042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3ae77-b8ce-4dd9-9fb3-832050b19c93 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:22.673708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 141/276] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:15:22.682979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffdbaa-c2db-48bc-bd0c-0cc30115c215 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:22.683262 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffdbaa-c2db-48bc-bd0c-0cc30115c215 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:22.683535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffdbaa-c2db-48bc-bd0c-0cc30115c215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:22.687891 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298efed-8957-4218-8c11-981f6898bc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:22.688551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298efed-8957-4218-8c11-981f6898bc15 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:22.688836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298efed-8957-4218-8c11-981f6898bc15 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:22.689111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298efed-8957-4218-8c11-981f6898bc15 None admin] PATH_INFO: `/v3/users/e6992d004cc346aeb85dcc9032f5ba28` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:22.706133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-d9ffdbaa-c2db-48bc-bd0c-0cc30115c215 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:22.707346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d9ffdbaa-c2db-48bc-bd0c-0cc30115c215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:22.708754 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298efed-8957-4218-8c11-981f6898bc15 None admin] RBAC: Authorizing `identity:get_user(user_id=e6992d004cc346aeb85dcc9032f5ba28)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:22.710745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298efed-8957-4218-8c11-981f6898bc15 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:22.712906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 136/277] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:22 2022] GET /identity/v3/users/e6992d004cc346aeb85dcc9032f5ba28 => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:22.718857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298efed-8957-4218-8c11-981f6898bc15 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:22.784509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 142/278] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:22.840233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298efed-8957-4218-8c11-981f6898bc15 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:22.850007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:22.876120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c890eb-18f6-4803-a4d9-e77f823ff5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:22.876730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c890eb-18f6-4803-a4d9-e77f823ff5dc None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:22.877012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c890eb-18f6-4803-a4d9-e77f823ff5dc None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:22.877287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c890eb-18f6-4803-a4d9-e77f823ff5dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:22.878037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c890eb-18f6-4803-a4d9-e77f823ff5dc None admin] RBAC: Adding query filter params (role.id=bec3ab91aff841e286162327678e1cc6, user.id=e6992d004cc346aeb85dcc9032f5ba28, scope.system=all) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:22.878351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c890eb-18f6-4803-a4d9-e77f823ff5dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:22.879812 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c890eb-18f6-4803-a4d9-e77f823ff5dc None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:22.885382 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 137/279] 10.222.0.74 () {56 vars in 1308 bytes} [Wed Aug 31 00:15:22 2022] GET /identity/v3/role_assignments?user.id=e6992d004cc346aeb85dcc9032f5ba28&scope.system=all&role.id=bec3ab91aff841e286162327678e1cc6 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:22.964752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffdbaa-c2db-48bc-bd0c-0cc30115c215 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:23.076662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffdbaa-c2db-48bc-bd0c-0cc30115c215 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:23.080109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c890eb-18f6-4803-a4d9-e77f823ff5dc None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:23.107639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:23.116976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80017019-b7f8-45fd-a78c-50e634893407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:23.121741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80017019-b7f8-45fd-a78c-50e634893407 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:23.121741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80017019-b7f8-45fd-a78c-50e634893407 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:23.121741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80017019-b7f8-45fd-a78c-50e634893407 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:23.130847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80017019-b7f8-45fd-a78c-50e634893407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-80017019-b7f8-45fd-a78c-50e634893407 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:23.136166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:23.137081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:23.137940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 143/280] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:23.145874 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80017019-b7f8-45fd-a78c-50e634893407 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:23.210954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c890eb-18f6-4803-a4d9-e77f823ff5dc None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:23.248333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf2f42-5893-4eb7-ae17-a8009a1101a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:23.248965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf2f42-5893-4eb7-ae17-a8009a1101a3 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:23.249245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf2f42-5893-4eb7-ae17-a8009a1101a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:23.249520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf2f42-5893-4eb7-ae17-a8009a1101a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:23.250766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf2f42-5893-4eb7-ae17-a8009a1101a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:23.252238 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf2f42-5893-4eb7-ae17-a8009a1101a3 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:23.254054 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 138/281] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:23.259595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f985e93-fc95-4344-ad65-55ee1555cb5e None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:23.259892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f985e93-fc95-4344-ad65-55ee1555cb5e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:23.260169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f985e93-fc95-4344-ad65-55ee1555cb5e None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:23.261402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 139/282] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:23.266109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f985e93-fc95-4344-ad65-55ee1555cb5e None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:23.267160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80017019-b7f8-45fd-a78c-50e634893407 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:23.308994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf96d7-fb9b-4a57-9495-51be1abd10bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:23.309620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf96d7-fb9b-4a57-9495-51be1abd10bc None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:23.310021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf96d7-fb9b-4a57-9495-51be1abd10bc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:23.310294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf96d7-fb9b-4a57-9495-51be1abd10bc None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:23.311363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf96d7-fb9b-4a57-9495-51be1abd10bc None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:23.311679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf96d7-fb9b-4a57-9495-51be1abd10bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:23.313041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:23.313509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf96d7-fb9b-4a57-9495-51be1abd10bc None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:23.329083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 144/283] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:23.329083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435a87-b0b4-40c9-8156-35e79eb93bc2 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:23.329083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435a87-b0b4-40c9-8156-35e79eb93bc2 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:23.329083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435a87-b0b4-40c9-8156-35e79eb93bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:23.352841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-01435a87-b0b4-40c9-8156-35e79eb93bc2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:23.354370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-01435a87-b0b4-40c9-8156-35e79eb93bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:23.375884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f985e93-fc95-4344-ad65-55ee1555cb5e None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:23.402725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:23.412168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77328b0d-6215-4405-b764-7ed593043182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:23.426276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77328b0d-6215-4405-b764-7ed593043182 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:23.426276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77328b0d-6215-4405-b764-7ed593043182 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:23.426276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77328b0d-6215-4405-b764-7ed593043182 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:23.426276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77328b0d-6215-4405-b764-7ed593043182 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:23.426276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77328b0d-6215-4405-b764-7ed593043182 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:23.427959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 145/284] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:23.434571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01435a87-b0b4-40c9-8156-35e79eb93bc2 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:23.540102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01435a87-b0b4-40c9-8156-35e79eb93bc2 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:23.558928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 140/285] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:15:23 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:23.588011 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437cb31-3d38-4c14-8085-6d7cd9981fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:23.588678 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437cb31-3d38-4c14-8085-6d7cd9981fa8 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:23.588957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437cb31-3d38-4c14-8085-6d7cd9981fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:23.589235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437cb31-3d38-4c14-8085-6d7cd9981fa8 None admin] PATH_INFO: `/v3/users/048a2105fcd3490b8bb6bcf866c1d3e0` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:23.590529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437cb31-3d38-4c14-8085-6d7cd9981fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=048a2105fcd3490b8bb6bcf866c1d3e0)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:23.592463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437cb31-3d38-4c14-8085-6d7cd9981fa8 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:23.594273 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 146/286] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:23 2022] GET /identity/v3/users/048a2105fcd3490b8bb6bcf866c1d3e0 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:23.600155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77328b0d-6215-4405-b764-7ed593043182 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:23.707586 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437cb31-3d38-4c14-8085-6d7cd9981fa8 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:23.718672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:23.727119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77328b0d-6215-4405-b764-7ed593043182 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:23.774837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6ef95-0ec0-4f47-810d-3cd21f520efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:23.775752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6ef95-0ec0-4f47-810d-3cd21f520efc None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:23.776189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6ef95-0ec0-4f47-810d-3cd21f520efc None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:23.776468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6ef95-0ec0-4f47-810d-3cd21f520efc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:23.778574 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:23.855407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437cb31-3d38-4c14-8085-6d7cd9981fa8 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:23.861191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6ef95-0ec0-4f47-810d-3cd21f520efc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:23.862715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6ef95-0ec0-4f47-810d-3cd21f520efc None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:23.923953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be020f-7a7f-4c01-ad2f-e5934a60a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:23.924790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be020f-7a7f-4c01-ad2f-e5934a60a04c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:23.925174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be020f-7a7f-4c01-ad2f-e5934a60a04c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:23.925453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be020f-7a7f-4c01-ad2f-e5934a60a04c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:23.943099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be020f-7a7f-4c01-ad2f-e5934a60a04c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-62be020f-7a7f-4c01-ad2f-e5934a60a04c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:23.948531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:23.949453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:23.950444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 147/287] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:23.958505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be020f-7a7f-4c01-ad2f-e5934a60a04c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:24.000260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:24.007396 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 141/288] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:24.016270 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6ef95-0ec0-4f47-810d-3cd21f520efc None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:24.112822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be020f-7a7f-4c01-ad2f-e5934a60a04c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:24.122539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:24.137773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6ef95-0ec0-4f47-810d-3cd21f520efc None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:24.158353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83719775-4ae2-4e4c-b1bb-6aa079c6912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:24.159373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83719775-4ae2-4e4c-b1bb-6aa079c6912c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:24.159661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83719775-4ae2-4e4c-b1bb-6aa079c6912c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:24.159940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83719775-4ae2-4e4c-b1bb-6aa079c6912c None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:24.160966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83719775-4ae2-4e4c-b1bb-6aa079c6912c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:24.161275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83719775-4ae2-4e4c-b1bb-6aa079c6912c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:24.162882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83719775-4ae2-4e4c-b1bb-6aa079c6912c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:24.175420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 148/289] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:24.183474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83719775-4ae2-4e4c-b1bb-6aa079c6912c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:24.195805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cd453-18ad-4e88-b3e7-9c3383c9e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:24.197303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cd453-18ad-4e88-b3e7-9c3383c9e055 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:24.197928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cd453-18ad-4e88-b3e7-9c3383c9e055 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:24.198486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cd453-18ad-4e88-b3e7-9c3383c9e055 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:24.205145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cd453-18ad-4e88-b3e7-9c3383c9e055 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:24.209228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cd453-18ad-4e88-b3e7-9c3383c9e055 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:24.211140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 142/290] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:24 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:24.220966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cd453-18ad-4e88-b3e7-9c3383c9e055 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:24.341662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83719775-4ae2-4e4c-b1bb-6aa079c6912c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:24.374992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:24.382411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833554bf-efa9-446a-ab53-c083c72786b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:24.384109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833554bf-efa9-446a-ab53-c083c72786b9 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:24.384541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833554bf-efa9-446a-ab53-c083c72786b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:24.385106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833554bf-efa9-446a-ab53-c083c72786b9 None admin] PATH_INFO: `/v3/users/4df3a673ee6e4a5dbf431386032c2281` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:24.395556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833554bf-efa9-446a-ab53-c083c72786b9 None admin] RBAC: Authorizing `identity:get_user(user_id=4df3a673ee6e4a5dbf431386032c2281)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:24.395556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833554bf-efa9-446a-ab53-c083c72786b9 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:24.395556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 149/291] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:24 2022] GET /identity/v3/users/4df3a673ee6e4a5dbf431386032c2281 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:24.397733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833554bf-efa9-446a-ab53-c083c72786b9 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:24.439226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:24.467666 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cd453-18ad-4e88-b3e7-9c3383c9e055 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:24.536034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd7178-8f0a-4eb4-90a5-df7af131ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:24.536654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7178-8f0a-4eb4-90a5-df7af131ff1c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:24.536937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7178-8f0a-4eb4-90a5-df7af131ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:24.537209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd7178-8f0a-4eb4-90a5-df7af131ff1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:24.537980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd7178-8f0a-4eb4-90a5-df7af131ff1c None admin] RBAC: Adding query filter params (role.id=bec3ab91aff841e286162327678e1cc6, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909, user.id=048a2105fcd3490b8bb6bcf866c1d3e0) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:24.538293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd7178-8f0a-4eb4-90a5-df7af131ff1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:24.539739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd7178-8f0a-4eb4-90a5-df7af131ff1c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:24.547695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833554bf-efa9-446a-ab53-c083c72786b9 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:24.560692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 143/292] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:24 2022] GET /identity/v3/role_assignments?user.id=048a2105fcd3490b8bb6bcf866c1d3e0&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=bec3ab91aff841e286162327678e1cc6 => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:24.609785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261f02e-ce32-4463-a291-f01d8ac62cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:24.610454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f02e-ce32-4463-a291-f01d8ac62cc8 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:24.610741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f02e-ce32-4463-a291-f01d8ac62cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:24.611093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261f02e-ce32-4463-a291-f01d8ac62cc8 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:24.612295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261f02e-ce32-4463-a291-f01d8ac62cc8 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:24.613872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e261f02e-ce32-4463-a291-f01d8ac62cc8 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:24.615840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 150/293] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:24 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:24.621764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd7178-8f0a-4eb4-90a5-df7af131ff1c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:24.758827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd7178-8f0a-4eb4-90a5-df7af131ff1c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:24.789056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:24.801385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f989f-d6f7-42b3-b118-dc918ee1042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:24.802105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f989f-d6f7-42b3-b118-dc918ee1042a None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:24.810730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f989f-d6f7-42b3-b118-dc918ee1042a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:24.810730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f989f-d6f7-42b3-b118-dc918ee1042a None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/users/4df3a673ee6e4a5dbf431386032c2281/roles/c532e20495e749c28c0e9211e8264453` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:24.810730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f989f-d6f7-42b3-b118-dc918ee1042a None admin] RBAC: Authorizing `identity:create_grant(project_id=2d6a4068250844a5a5f88b9f1f3c7909, user_id=4df3a673ee6e4a5dbf431386032c2281, role_id=c532e20495e749c28c0e9211e8264453)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:24.810730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f989f-d6f7-42b3-b118-dc918ee1042a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:24.917632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 144/294] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:15:24 2022] PUT /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/users/4df3a673ee6e4a5dbf431386032c2281/roles/c532e20495e749c28c0e9211e8264453 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:25.097889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da0c0-905e-4089-9b8c-fb69c410a57c None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:25.098387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da0c0-905e-4089-9b8c-fb69c410a57c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:25.098387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2da0c0-905e-4089-9b8c-fb69c410a57c None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:25.099995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 151/295] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:25.105423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ed85f-a9d2-4b14-bd30-ba1f8f42f591 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:25.105752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ed85f-a9d2-4b14-bd30-ba1f8f42f591 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:25.106038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ed85f-a9d2-4b14-bd30-ba1f8f42f591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:25.126012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-060ed85f-a9d2-4b14-bd30-ba1f8f42f591 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:25.127236 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-060ed85f-a9d2-4b14-bd30-ba1f8f42f591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:25.201603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 145/296] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:25.476074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2da0c0-905e-4089-9b8c-fb69c410a57c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:25.593596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2da0c0-905e-4089-9b8c-fb69c410a57c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:25.596001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:25.632564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3acec4-a1e7-4479-8912-4acb773b1b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:25.633207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3acec4-a1e7-4479-8912-4acb773b1b30 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:25.633491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3acec4-a1e7-4479-8912-4acb773b1b30 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:25.633797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3acec4-a1e7-4479-8912-4acb773b1b30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:25.645626 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3acec4-a1e7-4479-8912-4acb773b1b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-7f3acec4-a1e7-4479-8912-4acb773b1b30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:25.650735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:25.651624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:25.652464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 152/297] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:25.658455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ed85f-a9d2-4b14-bd30-ba1f8f42f591 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:25.767202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ed85f-a9d2-4b14-bd30-ba1f8f42f591 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:25.790271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:25.804220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1267719-c3a0-4ee5-8d08-72fb789e737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:25.805005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1267719-c3a0-4ee5-8d08-72fb789e737e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:25.805388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1267719-c3a0-4ee5-8d08-72fb789e737e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:25.805791 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1267719-c3a0-4ee5-8d08-72fb789e737e None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:25.806566 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1267719-c3a0-4ee5-8d08-72fb789e737e None admin] RBAC: Adding query filter params (name=member) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:25.806971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1267719-c3a0-4ee5-8d08-72fb789e737e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:25.808444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1267719-c3a0-4ee5-8d08-72fb789e737e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:25.818060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 146/298] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:25.823606 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3acec4-a1e7-4479-8912-4acb773b1b30 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:25.930884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50e3f-0948-4905-85d9-fc471cdbf461 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:25.931214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50e3f-0948-4905-85d9-fc471cdbf461 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:25.933018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50e3f-0948-4905-85d9-fc471cdbf461 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:25.933018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 147/299] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:25.940194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33ca0b-f2a3-443c-9668-cad5e2b6779d None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:25.940485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33ca0b-f2a3-443c-9668-cad5e2b6779d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:25.940764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33ca0b-f2a3-443c-9668-cad5e2b6779d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:25.964393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-3c33ca0b-f2a3-443c-9668-cad5e2b6779d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:25.965639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3c33ca0b-f2a3-443c-9668-cad5e2b6779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:26.038817 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3acec4-a1e7-4479-8912-4acb773b1b30 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:26.089689 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 148/300] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:26.090578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754f46b-17c9-4127-b034-1be60fe905bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:26.091261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754f46b-17c9-4127-b034-1be60fe905bd None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:26.091546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754f46b-17c9-4127-b034-1be60fe905bd None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:26.091823 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754f46b-17c9-4127-b034-1be60fe905bd None admin] PATH_INFO: `/v3/users/e6992d004cc346aeb85dcc9032f5ba28` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:26.093018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754f46b-17c9-4127-b034-1be60fe905bd None admin] RBAC: Authorizing `identity:get_user(user_id=e6992d004cc346aeb85dcc9032f5ba28)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:26.101148 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c754f46b-17c9-4127-b034-1be60fe905bd None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:26.101148 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 153/301] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:25 2022] GET /identity/v3/users/e6992d004cc346aeb85dcc9032f5ba28 => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:26.102867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33ca0b-f2a3-443c-9668-cad5e2b6779d None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:26.125760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483453de-71dd-4f6b-9280-1fc51ee92965 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:26.126088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483453de-71dd-4f6b-9280-1fc51ee92965 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:26.126325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483453de-71dd-4f6b-9280-1fc51ee92965 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:26.128149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 154/302] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:15:26.134378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4fb14-657b-4d7f-99c4-95e9a2e07cb7 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:26.134655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4fb14-657b-4d7f-99c4-95e9a2e07cb7 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:26.134979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4fb14-657b-4d7f-99c4-95e9a2e07cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:26.172858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-25e4fb14-657b-4d7f-99c4-95e9a2e07cb7 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:26.174097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-25e4fb14-657b-4d7f-99c4-95e9a2e07cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:26.218826 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:26.266621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33ca0b-f2a3-443c-9668-cad5e2b6779d None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:26.280500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:26.313698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 155/303] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:26.318400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824610-c75d-43cc-b6d2-a345858936f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:26.319528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824610-c75d-43cc-b6d2-a345858936f1 None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:26.319971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824610-c75d-43cc-b6d2-a345858936f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:26.320368 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824610-c75d-43cc-b6d2-a345858936f1 None admin] PATH_INFO: `/v3/system/users/e6992d004cc346aeb85dcc9032f5ba28/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:26.322198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd824610-c75d-43cc-b6d2-a345858936f1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e6992d004cc346aeb85dcc9032f5ba28, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:26.327252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd824610-c75d-43cc-b6d2-a345858936f1 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:26.380076 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4fb14-657b-4d7f-99c4-95e9a2e07cb7 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:26.426814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 149/304] 10.222.0.74 () {58 vars in 1334 bytes} [Wed Aug 31 00:15:26 2022] PUT /identity/v3/system/users/e6992d004cc346aeb85dcc9032f5ba28/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:26.517688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4fb14-657b-4d7f-99c4-95e9a2e07cb7 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:26.558441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89a652-8b1b-4ff5-8f7b-2a5fa0b1954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:26.559213 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89a652-8b1b-4ff5-8f7b-2a5fa0b1954e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:26.559498 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89a652-8b1b-4ff5-8f7b-2a5fa0b1954e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:26.560345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89a652-8b1b-4ff5-8f7b-2a5fa0b1954e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:26.572789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89a652-8b1b-4ff5-8f7b-2a5fa0b1954e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-8d89a652-8b1b-4ff5-8f7b-2a5fa0b1954e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:26.578353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:26.579261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:26.580769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 156/305] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:26.585720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824610-c75d-43cc-b6d2-a345858936f1 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:26.632209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89a652-8b1b-4ff5-8f7b-2a5fa0b1954e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:26.664218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:26.717369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824610-c75d-43cc-b6d2-a345858936f1 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:26.762003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66cbaf-86f4-45b7-8212-4d9a53da3ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:26.763755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66cbaf-86f4-45b7-8212-4d9a53da3ac0 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:26.764224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66cbaf-86f4-45b7-8212-4d9a53da3ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:26.764680 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66cbaf-86f4-45b7-8212-4d9a53da3ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:26.766164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66cbaf-86f4-45b7-8212-4d9a53da3ac0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:26.766649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66cbaf-86f4-45b7-8212-4d9a53da3ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:26.768448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66cbaf-86f4-45b7-8212-4d9a53da3ac0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:26.769129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89a652-8b1b-4ff5-8f7b-2a5fa0b1954e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:26.780598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 150/306] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:26.786062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66cbaf-86f4-45b7-8212-4d9a53da3ac0 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:26.818049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322da46c-92e9-4eeb-b0f4-9bbad41ed139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:26.819140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322da46c-92e9-4eeb-b0f4-9bbad41ed139 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:26.819663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322da46c-92e9-4eeb-b0f4-9bbad41ed139 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:26.820254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322da46c-92e9-4eeb-b0f4-9bbad41ed139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:26.821791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322da46c-92e9-4eeb-b0f4-9bbad41ed139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:26.828471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322da46c-92e9-4eeb-b0f4-9bbad41ed139 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:26.828647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:26.828729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 157/307] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:26.833869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322da46c-92e9-4eeb-b0f4-9bbad41ed139 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:26.996483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66cbaf-86f4-45b7-8212-4d9a53da3ac0 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:27.029144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:27.034884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef7866-4a3d-4a17-9c81-d0eb1f1fbaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:27.040230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef7866-4a3d-4a17-9c81-d0eb1f1fbaf2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:27.040230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef7866-4a3d-4a17-9c81-d0eb1f1fbaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:27.040230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef7866-4a3d-4a17-9c81-d0eb1f1fbaf2 None admin] PATH_INFO: `/v3/users/2203d5b824274bacbf21ae1e548cf6f2` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:27.040464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322da46c-92e9-4eeb-b0f4-9bbad41ed139 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:27.050342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef7866-4a3d-4a17-9c81-d0eb1f1fbaf2 None admin] RBAC: Authorizing `identity:get_user(user_id=2203d5b824274bacbf21ae1e548cf6f2)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:27.051821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef7866-4a3d-4a17-9c81-d0eb1f1fbaf2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:27.053497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 151/308] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:26 2022] GET /identity/v3/users/2203d5b824274bacbf21ae1e548cf6f2 => generated 293 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:27.054761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850faff-6969-45d0-82c3-18971db604c4 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:27.055052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850faff-6969-45d0-82c3-18971db604c4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:27.055327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850faff-6969-45d0-82c3-18971db604c4 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:27.056685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 152/309] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:27.062062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850faff-6969-45d0-82c3-18971db604c4 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:27.083937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8c262-679a-4c49-b28a-f6175bc0bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:27.084483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8c262-679a-4c49-b28a-f6175bc0bde5 None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:27.084821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8c262-679a-4c49-b28a-f6175bc0bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:27.085104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8c262-679a-4c49-b28a-f6175bc0bde5 None admin] PATH_INFO: `/v3/groups` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:27.085768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8c262-679a-4c49-b28a-f6175bc0bde5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:27.087216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a8c262-679a-4c49-b28a-f6175bc0bde5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:27.163746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:27.170381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 158/310] 10.222.0.74 () {60 vars in 1134 bytes} [Wed Aug 31 00:15:26 2022] POST /identity/v3/groups => generated 229 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:15:27.171818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1b7e4-5c78-43e1-b312-4db787ba468c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:27.172158 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1b7e4-5c78-43e1-b312-4db787ba468c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:27.172449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1b7e4-5c78-43e1-b312-4db787ba468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:27.182114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850faff-6969-45d0-82c3-18971db604c4 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:27.196245 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-91a1b7e4-5c78-43e1-b312-4db787ba468c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:27.197592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-91a1b7e4-5c78-43e1-b312-4db787ba468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:27.227370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b8fb-74e2-4ca3-989a-cb4223623d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:27.228490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b8fb-74e2-4ca3-989a-cb4223623d5b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:27.228986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b8fb-74e2-4ca3-989a-cb4223623d5b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:27.229471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149b8fb-74e2-4ca3-989a-cb4223623d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:27.230620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b8fb-74e2-4ca3-989a-cb4223623d5b None admin] RBAC: Adding query filter params (role.id=c532e20495e749c28c0e9211e8264453, user.id=2203d5b824274bacbf21ae1e548cf6f2, scope.system=all) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:27.231131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b8fb-74e2-4ca3-989a-cb4223623d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:27.232993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149b8fb-74e2-4ca3-989a-cb4223623d5b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:27.239647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 153/311] 10.222.0.74 () {56 vars in 1308 bytes} [Wed Aug 31 00:15:27 2022] GET /identity/v3/role_assignments?user.id=2203d5b824274bacbf21ae1e548cf6f2&scope.system=all&role.id=c532e20495e749c28c0e9211e8264453 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:27.294632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 159/312] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:27.578828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b8fb-74e2-4ca3-989a-cb4223623d5b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:27.702251 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149b8fb-74e2-4ca3-989a-cb4223623d5b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:27.737550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2871b4-8312-4fdc-9a48-6466adaa5af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:27.738980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2871b4-8312-4fdc-9a48-6466adaa5af9 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:27.739450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2871b4-8312-4fdc-9a48-6466adaa5af9 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:27.739935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2871b4-8312-4fdc-9a48-6466adaa5af9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:27.751240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2871b4-8312-4fdc-9a48-6466adaa5af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-7e2871b4-8312-4fdc-9a48-6466adaa5af9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:27.756560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:27.757460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:27.758286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:27.760760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 154/313] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:27.767816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1b7e4-5c78-43e1-b312-4db787ba468c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:27.854293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:27.875205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1b7e4-5c78-43e1-b312-4db787ba468c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:27.926738 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0da9d8-2333-45de-a366-e242f7ccc19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:27.927359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da9d8-2333-45de-a366-e242f7ccc19f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:27.927641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da9d8-2333-45de-a366-e242f7ccc19f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:27.927918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da9d8-2333-45de-a366-e242f7ccc19f None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:27.928590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0da9d8-2333-45de-a366-e242f7ccc19f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:27.928895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0da9d8-2333-45de-a366-e242f7ccc19f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:27.930299 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0da9d8-2333-45de-a366-e242f7ccc19f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:27.939493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 160/314] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:27.944831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2871b4-8312-4fdc-9a48-6466adaa5af9 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:27.964799 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:28.050399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2871b4-8312-4fdc-9a48-6466adaa5af9 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:28.085359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da7441-0821-45f7-880e-b3a78e0af632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:28.086017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da7441-0821-45f7-880e-b3a78e0af632 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:28.086403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da7441-0821-45f7-880e-b3a78e0af632 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:28.086675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da7441-0821-45f7-880e-b3a78e0af632 None admin] PATH_INFO: `/v3/users/4df3a673ee6e4a5dbf431386032c2281` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:28.087811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da7441-0821-45f7-880e-b3a78e0af632 None admin] RBAC: Authorizing `identity:get_user(user_id=4df3a673ee6e4a5dbf431386032c2281)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:28.089255 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da7441-0821-45f7-880e-b3a78e0af632 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:28.091845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 155/315] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:27 2022] GET /identity/v3/users/4df3a673ee6e4a5dbf431386032c2281 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:28.097493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0da9d8-2333-45de-a366-e242f7ccc19f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:28.206657 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0da9d8-2333-45de-a366-e242f7ccc19f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:28.242600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791c666-ae6e-495d-8729-b6e719077aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:28.243218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791c666-ae6e-495d-8729-b6e719077aa3 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:28.243502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791c666-ae6e-495d-8729-b6e719077aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:28.243777 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791c666-ae6e-495d-8729-b6e719077aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:28.257947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:28.328472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791c666-ae6e-495d-8729-b6e719077aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:28.330188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791c666-ae6e-495d-8729-b6e719077aa3 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:28.439838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 161/316] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:15:28.445698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da7441-0821-45f7-880e-b3a78e0af632 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:28.448490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570a06-00e2-4cc4-8294-bc92ea2b6df3 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:28.448868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570a06-00e2-4cc4-8294-bc92ea2b6df3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:28.449151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570a06-00e2-4cc4-8294-bc92ea2b6df3 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:28.451458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 162/317] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:15:28.456416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd73e1-6c82-4846-8dd8-4bd750397c28 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:28.456782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd73e1-6c82-4846-8dd8-4bd750397c28 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:28.456994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd73e1-6c82-4846-8dd8-4bd750397c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:28.479146 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-6bcd73e1-6c82-4846-8dd8-4bd750397c28 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:28.480626 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6bcd73e1-6c82-4846-8dd8-4bd750397c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:28.533942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:28.541788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:28.553003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 163/318] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:28.561406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da7441-0821-45f7-880e-b3a78e0af632 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:28.597008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf01769-3c71-4003-8f76-e22ef87e7021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:28.599748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf01769-3c71-4003-8f76-e22ef87e7021 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:28.599748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf01769-3c71-4003-8f76-e22ef87e7021 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:28.599748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf01769-3c71-4003-8f76-e22ef87e7021 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:28.599748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf01769-3c71-4003-8f76-e22ef87e7021 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:28.600875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf01769-3c71-4003-8f76-e22ef87e7021 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:28.602834 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 156/319] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:28 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:28.609384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd73e1-6c82-4846-8dd8-4bd750397c28 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:28.725394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd73e1-6c82-4846-8dd8-4bd750397c28 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:28.765811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877e982-ca00-4293-bdcd-a985c76d2101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:28.766430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877e982-ca00-4293-bdcd-a985c76d2101 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:28.766766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877e982-ca00-4293-bdcd-a985c76d2101 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:28.767038 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877e982-ca00-4293-bdcd-a985c76d2101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:28.767895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877e982-ca00-4293-bdcd-a985c76d2101 None admin] RBAC: Adding query filter params (role.id=c532e20495e749c28c0e9211e8264453, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909, user.id=4df3a673ee6e4a5dbf431386032c2281) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:28.768266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877e982-ca00-4293-bdcd-a985c76d2101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:28.770336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877e982-ca00-4293-bdcd-a985c76d2101 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:28.777420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 164/320] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:28 2022] GET /identity/v3/role_assignments?user.id=4df3a673ee6e4a5dbf431386032c2281&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=c532e20495e749c28c0e9211e8264453 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:28.846407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf01769-3c71-4003-8f76-e22ef87e7021 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:28.991151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf01769-3c71-4003-8f76-e22ef87e7021 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:29.032965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6f936-9f7c-492d-b980-1476fb3b14a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:29.034019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f936-9f7c-492d-b980-1476fb3b14a4 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:29.034476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f936-9f7c-492d-b980-1476fb3b14a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:29.035006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6f936-9f7c-492d-b980-1476fb3b14a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:29.053431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6f936-9f7c-492d-b980-1476fb3b14a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-22b6f936-9f7c-492d-b980-1476fb3b14a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:29.063183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:29.064207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:29.065022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:29.065651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 157/321] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:29.073775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877e982-ca00-4293-bdcd-a985c76d2101 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:29.125046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:29.197525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877e982-ca00-4293-bdcd-a985c76d2101 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:29.235174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230083f-e451-4097-b388-a2cdbb1db3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:29.235840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230083f-e451-4097-b388-a2cdbb1db3cb None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:29.236070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230083f-e451-4097-b388-a2cdbb1db3cb None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:29.236395 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230083f-e451-4097-b388-a2cdbb1db3cb None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:29.237069 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230083f-e451-4097-b388-a2cdbb1db3cb None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:29.237377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230083f-e451-4097-b388-a2cdbb1db3cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:29.238790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230083f-e451-4097-b388-a2cdbb1db3cb None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:29.255770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 165/322] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:29.257041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6f936-9f7c-492d-b980-1476fb3b14a4 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:29.276188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7eef6-e8d1-4495-bb68-b768a0679c0b None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:29.276497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7eef6-e8d1-4495-bb68-b768a0679c0b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:29.276765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7eef6-e8d1-4495-bb68-b768a0679c0b None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:29.277953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:29.278965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 166/323] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:15:29.286516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a742280-5848-41c6-9af9-1c45733f63d7 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:29.286868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a742280-5848-41c6-9af9-1c45733f63d7 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:29.290846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a742280-5848-41c6-9af9-1c45733f63d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:29.307426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-5a742280-5848-41c6-9af9-1c45733f63d7 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:29.308721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5a742280-5848-41c6-9af9-1c45733f63d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:29.386596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6f936-9f7c-492d-b980-1476fb3b14a4 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:29.391604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 167/324] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:29.393154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b958ff-6215-41f2-b41e-edf7892ed151 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:29.393425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b958ff-6215-41f2-b41e-edf7892ed151 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:29.393963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b958ff-6215-41f2-b41e-edf7892ed151 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:29.395269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 168/325] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:29.403702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791e52-3d8d-4cfd-86b6-b7bb009699e2 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:29.403998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791e52-3d8d-4cfd-86b6-b7bb009699e2 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:29.404285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791e52-3d8d-4cfd-86b6-b7bb009699e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:29.424560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-4a791e52-3d8d-4cfd-86b6-b7bb009699e2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:29.425802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4a791e52-3d8d-4cfd-86b6-b7bb009699e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:29.428088 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195d11-f1bd-48df-a021-464829ce1b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:29.429025 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195d11-f1bd-48df-a021-464829ce1b23 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:29.429431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195d11-f1bd-48df-a021-464829ce1b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:29.429770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195d11-f1bd-48df-a021-464829ce1b23 None admin] PATH_INFO: `/v3/users/e6992d004cc346aeb85dcc9032f5ba28` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:29.431271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d195d11-f1bd-48df-a021-464829ce1b23 None admin] RBAC: Authorizing `identity:get_user(user_id=e6992d004cc346aeb85dcc9032f5ba28)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:29.433546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d195d11-f1bd-48df-a021-464829ce1b23 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:29.436143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 158/326] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:29 2022] GET /identity/v3/users/e6992d004cc346aeb85dcc9032f5ba28 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:29.442150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195d11-f1bd-48df-a021-464829ce1b23 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:29.453272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:29.505629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 169/327] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:29.546080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:29.567342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195d11-f1bd-48df-a021-464829ce1b23 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:29.606557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7147-797b-410e-aa74-bead21995f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:29.607161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7147-797b-410e-aa74-bead21995f3f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:29.607441 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7147-797b-410e-aa74-bead21995f3f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:29.607710 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7147-797b-410e-aa74-bead21995f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:29.608438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa7147-797b-410e-aa74-bead21995f3f None admin] RBAC: Adding query filter params (role.id=bec3ab91aff841e286162327678e1cc6, user.id=e6992d004cc346aeb85dcc9032f5ba28, scope.system=all) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:29.608745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa7147-797b-410e-aa74-bead21995f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:29.610229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa7147-797b-410e-aa74-bead21995f3f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:29.622797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 159/328] 10.222.0.74 () {56 vars in 1308 bytes} [Wed Aug 31 00:15:29 2022] GET /identity/v3/role_assignments?user.id=e6992d004cc346aeb85dcc9032f5ba28&scope.system=all&role.id=bec3ab91aff841e286162327678e1cc6 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:29.672538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a791e52-3d8d-4cfd-86b6-b7bb009699e2 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:29.790286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7147-797b-410e-aa74-bead21995f3f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:29.792553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a791e52-3d8d-4cfd-86b6-b7bb009699e2 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:29.837251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83867b06-e2cb-4fc7-bf21-6f46c1d72874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:29.838013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867b06-e2cb-4fc7-bf21-6f46c1d72874 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:29.838317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867b06-e2cb-4fc7-bf21-6f46c1d72874 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:29.838728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867b06-e2cb-4fc7-bf21-6f46c1d72874 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:29.839923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83867b06-e2cb-4fc7-bf21-6f46c1d72874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:29.842128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83867b06-e2cb-4fc7-bf21-6f46c1d72874 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:29.844199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 170/329] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:29.850882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83867b06-e2cb-4fc7-bf21-6f46c1d72874 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:29.878930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:29.915173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7147-797b-410e-aa74-bead21995f3f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:29.951172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab57c7-b2c5-4362-9a6e-c003da0709ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:29.951813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab57c7-b2c5-4362-9a6e-c003da0709ea None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:29.952091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab57c7-b2c5-4362-9a6e-c003da0709ea None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:29.952362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab57c7-b2c5-4362-9a6e-c003da0709ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:29.958932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83867b06-e2cb-4fc7-bf21-6f46c1d72874 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:29.960303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:29.964034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab57c7-b2c5-4362-9a6e-c003da0709ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-17ab57c7-b2c5-4362-9a6e-c003da0709ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:29.969714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:29.976619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 160/330] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:29.977610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab57c7-b2c5-4362-9a6e-c003da0709ea None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:29.999267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b40e8-1238-4f2a-9916-5539095dc4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:29.999891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b40e8-1238-4f2a-9916-5539095dc4dc None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:30.000166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b40e8-1238-4f2a-9916-5539095dc4dc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:30.000438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b40e8-1238-4f2a-9916-5539095dc4dc None admin] PATH_INFO: `/v3/groups` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:30.001079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b40e8-1238-4f2a-9916-5539095dc4dc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:30.002546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b40e8-1238-4f2a-9916-5539095dc4dc None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:30.080513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab57c7-b2c5-4362-9a6e-c003da0709ea None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:30.102730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 171/331] 10.222.0.74 () {60 vars in 1134 bytes} [Wed Aug 31 00:15:29 2022] POST /identity/v3/groups => generated 226 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:15:30.123883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bf74b-157f-47f4-8c0a-b9405a00c39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:30.124535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bf74b-157f-47f4-8c0a-b9405a00c39e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:30.124819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bf74b-157f-47f4-8c0a-b9405a00c39e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:30.125097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bf74b-157f-47f4-8c0a-b9405a00c39e None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:30.125842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bf74b-157f-47f4-8c0a-b9405a00c39e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:30.126154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bf74b-157f-47f4-8c0a-b9405a00c39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:30.127597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bf74b-157f-47f4-8c0a-b9405a00c39e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:30.137352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 161/332] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:30.144192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b40e8-1238-4f2a-9916-5539095dc4dc None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:30.253232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:30.271405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b40e8-1238-4f2a-9916-5539095dc4dc None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:30.312173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f3a19-fdd7-483c-9e67-873e38b62684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:30.313196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f3a19-fdd7-483c-9e67-873e38b62684 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:30.313958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f3a19-fdd7-483c-9e67-873e38b62684 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:30.314243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f3a19-fdd7-483c-9e67-873e38b62684 None admin] PATH_INFO: `/v3/users/2203d5b824274bacbf21ae1e548cf6f2` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:30.315473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f3a19-fdd7-483c-9e67-873e38b62684 None admin] RBAC: Authorizing `identity:get_user(user_id=2203d5b824274bacbf21ae1e548cf6f2)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:30.317477 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f3a19-fdd7-483c-9e67-873e38b62684 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:30.319258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 172/333] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:30 2022] GET /identity/v3/users/2203d5b824274bacbf21ae1e548cf6f2 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:30.325412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bf74b-157f-47f4-8c0a-b9405a00c39e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:30.399889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:30.450210 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bf74b-157f-47f4-8c0a-b9405a00c39e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:30.487527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7d6b5-e0b3-43b6-8d56-db311874d18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:30.488199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d6b5-e0b3-43b6-8d56-db311874d18f None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:30.488481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d6b5-e0b3-43b6-8d56-db311874d18f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:30.488760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7d6b5-e0b3-43b6-8d56-db311874d18f None admin] PATH_INFO: `/v3/system/users/2203d5b824274bacbf21ae1e548cf6f2/roles/c532e20495e749c28c0e9211e8264453` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:30.490321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7d6b5-e0b3-43b6-8d56-db311874d18f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2203d5b824274bacbf21ae1e548cf6f2, role_id=c532e20495e749c28c0e9211e8264453)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:30.491736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7d6b5-e0b3-43b6-8d56-db311874d18f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:30.583265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 162/334] 10.222.0.74 () {58 vars in 1334 bytes} [Wed Aug 31 00:15:30 2022] PUT /identity/v3/system/users/2203d5b824274bacbf21ae1e548cf6f2/roles/c532e20495e749c28c0e9211e8264453 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:32.399669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd58e4-8c88-4200-b1cd-f7869decc4bc None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:32.400219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd58e4-8c88-4200-b1cd-f7869decc4bc None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:32.400219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd58e4-8c88-4200-b1cd-f7869decc4bc None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:32.401786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 173/335] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:32.419417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3702-7e4a-4df4-b9f7-0e5377329a9e None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:32.420326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3702-7e4a-4df4-b9f7-0e5377329a9e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:32.420326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a3702-7e4a-4df4-b9f7-0e5377329a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:32.451315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-825a3702-7e4a-4df4-b9f7-0e5377329a9e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:32.452537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-825a3702-7e4a-4df4-b9f7-0e5377329a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:32.536161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 163/336] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:32.738274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a8db6-b11d-4029-ace6-df9f34db13cc None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:32.738614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a8db6-b11d-4029-ace6-df9f34db13cc None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:32.738731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a8db6-b11d-4029-ace6-df9f34db13cc None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:32.740060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 174/337] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:32.745599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893ba2b-65f1-479f-8025-2049080c6347 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:32.745892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893ba2b-65f1-479f-8025-2049080c6347 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:32.746171 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893ba2b-65f1-479f-8025-2049080c6347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:32.768255 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a893ba2b-65f1-479f-8025-2049080c6347 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:32.769438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a893ba2b-65f1-479f-8025-2049080c6347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:32.831480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:32.849834 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 164/338] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:33.009383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a8db6-b11d-4029-ace6-df9f34db13cc None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:33.145567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53024a-0cb3-4abd-a911-302f2ae33dc3 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:33.145931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53024a-0cb3-4abd-a911-302f2ae33dc3 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:33.146147 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53024a-0cb3-4abd-a911-302f2ae33dc3 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:33.147515 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 165/339] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:33.154082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eebd43-21a8-4853-a5e8-e874decaffc6 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:33.154588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eebd43-21a8-4853-a5e8-e874decaffc6 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:33.155089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eebd43-21a8-4853-a5e8-e874decaffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:33.191412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-08eebd43-21a8-4853-a5e8-e874decaffc6 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:33.192632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-08eebd43-21a8-4853-a5e8-e874decaffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:33.307889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a8db6-b11d-4029-ace6-df9f34db13cc None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:33.339725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 166/340] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:33.341283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eebd43-21a8-4853-a5e8-e874decaffc6 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:33.360861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe24ecb-deac-4a1b-96e7-da2040dbbed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:33.361509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe24ecb-deac-4a1b-96e7-da2040dbbed9 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:33.361818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe24ecb-deac-4a1b-96e7-da2040dbbed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:33.362087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe24ecb-deac-4a1b-96e7-da2040dbbed9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:33.382043 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe24ecb-deac-4a1b-96e7-da2040dbbed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-4fe24ecb-deac-4a1b-96e7-da2040dbbed9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:33.387130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:33.388060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 175/341] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:33.393788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a24c-148e-4ab9-b3fc-5fb5f7ddf60c None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:33.394515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a24c-148e-4ab9-b3fc-5fb5f7ddf60c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:33.394515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315a24c-148e-4ab9-b3fc-5fb5f7ddf60c None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:33.397678 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 176/342] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:33.398655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315a24c-148e-4ab9-b3fc-5fb5f7ddf60c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:33.429303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:33.476120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eebd43-21a8-4853-a5e8-e874decaffc6 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:33.500529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:33.524846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ee2e7-ab41-4fcd-a25f-964382543e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:33.525898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ee2e7-ab41-4fcd-a25f-964382543e91 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:33.526828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ee2e7-ab41-4fcd-a25f-964382543e91 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:33.527450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ee2e7-ab41-4fcd-a25f-964382543e91 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:33.540453 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ee2e7-ab41-4fcd-a25f-964382543e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-2f7ee2e7-ab41-4fcd-a25f-964382543e91 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:33.548056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:33.548972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 00:15:33.552436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:33.554838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 167/343] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:33.556806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b488a-0eef-428a-ac47-ba16abd01178 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:33.557286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b488a-0eef-428a-ac47-ba16abd01178 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:33.557797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b488a-0eef-428a-ac47-ba16abd01178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:33.578957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8c5b488a-0eef-428a-ac47-ba16abd01178 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:33.580511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8c5b488a-0eef-428a-ac47-ba16abd01178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:33.616126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315a24c-148e-4ab9-b3fc-5fb5f7ddf60c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:33.692772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147b478-4014-4c71-b0b7-e08be4f50545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:33.694416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147b478-4014-4c71-b0b7-e08be4f50545 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:33.695448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 168/344] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:33.695934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147b478-4014-4c71-b0b7-e08be4f50545 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:33.696487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147b478-4014-4c71-b0b7-e08be4f50545 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:33.697364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147b478-4014-4c71-b0b7-e08be4f50545 None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:33.698419 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b488a-0eef-428a-ac47-ba16abd01178 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:33.698973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147b478-4014-4c71-b0b7-e08be4f50545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:33.702922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147b478-4014-4c71-b0b7-e08be4f50545 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:33.719685 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 177/345] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:33.727450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147b478-4014-4c71-b0b7-e08be4f50545 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:33.817771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:33.843740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147b478-4014-4c71-b0b7-e08be4f50545 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:33.852769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b488a-0eef-428a-ac47-ba16abd01178 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:33.867095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:33.889632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7d323-8dc8-4fd3-93c6-e9cbf13d254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:33.889632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7d323-8dc8-4fd3-93c6-e9cbf13d254f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:33.889632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7d323-8dc8-4fd3-93c6-e9cbf13d254f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:33.889632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7d323-8dc8-4fd3-93c6-e9cbf13d254f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:33.909797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cbbc1-0683-4aff-8124-947c74a1b383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:33.910546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cbbc1-0683-4aff-8124-947c74a1b383 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:33.910832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cbbc1-0683-4aff-8124-947c74a1b383 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:33.911105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cbbc1-0683-4aff-8124-947c74a1b383 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:33.911776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cbbc1-0683-4aff-8124-947c74a1b383 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:33.912084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cbbc1-0683-4aff-8124-947c74a1b383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:33.914265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cbbc1-0683-4aff-8124-947c74a1b383 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:33.927480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 169/346] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:33.928562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cbbc1-0683-4aff-8124-947c74a1b383 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:34.026481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7d323-8dc8-4fd3-93c6-e9cbf13d254f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:34.028964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7d323-8dc8-4fd3-93c6-e9cbf13d254f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:34.064276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cbbc1-0683-4aff-8124-947c74a1b383 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:34.111424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734b4fd-8269-48e8-a311-cb56a7491a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:34.112303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734b4fd-8269-48e8-a311-cb56a7491a1c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:34.112724 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734b4fd-8269-48e8-a311-cb56a7491a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:34.113131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734b4fd-8269-48e8-a311-cb56a7491a1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:34.128649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734b4fd-8269-48e8-a311-cb56a7491a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-f734b4fd-8269-48e8-a311-cb56a7491a1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:34.135926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:34.137056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:34.138685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:34.141531 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 170/347] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:34.142535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734b4fd-8269-48e8-a311-cb56a7491a1c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:34.148901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:34.178451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 178/348] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:15:34.179826 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7d323-8dc8-4fd3-93c6-e9cbf13d254f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:34.181791 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:34.277465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734b4fd-8269-48e8-a311-cb56a7491a1c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:34.319515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7d323-8dc8-4fd3-93c6-e9cbf13d254f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:34.324722 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b5584-e3e6-416d-b38a-9afd8d19253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:34.325712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b5584-e3e6-416d-b38a-9afd8d19253b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:34.326191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b5584-e3e6-416d-b38a-9afd8d19253b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:34.326653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b5584-e3e6-416d-b38a-9afd8d19253b None admin] PATH_INFO: `/v3/users/2203d5b824274bacbf21ae1e548cf6f2` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:34.328022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b5584-e3e6-416d-b38a-9afd8d19253b None admin] RBAC: Authorizing `identity:get_user(user_id=2203d5b824274bacbf21ae1e548cf6f2)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:34.329748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b5584-e3e6-416d-b38a-9afd8d19253b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:34.331615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 171/349] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:15:34 2022] GET /identity/v3/users/2203d5b824274bacbf21ae1e548cf6f2 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:34.332571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b5584-e3e6-416d-b38a-9afd8d19253b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:34.363670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cd8e4-bcd2-4e7d-9fee-49696bf38980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:34.364628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd8e4-bcd2-4e7d-9fee-49696bf38980 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:34.365077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd8e4-bcd2-4e7d-9fee-49696bf38980 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:34.365527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd8e4-bcd2-4e7d-9fee-49696bf38980 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:34.378786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cd8e4-bcd2-4e7d-9fee-49696bf38980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-d09cd8e4-bcd2-4e7d-9fee-49696bf38980 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:34.383761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:34.384706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:34.385513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 179/350] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:34.387031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cd8e4-bcd2-4e7d-9fee-49696bf38980 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:34.436758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:34.466428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:34.473357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b5584-e3e6-416d-b38a-9afd8d19253b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:34.514627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cd8e4-bcd2-4e7d-9fee-49696bf38980 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:34.523818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05af642-f34c-4f8b-9090-ccfe53e384a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:34.525408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05af642-f34c-4f8b-9090-ccfe53e384a0 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:34.525750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05af642-f34c-4f8b-9090-ccfe53e384a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:34.526307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05af642-f34c-4f8b-9090-ccfe53e384a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:34.526991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05af642-f34c-4f8b-9090-ccfe53e384a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:34.527299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05af642-f34c-4f8b-9090-ccfe53e384a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:34.529895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05af642-f34c-4f8b-9090-ccfe53e384a0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:34.541387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 172/351] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:34.542803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a65a4f-b533-4b08-adab-5c6f13657014 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:34.543097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a65a4f-b533-4b08-adab-5c6f13657014 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:34.543363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a65a4f-b533-4b08-adab-5c6f13657014 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:34.545203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 173/352] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:34.546379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a65a4f-b533-4b08-adab-5c6f13657014 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:34.562642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b2477-8171-41ed-a655-f72585e9c1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:34.563351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2477-8171-41ed-a655-f72585e9c1c5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:34.563634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2477-8171-41ed-a655-f72585e9c1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:34.563910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2477-8171-41ed-a655-f72585e9c1c5 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:34.565091 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b2477-8171-41ed-a655-f72585e9c1c5 None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:34.566598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b2477-8171-41ed-a655-f72585e9c1c5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:34.568392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 180/353] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:34 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:34.569670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b2477-8171-41ed-a655-f72585e9c1c5 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:34.682280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a65a4f-b533-4b08-adab-5c6f13657014 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:34.725752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b2477-8171-41ed-a655-f72585e9c1c5 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:34.731214 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:34.732287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cdff0-ad15-4b52-ba20-d922cf2c13cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:34.733261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cdff0-ad15-4b52-ba20-d922cf2c13cd None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:34.733569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cdff0-ad15-4b52-ba20-d922cf2c13cd None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:34.733870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cdff0-ad15-4b52-ba20-d922cf2c13cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:34.734611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cdff0-ad15-4b52-ba20-d922cf2c13cd None admin] RBAC: Adding query filter params (role.id=c532e20495e749c28c0e9211e8264453, user.id=2203d5b824274bacbf21ae1e548cf6f2, scope.system=all) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:34.734923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cdff0-ad15-4b52-ba20-d922cf2c13cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:34.736370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cdff0-ad15-4b52-ba20-d922cf2c13cd None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:34.750142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 174/354] 10.222.0.74 () {56 vars in 1308 bytes} [Wed Aug 31 00:15:34 2022] GET /identity/v3/role_assignments?user.id=2203d5b824274bacbf21ae1e548cf6f2&scope.system=all&role.id=c532e20495e749c28c0e9211e8264453 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:34.751045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cdff0-ad15-4b52-ba20-d922cf2c13cd None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:34.784109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac29aed-2a71-45f4-87d9-9d2eb18e83e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:34.785707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29aed-2a71-45f4-87d9-9d2eb18e83e1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:34.786294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29aed-2a71-45f4-87d9-9d2eb18e83e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:34.786779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29aed-2a71-45f4-87d9-9d2eb18e83e1 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:34.787932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac29aed-2a71-45f4-87d9-9d2eb18e83e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:34.788692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:34.789059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac29aed-2a71-45f4-87d9-9d2eb18e83e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:34.791188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac29aed-2a71-45f4-87d9-9d2eb18e83e1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:34.804780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 181/355] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:34.806995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc9c37-0aa5-4819-be52-e7b8c7040e63 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:34.807864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc9c37-0aa5-4819-be52-e7b8c7040e63 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:34.808609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc9c37-0aa5-4819-be52-e7b8c7040e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:34.834375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b9dc9c37-0aa5-4819-be52-e7b8c7040e63 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:34.836751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b9dc9c37-0aa5-4819-be52-e7b8c7040e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:34.898332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cdff0-ad15-4b52-ba20-d922cf2c13cd None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:34.932840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 182/356] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:34.934015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc9c37-0aa5-4819-be52-e7b8c7040e63 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:34.947731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d8da1-021e-4cee-bebc-7606d8e70e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:34.948761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8da1-021e-4cee-bebc-7606d8e70e03 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:34.949285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8da1-021e-4cee-bebc-7606d8e70e03 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:34.949771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8da1-021e-4cee-bebc-7606d8e70e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:35.040947 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d8da1-021e-4cee-bebc-7606d8e70e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:35.042804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d8da1-021e-4cee-bebc-7606d8e70e03 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:35.065542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:35.070167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:35.079048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc9c37-0aa5-4819-be52-e7b8c7040e63 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:35.124403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082608d3-5f3f-4e22-ba3d-0cdca69a0d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:35.125277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082608d3-5f3f-4e22-ba3d-0cdca69a0d2f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:35.125548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082608d3-5f3f-4e22-ba3d-0cdca69a0d2f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:35.125859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082608d3-5f3f-4e22-ba3d-0cdca69a0d2f None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:35.133595 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082608d3-5f3f-4e22-ba3d-0cdca69a0d2f None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:35.135498 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082608d3-5f3f-4e22-ba3d-0cdca69a0d2f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:35.138361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 183/357] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:34 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:35.139341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082608d3-5f3f-4e22-ba3d-0cdca69a0d2f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:35.176058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 175/358] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:35.177341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b13b8-2cd6-49aa-8466-f8e6b3250760 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:35.179479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b13b8-2cd6-49aa-8466-f8e6b3250760 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:35.179775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b13b8-2cd6-49aa-8466-f8e6b3250760 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:35.181307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 176/359] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:35.181883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b13b8-2cd6-49aa-8466-f8e6b3250760 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:35.296676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082608d3-5f3f-4e22-ba3d-0cdca69a0d2f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:35.324412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b13b8-2cd6-49aa-8466-f8e6b3250760 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:35.344894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8107d31-2a71-4e16-a23a-c4cf9c813b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:35.345424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107d31-2a71-4e16-a23a-c4cf9c813b59 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:35.345742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107d31-2a71-4e16-a23a-c4cf9c813b59 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:35.346025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8107d31-2a71-4e16-a23a-c4cf9c813b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:35.347615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:35.371235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896d7d5-efcf-48c7-862f-c1d27f8f4830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:35.372652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896d7d5-efcf-48c7-862f-c1d27f8f4830 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:35.373535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896d7d5-efcf-48c7-862f-c1d27f8f4830 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:35.373809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896d7d5-efcf-48c7-862f-c1d27f8f4830 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:35.375121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896d7d5-efcf-48c7-862f-c1d27f8f4830 None admin] RBAC: Adding query filter params (group.id=2b9eea8dc234410b92158c54a99fc0b3, role.id=bec3ab91aff841e286162327678e1cc6, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:35.375121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896d7d5-efcf-48c7-862f-c1d27f8f4830 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:35.376586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896d7d5-efcf-48c7-862f-c1d27f8f4830 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:35.380216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:35.382607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 177/360] 10.222.0.74 () {56 vars in 1376 bytes} [Wed Aug 31 00:15:35 2022] GET /identity/v3/role_assignments?group.id=2b9eea8dc234410b92158c54a99fc0b3&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=bec3ab91aff841e286162327678e1cc6 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:35.383333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896d7d5-efcf-48c7-862f-c1d27f8f4830 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:35.450152 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8107d31-2a71-4e16-a23a-c4cf9c813b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:35.451878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8107d31-2a71-4e16-a23a-c4cf9c813b59 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:35.534163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896d7d5-efcf-48c7-862f-c1d27f8f4830 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:35.581487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab96149-5809-4e7c-a808-8a15fac52d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:35.581487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab96149-5809-4e7c-a808-8a15fac52d3d None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:35.581487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab96149-5809-4e7c-a808-8a15fac52d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:35.581979 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab96149-5809-4e7c-a808-8a15fac52d3d None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:35.583034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab96149-5809-4e7c-a808-8a15fac52d3d None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:35.584524 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab96149-5809-4e7c-a808-8a15fac52d3d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:35.586374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 178/361] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:35 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:35.587344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79b9c-284a-4fda-8f43-34383389a3df None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:35.588210 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79b9c-284a-4fda-8f43-34383389a3df None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:35.588487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79b9c-284a-4fda-8f43-34383389a3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:35.613908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-5bf79b9c-284a-4fda-8f43-34383389a3df None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:35.616257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 184/362] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:35.616611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5bf79b9c-284a-4fda-8f43-34383389a3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:35.617108 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8107d31-2a71-4e16-a23a-c4cf9c813b59 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:35.692396 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:35.720792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:35.730924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 179/363] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:35.732371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf79b9c-284a-4fda-8f43-34383389a3df None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:35.770677 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8107d31-2a71-4e16-a23a-c4cf9c813b59 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:35.807673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672b870-9060-4105-94e5-0e371dd2e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:35.808618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672b870-9060-4105-94e5-0e371dd2e1ac None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:35.809712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672b870-9060-4105-94e5-0e371dd2e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:35.810354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672b870-9060-4105-94e5-0e371dd2e1ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:35.821747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672b870-9060-4105-94e5-0e371dd2e1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-8672b870-9060-4105-94e5-0e371dd2e1ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:35.828270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:35.829229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:35.830089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:35.832363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 185/364] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:35.833397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672b870-9060-4105-94e5-0e371dd2e1ac None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:35.858632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf79b9c-284a-4fda-8f43-34383389a3df None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:35.908986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb420d52-9efa-41dc-a1df-61c93826985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:35.909675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb420d52-9efa-41dc-a1df-61c93826985e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:35.910540 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb420d52-9efa-41dc-a1df-61c93826985e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:35.910826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb420d52-9efa-41dc-a1df-61c93826985e None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:35.912099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb420d52-9efa-41dc-a1df-61c93826985e None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:35.913742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb420d52-9efa-41dc-a1df-61c93826985e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:35.916770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 180/365] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:35 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:35.917557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb420d52-9efa-41dc-a1df-61c93826985e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:35.969191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672b870-9060-4105-94e5-0e371dd2e1ac None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:35.991219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:36.004684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:36.027201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbdda8-46ed-465a-819f-a578a644eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:36.028051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbdda8-46ed-465a-819f-a578a644eca7 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:36.028406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbdda8-46ed-465a-819f-a578a644eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:36.028698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbdda8-46ed-465a-819f-a578a644eca7 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:36.030683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbdda8-46ed-465a-819f-a578a644eca7 None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:36.033012 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbdda8-46ed-465a-819f-a578a644eca7 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:36.035592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 186/366] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:35 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:36.036731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbdda8-46ed-465a-819f-a578a644eca7 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:36.068064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb420d52-9efa-41dc-a1df-61c93826985e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:36.118467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3274-c057-4931-bfc2-08678d2af64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:36.119032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3274-c057-4931-bfc2-08678d2af64b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:36.119286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3274-c057-4931-bfc2-08678d2af64b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:36.119555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3274-c057-4931-bfc2-08678d2af64b None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:36.120262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c3274-c057-4931-bfc2-08678d2af64b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:36.120572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c3274-c057-4931-bfc2-08678d2af64b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:36.122095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c3274-c057-4931-bfc2-08678d2af64b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:36.134403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 181/367] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:36.134604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3274-c057-4931-bfc2-08678d2af64b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:36.179019 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbdda8-46ed-465a-819f-a578a644eca7 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:36.229272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c544b84-d992-4292-84ef-8ab8f6c0d5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:36.229672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c544b84-d992-4292-84ef-8ab8f6c0d5e4 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:36.229902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c544b84-d992-4292-84ef-8ab8f6c0d5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:36.230174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c544b84-d992-4292-84ef-8ab8f6c0d5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:36.231455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c544b84-d992-4292-84ef-8ab8f6c0d5e4 None admin] RBAC: Adding query filter params (group.id=2b9eea8dc234410b92158c54a99fc0b3, role.id=bec3ab91aff841e286162327678e1cc6, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:36.231772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c544b84-d992-4292-84ef-8ab8f6c0d5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:36.233336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c544b84-d992-4292-84ef-8ab8f6c0d5e4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:36.241090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 187/368] 10.222.0.74 () {56 vars in 1376 bytes} [Wed Aug 31 00:15:36 2022] GET /identity/v3/role_assignments?group.id=2b9eea8dc234410b92158c54a99fc0b3&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=bec3ab91aff841e286162327678e1cc6 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:36.242129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c544b84-d992-4292-84ef-8ab8f6c0d5e4 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:36.267687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3274-c057-4931-bfc2-08678d2af64b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:36.287623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:36.325204 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:36.325878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeca57e-08d1-4027-8fca-6874c7ee04be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:36.326814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeca57e-08d1-4027-8fca-6874c7ee04be None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:36.327306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeca57e-08d1-4027-8fca-6874c7ee04be None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:36.328374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeca57e-08d1-4027-8fca-6874c7ee04be None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:36.330096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeca57e-08d1-4027-8fca-6874c7ee04be None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:36.331849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeca57e-08d1-4027-8fca-6874c7ee04be None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:36.333854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 182/369] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:36 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:36.335121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeca57e-08d1-4027-8fca-6874c7ee04be None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:36.390120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c544b84-d992-4292-84ef-8ab8f6c0d5e4 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:36.434801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b783-8048-488c-8542-582569b93b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:36.435514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b783-8048-488c-8542-582569b93b0b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:36.435795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b783-8048-488c-8542-582569b93b0b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:36.436116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b783-8048-488c-8542-582569b93b0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:36.462822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b783-8048-488c-8542-582569b93b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-71e1b783-8048-488c-8542-582569b93b0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:36.469496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:36.470534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 188/370] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:15:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:36.471460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b783-8048-488c-8542-582569b93b0b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:36.484958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeca57e-08d1-4027-8fca-6874c7ee04be None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:36.529415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298945a7-09f5-4dec-9ceb-69f60b8661fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:36.530073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298945a7-09f5-4dec-9ceb-69f60b8661fa None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:36.530351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298945a7-09f5-4dec-9ceb-69f60b8661fa None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:36.530623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298945a7-09f5-4dec-9ceb-69f60b8661fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:36.591025 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:36.618577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b783-8048-488c-8542-582569b93b0b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:36.628241 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298945a7-09f5-4dec-9ceb-69f60b8661fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:36.630942 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298945a7-09f5-4dec-9ceb-69f60b8661fa None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:36.636344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:36.661491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7819d-084f-46e7-b462-eba3dc221619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:36.665494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7819d-084f-46e7-b462-eba3dc221619 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:36.666015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7819d-084f-46e7-b462-eba3dc221619 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:36.666472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7819d-084f-46e7-b462-eba3dc221619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:36.667593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7819d-084f-46e7-b462-eba3dc221619 None admin] RBAC: Adding query filter params (group.id=2b9eea8dc234410b92158c54a99fc0b3, role.id=20d736bdf9df414f9e9b2ae27c77c071, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:36.668172 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7819d-084f-46e7-b462-eba3dc221619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:36.671705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7819d-084f-46e7-b462-eba3dc221619 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:36.680436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 189/371] 10.222.0.74 () {56 vars in 1376 bytes} [Wed Aug 31 00:15:36 2022] GET /identity/v3/role_assignments?group.id=2b9eea8dc234410b92158c54a99fc0b3&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=20d736bdf9df414f9e9b2ae27c77c071 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:36.681610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7819d-084f-46e7-b462-eba3dc221619 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:36.775812 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 183/372] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:36.777559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298945a7-09f5-4dec-9ceb-69f60b8661fa None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:36.828617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7819d-084f-46e7-b462-eba3dc221619 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:36.874469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29c46e-be14-4a87-b077-294b96dea43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:36.875091 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c46e-be14-4a87-b077-294b96dea43b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:36.875378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c46e-be14-4a87-b077-294b96dea43b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:36.875708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c46e-be14-4a87-b077-294b96dea43b None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:36.876492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29c46e-be14-4a87-b077-294b96dea43b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:36.876844 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29c46e-be14-4a87-b077-294b96dea43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:36.880879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29c46e-be14-4a87-b077-294b96dea43b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:36.887688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:36.896678 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 190/373] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:36.902470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29c46e-be14-4a87-b077-294b96dea43b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:36.912684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298945a7-09f5-4dec-9ceb-69f60b8661fa None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:36.951140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:36.956754 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200d6ae-ba32-4b6b-a081-f18419212ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:36.966521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200d6ae-ba32-4b6b-a081-f18419212ccf None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:36.966521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200d6ae-ba32-4b6b-a081-f18419212ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:36.966521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200d6ae-ba32-4b6b-a081-f18419212ccf None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:36.966521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200d6ae-ba32-4b6b-a081-f18419212ccf None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:36.966521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200d6ae-ba32-4b6b-a081-f18419212ccf None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:36.966521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 184/374] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:36 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:36.969989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200d6ae-ba32-4b6b-a081-f18419212ccf None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:37.029315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29c46e-be14-4a87-b077-294b96dea43b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:37.067604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7c4ba-6e91-4b92-a2ad-d79ca8d130de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:37.068217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c4ba-6e91-4b92-a2ad-d79ca8d130de None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:37.068681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c4ba-6e91-4b92-a2ad-d79ca8d130de None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:37.068957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7c4ba-6e91-4b92-a2ad-d79ca8d130de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.078549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200d6ae-ba32-4b6b-a081-f18419212ccf None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:37.116318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da40515-f013-4e45-bce0-1845cc411175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:37.116950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da40515-f013-4e45-bce0-1845cc411175 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:37.117225 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da40515-f013-4e45-bce0-1845cc411175 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:37.117495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da40515-f013-4e45-bce0-1845cc411175 None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.118651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da40515-f013-4e45-bce0-1845cc411175 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:37.120083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da40515-f013-4e45-bce0-1845cc411175 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:37.127205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 185/375] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:36 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:37.128533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da40515-f013-4e45-bce0-1845cc411175 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:37.144220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:37.158049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7c4ba-6e91-4b92-a2ad-d79ca8d130de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:37.159998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7c4ba-6e91-4b92-a2ad-d79ca8d130de None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:37.205980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:37.236983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da40515-f013-4e45-bce0-1845cc411175 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:37.273365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e8901-d4c7-4bd4-8791-31b9a01b5944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:37.274051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e8901-d4c7-4bd4-8791-31b9a01b5944 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:37.274290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e8901-d4c7-4bd4-8791-31b9a01b5944 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:37.274560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e8901-d4c7-4bd4-8791-31b9a01b5944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.275290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e8901-d4c7-4bd4-8791-31b9a01b5944 None admin] RBAC: Adding query filter params (group.id=2b9eea8dc234410b92158c54a99fc0b3, role.id=20d736bdf9df414f9e9b2ae27c77c071, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:37.275599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e8901-d4c7-4bd4-8791-31b9a01b5944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:37.276510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 191/376] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:15:37.278817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e8901-d4c7-4bd4-8791-31b9a01b5944 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:37.283282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7c4ba-6e91-4b92-a2ad-d79ca8d130de None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:37.288655 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 186/377] 10.222.0.74 () {56 vars in 1376 bytes} [Wed Aug 31 00:15:37 2022] GET /identity/v3/role_assignments?group.id=2b9eea8dc234410b92158c54a99fc0b3&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=20d736bdf9df414f9e9b2ae27c77c071 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:37.398387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7c4ba-6e91-4b92-a2ad-d79ca8d130de None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:37.441530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b27b5-2f06-40c2-84ae-f63b8f98e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:37.442209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b27b5-2f06-40c2-84ae-f63b8f98e9d9 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:37.442549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b27b5-2f06-40c2-84ae-f63b8f98e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:37.442825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b27b5-2f06-40c2-84ae-f63b8f98e9d9 None admin] PATH_INFO: `/v3/projects/cd01cbdba4ce42c9aba3127e81a7cb7f` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.444005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b27b5-2f06-40c2-84ae-f63b8f98e9d9 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01cbdba4ce42c9aba3127e81a7cb7f)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:37.445490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b27b5-2f06-40c2-84ae-f63b8f98e9d9 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:37.447424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 192/378] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:37 2022] GET /identity/v3/projects/cd01cbdba4ce42c9aba3127e81a7cb7f => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:37.453948 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e8901-d4c7-4bd4-8791-31b9a01b5944 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:37.553452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:37.580053 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e8901-d4c7-4bd4-8791-31b9a01b5944 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:37.618078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140af5d3-a757-4298-9887-4b8160ba9415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:37.618707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af5d3-a757-4298-9887-4b8160ba9415 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:37.618984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af5d3-a757-4298-9887-4b8160ba9415 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:37.619253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140af5d3-a757-4298-9887-4b8160ba9415 None admin] PATH_INFO: `/v3/groups/3413e9261c8d4cfe8fb45a99121c5a2e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.626041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140af5d3-a757-4298-9887-4b8160ba9415 None admin] RBAC: Authorizing `identity:get_group(group_id=3413e9261c8d4cfe8fb45a99121c5a2e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:37.627529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140af5d3-a757-4298-9887-4b8160ba9415 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:37.629551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 187/379] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:37 2022] GET /identity/v3/groups/3413e9261c8d4cfe8fb45a99121c5a2e => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:37.635194 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b27b5-2f06-40c2-84ae-f63b8f98e9d9 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:37.646111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:37.754098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b27b5-2f06-40c2-84ae-f63b8f98e9d9 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:37.796381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af015bf4-0cdc-47ab-8956-806a40342f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:37.797004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af015bf4-0cdc-47ab-8956-806a40342f8f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:37.797280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af015bf4-0cdc-47ab-8956-806a40342f8f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:37.797551 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af015bf4-0cdc-47ab-8956-806a40342f8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.798296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af015bf4-0cdc-47ab-8956-806a40342f8f None admin] RBAC: Adding query filter params (group.id=3413e9261c8d4cfe8fb45a99121c5a2e, role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=cd01cbdba4ce42c9aba3127e81a7cb7f) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:37.798601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af015bf4-0cdc-47ab-8956-806a40342f8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:37.800028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af015bf4-0cdc-47ab-8956-806a40342f8f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:37.810900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 193/380] 10.222.0.74 () {56 vars in 1376 bytes} [Wed Aug 31 00:15:37 2022] GET /identity/v3/role_assignments?group.id=3413e9261c8d4cfe8fb45a99121c5a2e&scope.project.id=cd01cbdba4ce42c9aba3127e81a7cb7f&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:37.836729 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f73c9-1c34-4559-851d-c6f79ff2b9c0 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:37.837060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f73c9-1c34-4559-851d-c6f79ff2b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:37.837293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f73c9-1c34-4559-851d-c6f79ff2b9c0 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.839060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 188/381] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:37.845785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307cbbc-f614-4016-9c47-83069c6abefa None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:37.846099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307cbbc-f614-4016-9c47-83069c6abefa None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:37.846346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307cbbc-f614-4016-9c47-83069c6abefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:37.866017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-1307cbbc-f614-4016-9c47-83069c6abefa None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:37.867280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1307cbbc-f614-4016-9c47-83069c6abefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:37.942799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:37.954013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 194/382] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:38.238922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f73c9-1c34-4559-851d-c6f79ff2b9c0 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:38.354537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f73c9-1c34-4559-851d-c6f79ff2b9c0 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:38.390185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b46ec-2a8f-4288-b2d8-48ced4a2ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:38.390815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b46ec-2a8f-4288-b2d8-48ced4a2ea72 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:38.391092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b46ec-2a8f-4288-b2d8-48ced4a2ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:38.391361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b46ec-2a8f-4288-b2d8-48ced4a2ea72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:38.401693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:38.405763 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b46ec-2a8f-4288-b2d8-48ced4a2ea72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-859b46ec-2a8f-4288-b2d8-48ced4a2ea72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:38.411013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:38.421080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:38.421932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 189/383] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:38.422621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307cbbc-f614-4016-9c47-83069c6abefa None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:38.537217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307cbbc-f614-4016-9c47-83069c6abefa None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:38.584997 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6700ca8-ff3b-4fc2-9d4b-f73c9182abbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:38.585659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6700ca8-ff3b-4fc2-9d4b-f73c9182abbf None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:38.585904 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6700ca8-ff3b-4fc2-9d4b-f73c9182abbf None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:38.586175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6700ca8-ff3b-4fc2-9d4b-f73c9182abbf None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:38.586833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6700ca8-ff3b-4fc2-9d4b-f73c9182abbf None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:38.587130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6700ca8-ff3b-4fc2-9d4b-f73c9182abbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:38.588593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6700ca8-ff3b-4fc2-9d4b-f73c9182abbf None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:38.601246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 195/384] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:38.607306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b46ec-2a8f-4288-b2d8-48ced4a2ea72 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:38.716880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b46ec-2a8f-4288-b2d8-48ced4a2ea72 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:38.752493 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a2b75-ecb0-415e-8257-b7b26b6cb928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:38.753132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a2b75-ecb0-415e-8257-b7b26b6cb928 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:38.753410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a2b75-ecb0-415e-8257-b7b26b6cb928 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:38.753712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a2b75-ecb0-415e-8257-b7b26b6cb928 None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:38.754871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a2b75-ecb0-415e-8257-b7b26b6cb928 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:38.756442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a2b75-ecb0-415e-8257-b7b26b6cb928 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:38.758400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 190/385] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:38 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:38.770940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6700ca8-ff3b-4fc2-9d4b-f73c9182abbf None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:38.841819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d45f4-b6a0-49eb-917b-4f3fbb7f66c7 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:38.842120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d45f4-b6a0-49eb-917b-4f3fbb7f66c7 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:38.842297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d45f4-b6a0-49eb-917b-4f3fbb7f66c7 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:38.843630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 191/386] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:38.848514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f597f9-b761-4d02-be57-2b18075b7a60 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:38.849036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f597f9-b761-4d02-be57-2b18075b7a60 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:38.849513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f597f9-b761-4d02-be57-2b18075b7a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:38.857914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:38.888972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-28f597f9-b761-4d02-be57-2b18075b7a60 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:38.890346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-28f597f9-b761-4d02-be57-2b18075b7a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:38.911835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6700ca8-ff3b-4fc2-9d4b-f73c9182abbf None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:38.984850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2c654-64fc-467d-9d1b-5204573d9faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:38.985530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2c654-64fc-467d-9d1b-5204573d9faf None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:38.985837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2c654-64fc-467d-9d1b-5204573d9faf None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:38.986110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2c654-64fc-467d-9d1b-5204573d9faf None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:38.988208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2c654-64fc-467d-9d1b-5204573d9faf None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:38.989688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2c654-64fc-467d-9d1b-5204573d9faf None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:38.995966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 196/387] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:38 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:38.997337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2c654-64fc-467d-9d1b-5204573d9faf None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:38.998304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:39.002793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 192/388] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:39.137921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2c654-64fc-467d-9d1b-5204573d9faf None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:39.166482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:39.177077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581efaa-e50f-4719-9d59-88ece9ae9f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:39.177771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581efaa-e50f-4719-9d59-88ece9ae9f74 None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:39.178048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581efaa-e50f-4719-9d59-88ece9ae9f74 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:39.178318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581efaa-e50f-4719-9d59-88ece9ae9f74 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/groups/2b9eea8dc234410b92158c54a99fc0b3/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:39.181429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581efaa-e50f-4719-9d59-88ece9ae9f74 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b8f41a4823488faa3818650e1d3d0b, group_id=2b9eea8dc234410b92158c54a99fc0b3, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:39.182898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581efaa-e50f-4719-9d59-88ece9ae9f74 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:39.283570 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 197/389] 10.222.0.74 () {58 vars in 1442 bytes} [Wed Aug 31 00:15:38 2022] PUT /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/groups/2b9eea8dc234410b92158c54a99fc0b3/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:39.303084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f597f9-b761-4d02-be57-2b18075b7a60 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:39.424935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f597f9-b761-4d02-be57-2b18075b7a60 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:39.462820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcbe81-db1d-4ed9-8ece-5768ebabd638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:39.463526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbe81-db1d-4ed9-8ece-5768ebabd638 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:39.463806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbe81-db1d-4ed9-8ece-5768ebabd638 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:39.464077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbe81-db1d-4ed9-8ece-5768ebabd638 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:39.475089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcbe81-db1d-4ed9-8ece-5768ebabd638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-64bcbe81-db1d-4ed9-8ece-5768ebabd638 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:39.479985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:39.480950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:39.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 193/390] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:39.487303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581efaa-e50f-4719-9d59-88ece9ae9f74 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:39.601790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581efaa-e50f-4719-9d59-88ece9ae9f74 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:39.651260 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055bae9-a254-49c0-b69f-79a433a6a79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:39.651880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055bae9-a254-49c0-b69f-79a433a6a79e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:39.652159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055bae9-a254-49c0-b69f-79a433a6a79e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:39.652429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055bae9-a254-49c0-b69f-79a433a6a79e None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:39.653403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055bae9-a254-49c0-b69f-79a433a6a79e None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:39.653737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055bae9-a254-49c0-b69f-79a433a6a79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:39.655255 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055bae9-a254-49c0-b69f-79a433a6a79e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:39.666908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049e3b-fdc2-448a-bc13-2c16fee21e74 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:39.667201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049e3b-fdc2-448a-bc13-2c16fee21e74 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:39.667460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049e3b-fdc2-448a-bc13-2c16fee21e74 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:39.670352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 194/391] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:15:39.675045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 198/392] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:39.675329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804e17f-1714-4883-b8b2-b56269d5be55 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:39.675625 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804e17f-1714-4883-b8b2-b56269d5be55 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:39.675976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804e17f-1714-4883-b8b2-b56269d5be55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:39.680460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055bae9-a254-49c0-b69f-79a433a6a79e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:39.710594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-6804e17f-1714-4883-b8b2-b56269d5be55 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:39.711819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6804e17f-1714-4883-b8b2-b56269d5be55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:39.739286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:39.791658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055bae9-a254-49c0-b69f-79a433a6a79e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:39.819405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:39.830519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28dd19-58d6-41ac-a649-62c35da77258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:39.831162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28dd19-58d6-41ac-a649-62c35da77258 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:39.831447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28dd19-58d6-41ac-a649-62c35da77258 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:39.831728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28dd19-58d6-41ac-a649-62c35da77258 None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:39.832945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28dd19-58d6-41ac-a649-62c35da77258 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:39.834538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28dd19-58d6-41ac-a649-62c35da77258 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:39.835036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 195/393] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:39.836409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 199/394] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:39 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:39.843150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a8c7-9f78-493d-a473-3c08487627d2 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:39.845709 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a8c7-9f78-493d-a473-3c08487627d2 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:39.845709 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a8c7-9f78-493d-a473-3c08487627d2 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:39.845709 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 196/395] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:39.846347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28dd19-58d6-41ac-a649-62c35da77258 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:39.850983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac4da5-7ec8-4478-8bd5-7fcb1429c6f6 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:39.851305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac4da5-7ec8-4478-8bd5-7fcb1429c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:39.851540 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac4da5-7ec8-4478-8bd5-7fcb1429c6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:39.899790 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-7cac4da5-7ec8-4478-8bd5-7fcb1429c6f6 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:39.906003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7cac4da5-7ec8-4478-8bd5-7fcb1429c6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:40.007815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28dd19-58d6-41ac-a649-62c35da77258 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:40.052955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:40.062900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 197/396] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:40.083623 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34732c3d-ef3b-4910-83ef-e65e518d7ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:40.084283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34732c3d-ef3b-4910-83ef-e65e518d7ed5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:40.084560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34732c3d-ef3b-4910-83ef-e65e518d7ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:40.084830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34732c3d-ef3b-4910-83ef-e65e518d7ed5 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:40.086001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34732c3d-ef3b-4910-83ef-e65e518d7ed5 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:40.087569 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34732c3d-ef3b-4910-83ef-e65e518d7ed5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:40.089383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 200/397] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:39 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:40.095722 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac4da5-7ec8-4478-8bd5-7fcb1429c6f6 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:40.145870 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34732c3d-ef3b-4910-83ef-e65e518d7ed5 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:40.267116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac4da5-7ec8-4478-8bd5-7fcb1429c6f6 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:40.287535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:40.301368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34732c3d-ef3b-4910-83ef-e65e518d7ed5 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:40.315720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6cf03-1362-45f7-8e55-344bf31de83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:40.316743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cf03-1362-45f7-8e55-344bf31de83b None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:40.317225 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cf03-1362-45f7-8e55-344bf31de83b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:40.317719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cf03-1362-45f7-8e55-344bf31de83b None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/groups/2b9eea8dc234410b92158c54a99fc0b3/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:40.322904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6cf03-1362-45f7-8e55-344bf31de83b None admin] RBAC: Authorizing `identity:create_grant(project_id=2d6a4068250844a5a5f88b9f1f3c7909, group_id=2b9eea8dc234410b92158c54a99fc0b3, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:40.324647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6cf03-1362-45f7-8e55-344bf31de83b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:40.338100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6194f-8133-413b-8a83-0ce1ca1ac077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:40.340791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6194f-8133-413b-8a83-0ce1ca1ac077 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:40.340791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6194f-8133-413b-8a83-0ce1ca1ac077 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:40.340791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6194f-8133-413b-8a83-0ce1ca1ac077 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:40.352279 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6194f-8133-413b-8a83-0ce1ca1ac077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-3de6194f-8133-413b-8a83-0ce1ca1ac077 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:40.360275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:40.361222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:40.363360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 201/398] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:40.367111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6194f-8133-413b-8a83-0ce1ca1ac077 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:40.400830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 198/399] 10.222.0.74 () {58 vars in 1442 bytes} [Wed Aug 31 00:15:40 2022] PUT /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/groups/2b9eea8dc234410b92158c54a99fc0b3/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:40.443618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:40.522624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6194f-8133-413b-8a83-0ce1ca1ac077 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:40.527467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6cf03-1362-45f7-8e55-344bf31de83b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:40.573769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfcade-1725-4ae0-bdfc-80ba1e832483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:40.575363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfcade-1725-4ae0-bdfc-80ba1e832483 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:40.575875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfcade-1725-4ae0-bdfc-80ba1e832483 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:40.576348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfcade-1725-4ae0-bdfc-80ba1e832483 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:40.577215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfcade-1725-4ae0-bdfc-80ba1e832483 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:40.577723 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfcade-1725-4ae0-bdfc-80ba1e832483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:40.579939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfcade-1725-4ae0-bdfc-80ba1e832483 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:40.593082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 202/400] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:40.599066 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfcade-1725-4ae0-bdfc-80ba1e832483 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:40.701661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6cf03-1362-45f7-8e55-344bf31de83b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:40.733105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfcade-1725-4ae0-bdfc-80ba1e832483 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:40.745502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:40.756713 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8923eaf-bae9-41dc-836b-740029937a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:40.758434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8923eaf-bae9-41dc-836b-740029937a96 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:40.759089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8923eaf-bae9-41dc-836b-740029937a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:40.760217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8923eaf-bae9-41dc-836b-740029937a96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:40.778230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7106b-2104-4e15-bb69-63f1fc2e37d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:40.779259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7106b-2104-4e15-bb69-63f1fc2e37d4 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:40.779526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7106b-2104-4e15-bb69-63f1fc2e37d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:40.779864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7106b-2104-4e15-bb69-63f1fc2e37d4 None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:40.780617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8923eaf-bae9-41dc-836b-740029937a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:40.781299 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7106b-2104-4e15-bb69-63f1fc2e37d4 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:40.782844 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7106b-2104-4e15-bb69-63f1fc2e37d4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:40.785070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 203/401] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:40 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:40.786512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16a69f-2506-4e46-9315-e69108e63bd1 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:40.786865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16a69f-2506-4e46-9315-e69108e63bd1 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:40.787144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16a69f-2506-4e46-9315-e69108e63bd1 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:40.788684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 204/402] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-c8923eaf-bae9-41dc-836b-740029937a96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:40.789247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:40.790220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:40.791026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:40.791635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 199/403] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:40.797266 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8923eaf-bae9-41dc-836b-740029937a96 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:40.797429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da446-5864-42da-97d7-1fc956b4cf8c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:40.797429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da446-5864-42da-97d7-1fc956b4cf8c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:40.797429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5da446-5864-42da-97d7-1fc956b4cf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:40.822458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-ab5da446-5864-42da-97d7-1fc956b4cf8c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:40.824265 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ab5da446-5864-42da-97d7-1fc956b4cf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:40.859862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:40.926464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 205/404] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:40.927501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5da446-5864-42da-97d7-1fc956b4cf8c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:40.945381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8923eaf-bae9-41dc-836b-740029937a96 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:41.003096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e17fa-5cb1-4285-a12d-64d4fdf3b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:41.003990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e17fa-5cb1-4285-a12d-64d4fdf3b044 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:41.004654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e17fa-5cb1-4285-a12d-64d4fdf3b044 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:41.005077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e17fa-5cb1-4285-a12d-64d4fdf3b044 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:41.008856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e17fa-5cb1-4285-a12d-64d4fdf3b044 None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:41.014325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e17fa-5cb1-4285-a12d-64d4fdf3b044 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:41.019696 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 200/405] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:40 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:41.023653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e17fa-5cb1-4285-a12d-64d4fdf3b044 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:41.099017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5da446-5864-42da-97d7-1fc956b4cf8c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:41.122712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:41.163009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd045b-394f-46d3-8ab1-2b4ed8f38655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:41.163925 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd045b-394f-46d3-8ab1-2b4ed8f38655 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:41.164349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd045b-394f-46d3-8ab1-2b4ed8f38655 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:41.164830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd045b-394f-46d3-8ab1-2b4ed8f38655 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:41.165722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd045b-394f-46d3-8ab1-2b4ed8f38655 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:41.166173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd045b-394f-46d3-8ab1-2b4ed8f38655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:41.167708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd045b-394f-46d3-8ab1-2b4ed8f38655 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:41.179032 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 206/406] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:41.186068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd045b-394f-46d3-8ab1-2b4ed8f38655 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:41.255764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e17fa-5cb1-4285-a12d-64d4fdf3b044 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:41.272961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:41.322333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f95f-de0c-48f2-91ee-090e6fab7226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:41.323012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f95f-de0c-48f2-91ee-090e6fab7226 None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:41.323298 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f95f-de0c-48f2-91ee-090e6fab7226 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:41.323608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f95f-de0c-48f2-91ee-090e6fab7226 None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/groups/2b9eea8dc234410b92158c54a99fc0b3/roles/20d736bdf9df414f9e9b2ae27c77c071` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:41.328269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941f95f-de0c-48f2-91ee-090e6fab7226 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d6a4068250844a5a5f88b9f1f3c7909, group_id=2b9eea8dc234410b92158c54a99fc0b3, role_id=20d736bdf9df414f9e9b2ae27c77c071)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:41.329783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941f95f-de0c-48f2-91ee-090e6fab7226 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:41.362887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd045b-394f-46d3-8ab1-2b4ed8f38655 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:41.400816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efd9c1-e19d-43ae-aba0-8441126b158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:41.401879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efd9c1-e19d-43ae-aba0-8441126b158b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:41.402333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efd9c1-e19d-43ae-aba0-8441126b158b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:41.403407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efd9c1-e19d-43ae-aba0-8441126b158b None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:41.404762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efd9c1-e19d-43ae-aba0-8441126b158b None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:41.406391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efd9c1-e19d-43ae-aba0-8441126b158b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:41.412816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 207/407] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:41 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:41.412816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efd9c1-e19d-43ae-aba0-8441126b158b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:41.436305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 201/408] 10.222.0.74 () {58 vars in 1442 bytes} [Wed Aug 31 00:15:41 2022] PUT /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909/groups/2b9eea8dc234410b92158c54a99fc0b3/roles/20d736bdf9df414f9e9b2ae27c77c071 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:41.440079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f95f-de0c-48f2-91ee-090e6fab7226 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:41.491793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:41.601865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efd9c1-e19d-43ae-aba0-8441126b158b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:41.649857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf4234-0a3d-4982-ad61-3107d31b6d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:41.651574 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf4234-0a3d-4982-ad61-3107d31b6d7a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:41.652066 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf4234-0a3d-4982-ad61-3107d31b6d7a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:41.653103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf4234-0a3d-4982-ad61-3107d31b6d7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:41.669470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf4234-0a3d-4982-ad61-3107d31b6d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-fddf4234-0a3d-4982-ad61-3107d31b6d7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:41.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:41.678646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:41.680339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:41.683238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 208/409] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:41.689539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf4234-0a3d-4982-ad61-3107d31b6d7a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:41.698341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f95f-de0c-48f2-91ee-090e6fab7226 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:41.742968 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63458198-a03b-4df1-93e8-59338dc73b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:41.743737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458198-a03b-4df1-93e8-59338dc73b51 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:41.744026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458198-a03b-4df1-93e8-59338dc73b51 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:41.744314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63458198-a03b-4df1-93e8-59338dc73b51 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:41.745639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63458198-a03b-4df1-93e8-59338dc73b51 None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:41.747919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63458198-a03b-4df1-93e8-59338dc73b51 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:41.749819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 202/410] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:41 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:41.751118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5febe4-1637-465b-97e7-af50005dcd83 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:41.751364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5febe4-1637-465b-97e7-af50005dcd83 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:41.751639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5febe4-1637-465b-97e7-af50005dcd83 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:41.753109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 203/411] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:41.757981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5febe4-1637-465b-97e7-af50005dcd83 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:41.802229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:41.820996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:41.826398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf4234-0a3d-4982-ad61-3107d31b6d7a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:41.868782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2291a8-c3e0-41ee-942c-1ec569f844d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:41.869602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2291a8-c3e0-41ee-942c-1ec569f844d1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:41.869987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2291a8-c3e0-41ee-942c-1ec569f844d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:41.870363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2291a8-c3e0-41ee-942c-1ec569f844d1 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:41.871156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2291a8-c3e0-41ee-942c-1ec569f844d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:41.871629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2291a8-c3e0-41ee-942c-1ec569f844d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:41.873657 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2291a8-c3e0-41ee-942c-1ec569f844d1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:41.876926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5febe4-1637-465b-97e7-af50005dcd83 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:41.886608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 209/412] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:41.890820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e194487-0368-4661-8482-d1683dc3621a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:41.890820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e194487-0368-4661-8482-d1683dc3621a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:41.890820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e194487-0368-4661-8482-d1683dc3621a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:41.916349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e56e-21da-4b98-b4b3-199e5145100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:41.916993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e56e-21da-4b98-b4b3-199e5145100f None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:41.917280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e56e-21da-4b98-b4b3-199e5145100f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:41.917611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979e56e-21da-4b98-b4b3-199e5145100f None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/groups/2b9eea8dc234410b92158c54a99fc0b3/roles/20d736bdf9df414f9e9b2ae27c77c071` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:41.917952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-4e194487-0368-4661-8482-d1683dc3621a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:41.920549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4e194487-0368-4661-8482-d1683dc3621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:41.920757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979e56e-21da-4b98-b4b3-199e5145100f None admin] RBAC: Authorizing `identity:create_grant(project_id=e2b8f41a4823488faa3818650e1d3d0b, group_id=2b9eea8dc234410b92158c54a99fc0b3, role_id=20d736bdf9df414f9e9b2ae27c77c071)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:41.922307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979e56e-21da-4b98-b4b3-199e5145100f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:41.994759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 204/413] 10.222.0.74 () {58 vars in 1442 bytes} [Wed Aug 31 00:15:41 2022] PUT /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b/groups/2b9eea8dc234410b92158c54a99fc0b3/roles/20d736bdf9df414f9e9b2ae27c77c071 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:15:41.995684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e56e-21da-4b98-b4b3-199e5145100f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:42.005676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 210/414] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:42.170231 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979e56e-21da-4b98-b4b3-199e5145100f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:42.171933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:42.206229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d164f7-5d06-4bbf-96e0-df9a5eba48fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:42.206881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d164f7-5d06-4bbf-96e0-df9a5eba48fe None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:42.207163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d164f7-5d06-4bbf-96e0-df9a5eba48fe None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:42.207440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d164f7-5d06-4bbf-96e0-df9a5eba48fe None admin] PATH_INFO: `/v3/groups/3413e9261c8d4cfe8fb45a99121c5a2e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:42.208587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d164f7-5d06-4bbf-96e0-df9a5eba48fe None admin] RBAC: Authorizing `identity:get_group(group_id=3413e9261c8d4cfe8fb45a99121c5a2e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:42.210403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d164f7-5d06-4bbf-96e0-df9a5eba48fe None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:42.212318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 205/415] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:41 2022] GET /identity/v3/groups/3413e9261c8d4cfe8fb45a99121c5a2e => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:42.218058 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e194487-0368-4661-8482-d1683dc3621a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:42.333318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:42.349737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e194487-0368-4661-8482-d1683dc3621a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:42.393277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7faaca-19ad-4aeb-b428-d941529a172d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:42.393997 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7faaca-19ad-4aeb-b428-d941529a172d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:42.394275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7faaca-19ad-4aeb-b428-d941529a172d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:42.394548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7faaca-19ad-4aeb-b428-d941529a172d None admin] PATH_INFO: `/v3/projects/cd01cbdba4ce42c9aba3127e81a7cb7f` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:42.398576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7faaca-19ad-4aeb-b428-d941529a172d None admin] RBAC: Authorizing `identity:get_project(project_id=cd01cbdba4ce42c9aba3127e81a7cb7f)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:42.400153 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7faaca-19ad-4aeb-b428-d941529a172d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:42.401970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 211/416] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:42 2022] GET /identity/v3/projects/cd01cbdba4ce42c9aba3127e81a7cb7f => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:42.408414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d164f7-5d06-4bbf-96e0-df9a5eba48fe None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:42.409222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7faaca-19ad-4aeb-b428-d941529a172d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:42.597069 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7faaca-19ad-4aeb-b428-d941529a172d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:42.635385 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed230de-dd74-452c-b86d-044493664a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:42.636286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed230de-dd74-452c-b86d-044493664a0d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:42.636564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed230de-dd74-452c-b86d-044493664a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:42.636910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed230de-dd74-452c-b86d-044493664a0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:42.649348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed230de-dd74-452c-b86d-044493664a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-bed230de-dd74-452c-b86d-044493664a0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:42.656042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:42.656963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:42.657822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 212/417] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:42.659630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d164f7-5d06-4bbf-96e0-df9a5eba48fe None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:42.665449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed230de-dd74-452c-b86d-044493664a0d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:42.688871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:42.730142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958478c-ba8b-42a8-ab9b-46f947777fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:42.730941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958478c-ba8b-42a8-ab9b-46f947777fc2 None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:42.731128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958478c-ba8b-42a8-ab9b-46f947777fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:42.731402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958478c-ba8b-42a8-ab9b-46f947777fc2 None admin] PATH_INFO: `/v3/projects/cd01cbdba4ce42c9aba3127e81a7cb7f/groups/3413e9261c8d4cfe8fb45a99121c5a2e/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:42.733381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958478c-ba8b-42a8-ab9b-46f947777fc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd01cbdba4ce42c9aba3127e81a7cb7f, group_id=3413e9261c8d4cfe8fb45a99121c5a2e, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:42.734848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958478c-ba8b-42a8-ab9b-46f947777fc2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:42.787892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed230de-dd74-452c-b86d-044493664a0d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:42.802235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 206/418] 10.222.0.74 () {58 vars in 1442 bytes} [Wed Aug 31 00:15:42 2022] PUT /identity/v3/projects/cd01cbdba4ce42c9aba3127e81a7cb7f/groups/3413e9261c8d4cfe8fb45a99121c5a2e/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:15:42.804177 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf028-fc39-4294-a2be-8169630834d8 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:42.804764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf028-fc39-4294-a2be-8169630834d8 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:42.805241 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cf028-fc39-4294-a2be-8169630834d8 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:42.812434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 207/419] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:42.815099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e1e3-eff9-4ed5-91ab-ec26d899eae1 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:42.815696 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e1e3-eff9-4ed5-91ab-ec26d899eae1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:42.820314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e1e3-eff9-4ed5-91ab-ec26d899eae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:42.841599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-c1d2e1e3-eff9-4ed5-91ab-ec26d899eae1 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:42.844071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c1d2e1e3-eff9-4ed5-91ab-ec26d899eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:42.855175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf65a-3392-4a74-a487-2a27ed79bdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:42.856347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf65a-3392-4a74-a487-2a27ed79bdd0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:42.856499 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf65a-3392-4a74-a487-2a27ed79bdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:42.856755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf65a-3392-4a74-a487-2a27ed79bdd0 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:42.857469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf65a-3392-4a74-a487-2a27ed79bdd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:42.857830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf65a-3392-4a74-a487-2a27ed79bdd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:42.859319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf65a-3392-4a74-a487-2a27ed79bdd0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:42.867205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:42.879738 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 213/420] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:42.887118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf65a-3392-4a74-a487-2a27ed79bdd0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:42.935960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 208/421] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:43.059382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:43.085800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf65a-3392-4a74-a487-2a27ed79bdd0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:43.128221 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c09ea-91dc-46fb-9492-45e54eaed193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:43.128763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c09ea-91dc-46fb-9492-45e54eaed193 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:43.129047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c09ea-91dc-46fb-9492-45e54eaed193 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:43.129326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c09ea-91dc-46fb-9492-45e54eaed193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:43.231361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c09ea-91dc-46fb-9492-45e54eaed193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:43.233242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c09ea-91dc-46fb-9492-45e54eaed193 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:43.276460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2e1e3-eff9-4ed5-91ab-ec26d899eae1 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:43.341410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:43.375026 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 214/422] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:43.381801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c09ea-91dc-46fb-9492-45e54eaed193 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:43.525831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2e1e3-eff9-4ed5-91ab-ec26d899eae1 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:43.589592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c09ea-91dc-46fb-9492-45e54eaed193 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:43.596194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bb43c-b13b-48f8-964b-c2470401e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:43.598292 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bb43c-b13b-48f8-964b-c2470401e5cf None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:43.602499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bb43c-b13b-48f8-964b-c2470401e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:43.603023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bb43c-b13b-48f8-964b-c2470401e5cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:43.621654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bb43c-b13b-48f8-964b-c2470401e5cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-fd5bb43c-b13b-48f8-964b-c2470401e5cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:43.634854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:43.635809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 00:15:43.636635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:43.639700 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 209/423] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:43.645292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610e159-6e32-401a-b103-f13b48702b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:43.645529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bb43c-b13b-48f8-964b-c2470401e5cf None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:43.647035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610e159-6e32-401a-b103-f13b48702b9e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:43.647770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610e159-6e32-401a-b103-f13b48702b9e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:43.648541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610e159-6e32-401a-b103-f13b48702b9e None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:43.651047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610e159-6e32-401a-b103-f13b48702b9e None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:43.655417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610e159-6e32-401a-b103-f13b48702b9e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:43.659495 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 215/424] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:43 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:43.666414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:43.668898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610e159-6e32-401a-b103-f13b48702b9e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:43.770001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:43.793611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bb43c-b13b-48f8-964b-c2470401e5cf None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:43.832629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d39bd-ccb3-40ce-8c3a-1d7d53859947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:43.833248 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d39bd-ccb3-40ce-8c3a-1d7d53859947 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:43.833534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d39bd-ccb3-40ce-8c3a-1d7d53859947 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:43.833836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d39bd-ccb3-40ce-8c3a-1d7d53859947 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:43.834510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d39bd-ccb3-40ce-8c3a-1d7d53859947 None admin] RBAC: Adding query filter params (name=member) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:43.834845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d39bd-ccb3-40ce-8c3a-1d7d53859947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:43.836342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d39bd-ccb3-40ce-8c3a-1d7d53859947 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:43.846007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 210/425] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:15:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:43.847367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2da082-48d3-4126-8aa1-29c3804c0d75 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:43.847660 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2da082-48d3-4126-8aa1-29c3804c0d75 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:43.847937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2da082-48d3-4126-8aa1-29c3804c0d75 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:43.849339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 211/426] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:43.854935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2da082-48d3-4126-8aa1-29c3804c0d75 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:43.865170 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610e159-6e32-401a-b103-f13b48702b9e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:43.941131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:43.944825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28984765-31ce-4023-acdf-5dcc7b8b6b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:43.946010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984765-31ce-4023-acdf-5dcc7b8b6b2e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:43.946384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984765-31ce-4023-acdf-5dcc7b8b6b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:43.946866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984765-31ce-4023-acdf-5dcc7b8b6b2e None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:43.948900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28984765-31ce-4023-acdf-5dcc7b8b6b2e None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:43.953265 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28984765-31ce-4023-acdf-5dcc7b8b6b2e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:43.961788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 216/427] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:43 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:43.964220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abd10e-0efd-44d2-ad5c-fbcc28009a19 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:43.964504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abd10e-0efd-44d2-ad5c-fbcc28009a19 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:43.965609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abd10e-0efd-44d2-ad5c-fbcc28009a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:43.975027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2da082-48d3-4126-8aa1-29c3804c0d75 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:43.999947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b1abd10e-0efd-44d2-ad5c-fbcc28009a19 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:44.002065 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b1abd10e-0efd-44d2-ad5c-fbcc28009a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:44.014339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6255c30-4944-4f37-b724-c8fc6fb30846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.015186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6255c30-4944-4f37-b724-c8fc6fb30846 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.015657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6255c30-4944-4f37-b724-c8fc6fb30846 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.016096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6255c30-4944-4f37-b724-c8fc6fb30846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.109610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 217/428] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:44.109610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abd10e-0efd-44d2-ad5c-fbcc28009a19 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.117504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6255c30-4944-4f37-b724-c8fc6fb30846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.119383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6255c30-4944-4f37-b724-c8fc6fb30846 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.162799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:44.229949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abd10e-0efd-44d2-ad5c-fbcc28009a19 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.272266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1870169-40cb-44cf-a682-019fa7f183de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.272941 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1870169-40cb-44cf-a682-019fa7f183de None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.273225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1870169-40cb-44cf-a682-019fa7f183de None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.273500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1870169-40cb-44cf-a682-019fa7f183de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.275233 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1870169-40cb-44cf-a682-019fa7f183de None admin] RBAC: Adding query filter params (group.id=2b9eea8dc234410b92158c54a99fc0b3, role.id=bec3ab91aff841e286162327678e1cc6, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:44.275548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1870169-40cb-44cf-a682-019fa7f183de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.277062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1870169-40cb-44cf-a682-019fa7f183de None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.282035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:44.286348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 218/429] 10.222.0.74 () {56 vars in 1376 bytes} [Wed Aug 31 00:15:44 2022] GET /identity/v3/role_assignments?group.id=2b9eea8dc234410b92158c54a99fc0b3&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=bec3ab91aff841e286162327678e1cc6 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:44.334263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 212/430] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:44.341025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1870169-40cb-44cf-a682-019fa7f183de None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.468749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6255c30-4944-4f37-b724-c8fc6fb30846 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.502104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1870169-40cb-44cf-a682-019fa7f183de None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.523617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:44.541503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0430e-05b5-4e4e-8869-cf0438efb1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.543483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0430e-05b5-4e4e-8869-cf0438efb1eb None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.543483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0430e-05b5-4e4e-8869-cf0438efb1eb None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.543695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0430e-05b5-4e4e-8869-cf0438efb1eb None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.545741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0430e-05b5-4e4e-8869-cf0438efb1eb None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.547463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0430e-05b5-4e4e-8869-cf0438efb1eb None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.555006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 219/431] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:44 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:44.556399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74670e-bdbf-4adb-a202-e6330153974f None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.556873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74670e-bdbf-4adb-a202-e6330153974f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.557236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74670e-bdbf-4adb-a202-e6330153974f None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.561444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 220/432] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:44.562192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74670e-bdbf-4adb-a202-e6330153974f None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.620627 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6255c30-4944-4f37-b724-c8fc6fb30846 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.659212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e0abb-3f85-4be9-9e34-633612e3977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.659788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0abb-3f85-4be9-9e34-633612e3977b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.660075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0abb-3f85-4be9-9e34-633612e3977b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.660382 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e0abb-3f85-4be9-9e34-633612e3977b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.679323 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e0abb-3f85-4be9-9e34-633612e3977b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-b86e0abb-3f85-4be9-9e34-633612e3977b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:44.693721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:44.694923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 213/433] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:44.695903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80716c-c517-431c-b038-57034663ef46 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.696632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80716c-c517-431c-b038-57034663ef46 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.696632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80716c-c517-431c-b038-57034663ef46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.713461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74670e-bdbf-4adb-a202-e6330153974f None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.720502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-4e80716c-c517-431c-b038-57034663ef46 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:44.721653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4e80716c-c517-431c-b038-57034663ef46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:44.755739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:44.763826 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaf0de-1b99-434e-b066-6eae2cbd7b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.764769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf0de-1b99-434e-b066-6eae2cbd7b70 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.765373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf0de-1b99-434e-b066-6eae2cbd7b70 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.765595 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf0de-1b99-434e-b066-6eae2cbd7b70 None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.769818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaf0de-1b99-434e-b066-6eae2cbd7b70 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.769818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaf0de-1b99-434e-b066-6eae2cbd7b70 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.776439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 221/434] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:44 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:44.776439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaf0de-1b99-434e-b066-6eae2cbd7b70 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.815603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 214/435] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:44.816680 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80716c-c517-431c-b038-57034663ef46 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:44.839092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:44.927738 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaf0de-1b99-434e-b066-6eae2cbd7b70 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.981449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c15294-d8f9-4d78-bdf6-e006ffcdae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:44.981988 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80716c-c517-431c-b038-57034663ef46 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:44.982432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c15294-d8f9-4d78-bdf6-e006ffcdae5d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:44.982805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c15294-d8f9-4d78-bdf6-e006ffcdae5d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:44.983250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c15294-d8f9-4d78-bdf6-e006ffcdae5d None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:44.984351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c15294-d8f9-4d78-bdf6-e006ffcdae5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:44.984842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c15294-d8f9-4d78-bdf6-e006ffcdae5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:44.988051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c15294-d8f9-4d78-bdf6-e006ffcdae5d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:44.999685 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 222/436] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:45.005139 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c15294-d8f9-4d78-bdf6-e006ffcdae5d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.029633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc625c-18d2-4e63-b02b-e00557289d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.030277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc625c-18d2-4e63-b02b-e00557289d6c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.030929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc625c-18d2-4e63-b02b-e00557289d6c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.031232 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc625c-18d2-4e63-b02b-e00557289d6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.031969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc625c-18d2-4e63-b02b-e00557289d6c None admin] RBAC: Adding query filter params (group.id=2b9eea8dc234410b92158c54a99fc0b3, role.id=bec3ab91aff841e286162327678e1cc6, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:45.032285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc625c-18d2-4e63-b02b-e00557289d6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.033883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc625c-18d2-4e63-b02b-e00557289d6c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.043018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 215/437] 10.222.0.74 () {56 vars in 1376 bytes} [Wed Aug 31 00:15:44 2022] GET /identity/v3/role_assignments?group.id=2b9eea8dc234410b92158c54a99fc0b3&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=bec3ab91aff841e286162327678e1cc6 => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:45.135669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c15294-d8f9-4d78-bdf6-e006ffcdae5d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.146722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.174529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc625c-18d2-4e63-b02b-e00557289d6c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.177791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4bc8a-39ee-4f7e-afb9-190f27537a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.178426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bc8a-39ee-4f7e-afb9-190f27537a5c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.178708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bc8a-39ee-4f7e-afb9-190f27537a5c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.178986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bc8a-39ee-4f7e-afb9-190f27537a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.209399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.264664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4bc8a-39ee-4f7e-afb9-190f27537a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.266187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4bc8a-39ee-4f7e-afb9-190f27537a5c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.312209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc625c-18d2-4e63-b02b-e00557289d6c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.348560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068c42c-baa0-425e-990a-d7269b1335e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.349206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068c42c-baa0-425e-990a-d7269b1335e6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.349488 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068c42c-baa0-425e-990a-d7269b1335e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.349796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068c42c-baa0-425e-990a-d7269b1335e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.360874 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068c42c-baa0-425e-990a-d7269b1335e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-5068c42c-baa0-425e-990a-d7269b1335e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:45.365839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:45.366768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:45.367558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 216/438] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:15:45.368224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0a51-95a9-484b-9ad7-9639b086318e None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.368442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0a51-95a9-484b-9ad7-9639b086318e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.368755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0a51-95a9-484b-9ad7-9639b086318e None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.370586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 217/439] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:45.373461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0a51-95a9-484b-9ad7-9639b086318e None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.388376 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 223/440] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:15:45.390048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e422-4550-4da1-be2b-ca9f7e79f31b None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.390126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e422-4550-4da1-be2b-ca9f7e79f31b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.390387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e422-4550-4da1-be2b-ca9f7e79f31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.408249 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-60d1e422-4550-4da1-be2b-ca9f7e79f31b None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:45.409430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-60d1e422-4550-4da1-be2b-ca9f7e79f31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:45.411478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.467545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.482185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0a51-95a9-484b-9ad7-9639b086318e None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.487742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 224/441] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:45.488770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1e422-4550-4da1-be2b-ca9f7e79f31b None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.524453 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88771c69-f610-4980-a7d9-bfe186e07bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.524963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88771c69-f610-4980-a7d9-bfe186e07bcf None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.525243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88771c69-f610-4980-a7d9-bfe186e07bcf None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.525516 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88771c69-f610-4980-a7d9-bfe186e07bcf None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.526228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88771c69-f610-4980-a7d9-bfe186e07bcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:45.526596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88771c69-f610-4980-a7d9-bfe186e07bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.527954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88771c69-f610-4980-a7d9-bfe186e07bcf None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.539943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 218/442] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:45.545798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88771c69-f610-4980-a7d9-bfe186e07bcf None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.610480 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1e422-4550-4da1-be2b-ca9f7e79f31b None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.646406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec2154-b00b-4329-8098-29108be94ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.647321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec2154-b00b-4329-8098-29108be94ffc None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.647604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec2154-b00b-4329-8098-29108be94ffc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.647881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec2154-b00b-4329-8098-29108be94ffc None admin] PATH_INFO: `/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.649530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec2154-b00b-4329-8098-29108be94ffc None admin] RBAC: Authorizing `identity:get_project(project_id=2d6a4068250844a5a5f88b9f1f3c7909)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.651001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec2154-b00b-4329-8098-29108be94ffc None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.653299 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 225/443] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/projects/2d6a4068250844a5a5f88b9f1f3c7909 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:45.658577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec2154-b00b-4329-8098-29108be94ffc None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.664563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88771c69-f610-4980-a7d9-bfe186e07bcf None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.667288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.704845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53fb7f-3a2f-4221-91d8-227fc5b59d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.705466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53fb7f-3a2f-4221-91d8-227fc5b59d9c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.705770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53fb7f-3a2f-4221-91d8-227fc5b59d9c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.706046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53fb7f-3a2f-4221-91d8-227fc5b59d9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.730883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.782476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec2154-b00b-4329-8098-29108be94ffc None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.792212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53fb7f-3a2f-4221-91d8-227fc5b59d9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.793823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53fb7f-3a2f-4221-91d8-227fc5b59d9c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.816421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ce1a-58ff-4853-a725-b63ddff758bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.817063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ce1a-58ff-4853-a725-b63ddff758bf None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.817326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ce1a-58ff-4853-a725-b63ddff758bf None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.817665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ce1a-58ff-4853-a725-b63ddff758bf None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.818780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2ce1a-58ff-4853-a725-b63ddff758bf None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:45.820220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2ce1a-58ff-4853-a725-b63ddff758bf None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:45.821854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 226/444] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:45.822615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ce1a-58ff-4853-a725-b63ddff758bf None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.898542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 219/445] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:15:45.899295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53fb7f-3a2f-4221-91d8-227fc5b59d9c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:45.903114 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.928841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ce1a-58ff-4853-a725-b63ddff758bf None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:45.948401 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:45.963523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491e4da-b089-4c7e-9190-668966697070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:45.964144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491e4da-b089-4c7e-9190-668966697070 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:45.964425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491e4da-b089-4c7e-9190-668966697070 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:45.964697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491e4da-b089-4c7e-9190-668966697070 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:45.975435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491e4da-b089-4c7e-9190-668966697070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-b491e4da-b089-4c7e-9190-668966697070 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:45.980926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:45.982099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 227/446] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:45.982985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491e4da-b089-4c7e-9190-668966697070 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.004059 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53fb7f-3a2f-4221-91d8-227fc5b59d9c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.039056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9115f45-e271-445b-bd17-842b002aa797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.039579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115f45-e271-445b-bd17-842b002aa797 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.039855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115f45-e271-445b-bd17-842b002aa797 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.040124 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9115f45-e271-445b-bd17-842b002aa797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.040837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9115f45-e271-445b-bd17-842b002aa797 None admin] RBAC: Adding query filter params (group.id=2b9eea8dc234410b92158c54a99fc0b3, role.id=20d736bdf9df414f9e9b2ae27c77c071, scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:46.041140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9115f45-e271-445b-bd17-842b002aa797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.042614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9115f45-e271-445b-bd17-842b002aa797 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.048770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 220/447] 10.222.0.74 () {56 vars in 1376 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/role_assignments?group.id=2b9eea8dc234410b92158c54a99fc0b3&scope.project.id=2d6a4068250844a5a5f88b9f1f3c7909&role.id=20d736bdf9df414f9e9b2ae27c77c071 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:46.049538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9115f45-e271-445b-bd17-842b002aa797 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.086676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491e4da-b089-4c7e-9190-668966697070 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.126625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fbd53-d98d-4403-80e1-bdeb1a5da333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.127375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fbd53-d98d-4403-80e1-bdeb1a5da333 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.127659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fbd53-d98d-4403-80e1-bdeb1a5da333 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.127939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fbd53-d98d-4403-80e1-bdeb1a5da333 None admin] PATH_INFO: `/v3/projects/e2b8f41a4823488faa3818650e1d3d0b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.129774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fbd53-d98d-4403-80e1-bdeb1a5da333 None admin] RBAC: Authorizing `identity:get_project(project_id=e2b8f41a4823488faa3818650e1d3d0b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.131296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fbd53-d98d-4403-80e1-bdeb1a5da333 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.133175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 228/448] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:45 2022] GET /identity/v3/projects/e2b8f41a4823488faa3818650e1d3d0b => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:46.138901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fbd53-d98d-4403-80e1-bdeb1a5da333 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.142731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:46.185074 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9115f45-e271-445b-bd17-842b002aa797 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.201981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:46.223980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27833edb-d5f8-4931-8a8e-c6a97c696b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.224604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27833edb-d5f8-4931-8a8e-c6a97c696b66 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.224893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27833edb-d5f8-4931-8a8e-c6a97c696b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.225193 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27833edb-d5f8-4931-8a8e-c6a97c696b66 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.225872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27833edb-d5f8-4931-8a8e-c6a97c696b66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:46.226762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27833edb-d5f8-4931-8a8e-c6a97c696b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.227565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27833edb-d5f8-4931-8a8e-c6a97c696b66 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.238175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 221/449] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:46.243726 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27833edb-d5f8-4931-8a8e-c6a97c696b66 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.265826 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fbd53-d98d-4403-80e1-bdeb1a5da333 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.300664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1e2cc-9b5f-4a4a-be95-01d71db27d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.301216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1e2cc-9b5f-4a4a-be95-01d71db27d15 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.301497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1e2cc-9b5f-4a4a-be95-01d71db27d15 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.301801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1e2cc-9b5f-4a4a-be95-01d71db27d15 None admin] PATH_INFO: `/v3/groups/2b9eea8dc234410b92158c54a99fc0b3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.302931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1e2cc-9b5f-4a4a-be95-01d71db27d15 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9eea8dc234410b92158c54a99fc0b3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.304376 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1e2cc-9b5f-4a4a-be95-01d71db27d15 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.305971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 229/450] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/groups/2b9eea8dc234410b92158c54a99fc0b3 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:46.312622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1e2cc-9b5f-4a4a-be95-01d71db27d15 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.348867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27833edb-d5f8-4931-8a8e-c6a97c696b66 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.382552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:46.382717 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7988bd0-f2fc-4bc3-a1d3-806226e8be02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.383148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988bd0-f2fc-4bc3-a1d3-806226e8be02 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.383487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988bd0-f2fc-4bc3-a1d3-806226e8be02 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.383698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7988bd0-f2fc-4bc3-a1d3-806226e8be02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.414063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1e2cc-9b5f-4a4a-be95-01d71db27d15 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.430207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:46.450006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342367d-403a-4c3d-bfde-8fa59b84be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.450603 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342367d-403a-4c3d-bfde-8fa59b84be12 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.450881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342367d-403a-4c3d-bfde-8fa59b84be12 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.451150 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342367d-403a-4c3d-bfde-8fa59b84be12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.451876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342367d-403a-4c3d-bfde-8fa59b84be12 None admin] RBAC: Adding query filter params (group.id=2b9eea8dc234410b92158c54a99fc0b3, role.id=20d736bdf9df414f9e9b2ae27c77c071, scope.project.id=e2b8f41a4823488faa3818650e1d3d0b) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:46.452178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342367d-403a-4c3d-bfde-8fa59b84be12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.453632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342367d-403a-4c3d-bfde-8fa59b84be12 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.453934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7988bd0-f2fc-4bc3-a1d3-806226e8be02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.455378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7988bd0-f2fc-4bc3-a1d3-806226e8be02 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.460338 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 230/451] 10.222.0.74 () {56 vars in 1376 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/role_assignments?group.id=2b9eea8dc234410b92158c54a99fc0b3&scope.project.id=e2b8f41a4823488faa3818650e1d3d0b&role.id=20d736bdf9df414f9e9b2ae27c77c071 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:15:46.568405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 222/452] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:15:46.575115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342367d-403a-4c3d-bfde-8fa59b84be12 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.680401 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342367d-403a-4c3d-bfde-8fa59b84be12 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.716956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2113178-9b2d-4546-82a7-3147c320746a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.717622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2113178-9b2d-4546-82a7-3147c320746a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.717899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2113178-9b2d-4546-82a7-3147c320746a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.718171 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2113178-9b2d-4546-82a7-3147c320746a None admin] PATH_INFO: `/v3/projects/cd01cbdba4ce42c9aba3127e81a7cb7f` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.719345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2113178-9b2d-4546-82a7-3147c320746a None admin] RBAC: Authorizing `identity:get_project(project_id=cd01cbdba4ce42c9aba3127e81a7cb7f)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.720791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2113178-9b2d-4546-82a7-3147c320746a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.723724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 231/453] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/projects/cd01cbdba4ce42c9aba3127e81a7cb7f => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:46.728858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7988bd0-f2fc-4bc3-a1d3-806226e8be02 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.822504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:46.848437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7988bd0-f2fc-4bc3-a1d3-806226e8be02 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:46.896873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7820349-0ff8-4881-b11f-6180c35862ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:46.897858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7820349-0ff8-4881-b11f-6180c35862ab None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:46.898294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7820349-0ff8-4881-b11f-6180c35862ab None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:46.898708 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7820349-0ff8-4881-b11f-6180c35862ab None admin] PATH_INFO: `/v3/groups/3413e9261c8d4cfe8fb45a99121c5a2e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:46.900430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7820349-0ff8-4881-b11f-6180c35862ab None admin] RBAC: Authorizing `identity:get_group(group_id=3413e9261c8d4cfe8fb45a99121c5a2e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:46.903365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7820349-0ff8-4881-b11f-6180c35862ab None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:46.906097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 223/454] 10.222.0.74 () {56 vars in 1180 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/groups/3413e9261c8d4cfe8fb45a99121c5a2e => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:46.913264 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2113178-9b2d-4546-82a7-3147c320746a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:46.918013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:47.050150 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2113178-9b2d-4546-82a7-3147c320746a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:47.099966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12a7ec-22da-4bb5-b6fd-d87fa877c99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:47.100503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12a7ec-22da-4bb5-b6fd-d87fa877c99a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:47.100786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12a7ec-22da-4bb5-b6fd-d87fa877c99a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:47.101070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12a7ec-22da-4bb5-b6fd-d87fa877c99a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:47.101844 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12a7ec-22da-4bb5-b6fd-d87fa877c99a None admin] RBAC: Adding query filter params (group.id=3413e9261c8d4cfe8fb45a99121c5a2e, role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=cd01cbdba4ce42c9aba3127e81a7cb7f) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:47.102152 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12a7ec-22da-4bb5-b6fd-d87fa877c99a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:47.103597 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12a7ec-22da-4bb5-b6fd-d87fa877c99a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:47.111573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 232/455] 10.222.0.74 () {56 vars in 1376 bytes} [Wed Aug 31 00:15:46 2022] GET /identity/v3/role_assignments?group.id=3413e9261c8d4cfe8fb45a99121c5a2e&scope.project.id=cd01cbdba4ce42c9aba3127e81a7cb7f&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:49.994209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459e35-2674-4ea8-af78-1427433f75a4 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:49.994723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459e35-2674-4ea8-af78-1427433f75a4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:49.994797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459e35-2674-4ea8-af78-1427433f75a4 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:49.996659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 224/456] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:50.002514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1ced-48f6-4582-aa19-944425f2ca74 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.002983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1ced-48f6-4582-aa19-944425f2ca74 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.003057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc1ced-48f6-4582-aa19-944425f2ca74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.014711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423293e-e368-4dbb-8e4e-a00c638acf6e None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.015012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423293e-e368-4dbb-8e4e-a00c638acf6e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.016282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423293e-e368-4dbb-8e4e-a00c638acf6e None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.018045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 225/457] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:50.023072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d64b47-a5da-428f-9704-508c41f270a8 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.023386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d64b47-a5da-428f-9704-508c41f270a8 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.023664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d64b47-a5da-428f-9704-508c41f270a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.028050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-acfc1ced-48f6-4582-aa19-944425f2ca74 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:50.029617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-acfc1ced-48f6-4582-aa19-944425f2ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:50.058211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-52d64b47-a5da-428f-9704-508c41f270a8 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:50.061858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-52d64b47-a5da-428f-9704-508c41f270a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:50.158840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:50.164552 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 226/458] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:50.188243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 233/459] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:50.192981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640d5b-c91a-49bb-b506-783a5fc8b0f4 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.193350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640d5b-c91a-49bb-b506-783a5fc8b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.193734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37640d5b-c91a-49bb-b506-783a5fc8b0f4 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.195383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 227/460] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:50.201875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ac326-548b-4f07-814a-38ab4331bfec None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.202244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ac326-548b-4f07-814a-38ab4331bfec None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.202591 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ac326-548b-4f07-814a-38ab4331bfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.225456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-518ac326-548b-4f07-814a-38ab4331bfec None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:50.226889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-518ac326-548b-4f07-814a-38ab4331bfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:50.302957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 234/461] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:50.506030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37640d5b-c91a-49bb-b506-783a5fc8b0f4 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:50.596705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ac326-548b-4f07-814a-38ab4331bfec None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:50.616215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:50.655156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37640d5b-c91a-49bb-b506-783a5fc8b0f4 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:50.694168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91f306-cd1c-4c02-8ac1-dda7eeac0938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:50.694925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91f306-cd1c-4c02-8ac1-dda7eeac0938 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.695105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91f306-cd1c-4c02-8ac1-dda7eeac0938 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.695386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91f306-cd1c-4c02-8ac1-dda7eeac0938 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.706810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91f306-cd1c-4c02-8ac1-dda7eeac0938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:50.708290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91f306-cd1c-4c02-8ac1-dda7eeac0938 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:50.721023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ac326-548b-4f07-814a-38ab4331bfec None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-fe91f306-cd1c-4c02-8ac1-dda7eeac0938 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:50.726233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:50.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:50.728187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:50.728187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:50.728187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:50.728187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 228/462] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:50.729440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91f306-cd1c-4c02-8ac1-dda7eeac0938 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:50.755250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:50.765739 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de4bc0-7538-47fd-8e63-ca9736ab64e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:50.766296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de4bc0-7538-47fd-8e63-ca9736ab64e1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.766599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de4bc0-7538-47fd-8e63-ca9736ab64e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.766860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de4bc0-7538-47fd-8e63-ca9736ab64e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.778717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de4bc0-7538-47fd-8e63-ca9736ab64e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:50.780211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de4bc0-7538-47fd-8e63-ca9736ab64e1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-47de4bc0-7538-47fd-8e63-ca9736ab64e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:50.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:50.798976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:50.804928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:50.804928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:50.804928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:50.804928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 235/463] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:50.804928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478ba9-42a0-4eb3-8eb3-6ccee103ded2 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.804928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478ba9-42a0-4eb3-8eb3-6ccee103ded2 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.804928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e478ba9-42a0-4eb3-8eb3-6ccee103ded2 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.804928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 236/464] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:50.804928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478ba9-42a0-4eb3-8eb3-6ccee103ded2 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:50.855903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91f306-cd1c-4c02-8ac1-dda7eeac0938 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:50.894078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:50.900630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd5f80-89b2-464d-8a31-adc86f52e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:50.901268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd5f80-89b2-464d-8a31-adc86f52e96f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.901551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd5f80-89b2-464d-8a31-adc86f52e96f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.901859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd5f80-89b2-464d-8a31-adc86f52e96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.913562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd5f80-89b2-464d-8a31-adc86f52e96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:50.915071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd5f80-89b2-464d-8a31-adc86f52e96f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:50.931608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e478ba9-42a0-4eb3-8eb3-6ccee103ded2 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-75fd5f80-89b2-464d-8a31-adc86f52e96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:50.932303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:50.933169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:50.934800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:50.934800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:50.934800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:50.934800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 229/465] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:50.935030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd5f80-89b2-464d-8a31-adc86f52e96f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:50.979571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365b82e-5276-4bd7-8008-85d6e3af5c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:50.980751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b82e-5276-4bd7-8008-85d6e3af5c07 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.981157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b82e-5276-4bd7-8008-85d6e3af5c07 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.981688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b82e-5276-4bd7-8008-85d6e3af5c07 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:50.982432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365b82e-5276-4bd7-8008-85d6e3af5c07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:50.982747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365b82e-5276-4bd7-8008-85d6e3af5c07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:50.984159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365b82e-5276-4bd7-8008-85d6e3af5c07 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:50.998097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 237/466] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:50.999359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3f01-9670-468a-9887-d7e6577b1d50 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:50.999649 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3f01-9670-468a-9887-d7e6577b1d50 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:50.999933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3f01-9670-468a-9887-d7e6577b1d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.018780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-efdf3f01-9670-468a-9887-d7e6577b1d50 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:51.019930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-efdf3f01-9670-468a-9887-d7e6577b1d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:51.053857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:51.060533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd5f80-89b2-464d-8a31-adc86f52e96f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:51.096954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 238/467] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:51.098938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf3f01-9670-468a-9887-d7e6577b1d50 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:51.111478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36543f-26ad-4db0-8e21-a3c3fea5d327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:51.112916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36543f-26ad-4db0-8e21-a3c3fea5d327 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.113922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36543f-26ad-4db0-8e21-a3c3fea5d327 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.114610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36543f-26ad-4db0-8e21-a3c3fea5d327 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.115554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36543f-26ad-4db0-8e21-a3c3fea5d327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:51.116057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36543f-26ad-4db0-8e21-a3c3fea5d327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:51.118411 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36543f-26ad-4db0-8e21-a3c3fea5d327 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:51.144425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 230/468] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:51.145547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36543f-26ad-4db0-8e21-a3c3fea5d327 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:51.205327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:51.234122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf3f01-9670-468a-9887-d7e6577b1d50 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:51.279142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36543f-26ad-4db0-8e21-a3c3fea5d327 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:51.280097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa5712-26d5-4151-a929-cec01b43a28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:51.280749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa5712-26d5-4151-a929-cec01b43a28b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.281025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa5712-26d5-4151-a929-cec01b43a28b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.281293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa5712-26d5-4151-a929-cec01b43a28b None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.282000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa5712-26d5-4151-a929-cec01b43a28b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:51.282309 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa5712-26d5-4151-a929-cec01b43a28b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:51.283710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa5712-26d5-4151-a929-cec01b43a28b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:51.307746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 239/469] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:51.307746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa5712-26d5-4151-a929-cec01b43a28b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:51.340411 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6fcd-c7e6-4e27-90e5-de3436ba12b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:51.341023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6fcd-c7e6-4e27-90e5-de3436ba12b5 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.341307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6fcd-c7e6-4e27-90e5-de3436ba12b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.341743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6fcd-c7e6-4e27-90e5-de3436ba12b5 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.342258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa6fcd-c7e6-4e27-90e5-de3436ba12b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:51.343797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa6fcd-c7e6-4e27-90e5-de3436ba12b5 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:51.351183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:51.432336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa5712-26d5-4151-a929-cec01b43a28b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:51.460939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 231/470] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:15:51 2022] POST /identity/v3/users => generated 248 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:51.462227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951915b-3ffc-4cb4-a554-57818b736c69 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.462517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951915b-3ffc-4cb4-a554-57818b736c69 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.462796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951915b-3ffc-4cb4-a554-57818b736c69 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.464071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 232/471] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:51.465445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951915b-3ffc-4cb4-a554-57818b736c69 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:51.478551 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef4000-aaef-4c5c-bd0a-53ab3a5167e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:51.479356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef4000-aaef-4c5c-bd0a-53ab3a5167e4 None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.479741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef4000-aaef-4c5c-bd0a-53ab3a5167e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.480154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef4000-aaef-4c5c-bd0a-53ab3a5167e4 None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.481868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef4000-aaef-4c5c-bd0a-53ab3a5167e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:51.484134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef4000-aaef-4c5c-bd0a-53ab3a5167e4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:51.581708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 240/472] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:15:51 2022] POST /identity/v3/users => generated 248 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:51.582107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef4000-aaef-4c5c-bd0a-53ab3a5167e4 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:51.598410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:51.609383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951915b-3ffc-4cb4-a554-57818b736c69 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:51.665481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60a685-15b2-480a-b532-48d6c52c27b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:51.666204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60a685-15b2-480a-b532-48d6c52c27b9 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.666312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60a685-15b2-480a-b532-48d6c52c27b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.666557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60a685-15b2-480a-b532-48d6c52c27b9 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.667351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60a685-15b2-480a-b532-48d6c52c27b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:51.670150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60a685-15b2-480a-b532-48d6c52c27b9 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:51.728075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:51.749882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef4000-aaef-4c5c-bd0a-53ab3a5167e4 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:51.780834 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 233/473] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:15:51 2022] POST /identity/v3/users => generated 246 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:51.788082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a253ac-3e06-485d-bf2b-f69bf8ba685e None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.788536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a253ac-3e06-485d-bf2b-f69bf8ba685e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.788977 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a253ac-3e06-485d-bf2b-f69bf8ba685e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.801130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c4b99-dc38-424b-aaa3-91e3f798d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:51.801871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4b99-dc38-424b-aaa3-91e3f798d26d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:51.802160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4b99-dc38-424b-aaa3-91e3f798d26d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:51.803368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4b99-dc38-424b-aaa3-91e3f798d26d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:51.823526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-e9a253ac-3e06-485d-bf2b-f69bf8ba685e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:51.824210 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c4b99-dc38-424b-aaa3-91e3f798d26d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:51.824837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e9a253ac-3e06-485d-bf2b-f69bf8ba685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:51.825731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c4b99-dc38-424b-aaa3-91e3f798d26d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-179c4b99-dc38-424b-aaa3-91e3f798d26d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:51.859369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:51.860314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:51.861187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:51.861187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:51.861187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:51.861846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 241/474] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:51.875393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c4b99-dc38-424b-aaa3-91e3f798d26d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:51.959756 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 234/475] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:52.043496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c4b99-dc38-424b-aaa3-91e3f798d26d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:52.080271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04165f6-68d5-4c3e-80a5-084113dfa5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:52.080876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04165f6-68d5-4c3e-80a5-084113dfa5de None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:52.081155 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04165f6-68d5-4c3e-80a5-084113dfa5de None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:52.081430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04165f6-68d5-4c3e-80a5-084113dfa5de None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:52.082113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04165f6-68d5-4c3e-80a5-084113dfa5de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:52.082415 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04165f6-68d5-4c3e-80a5-084113dfa5de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:52.083783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04165f6-68d5-4c3e-80a5-084113dfa5de None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:52.086521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:52.098970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 242/476] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:52.106245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a253ac-3e06-485d-bf2b-f69bf8ba685e None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:52.201864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:52.221935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a253ac-3e06-485d-bf2b-f69bf8ba685e None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:52.258964 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b710b-ce1d-478d-afc6-db760a5c4b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:52.259646 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b710b-ce1d-478d-afc6-db760a5c4b9f None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:52.259933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b710b-ce1d-478d-afc6-db760a5c4b9f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:52.260265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b710b-ce1d-478d-afc6-db760a5c4b9f None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:52.260981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b710b-ce1d-478d-afc6-db760a5c4b9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:52.263666 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b710b-ce1d-478d-afc6-db760a5c4b9f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:52.292720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04165f6-68d5-4c3e-80a5-084113dfa5de None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:52.359181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 235/477] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:15:52 2022] POST /identity/v3/users => generated 249 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:52.406473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04165f6-68d5-4c3e-80a5-084113dfa5de None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:52.455492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fbc52-4ca7-476d-bf14-9d0e76f4298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:52.456112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbc52-4ca7-476d-bf14-9d0e76f4298e None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:52.456392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbc52-4ca7-476d-bf14-9d0e76f4298e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:52.456662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fbc52-4ca7-476d-bf14-9d0e76f4298e None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:52.457345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fbc52-4ca7-476d-bf14-9d0e76f4298e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:52.458773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fbc52-4ca7-476d-bf14-9d0e76f4298e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:52.510128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.sql.core [None req-c18fbc52-4ca7-476d-bf14-9d0e76f4298e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:15:52.510128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:15:52.510128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [parameters: {'id': '2210f96ecb1545cea43bf0998cb712e2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:15:52.510128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88178) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-c18fbc52-4ca7-476d-bf14-9d0e76f4298e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application result.read() Aug 31 00:15:52.528517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:15:52.529442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application yield resource Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise self.value Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application session.commit() Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:15:52.530409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:15:52.531860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:15:52.532745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application result.read() Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:15:52.533555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [parameters: {'id': '2210f96ecb1545cea43bf0998cb712e2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:52.534371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 00:15:52.536492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:52.538484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 243/478] 10.222.0.74 () {60 vars in 1131 bytes} [Wed Aug 31 00:15:52 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:52.538618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b710b-ce1d-478d-afc6-db760a5c4b9f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:52.654526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b710b-ce1d-478d-afc6-db760a5c4b9f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:52.695160 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4757ac-8135-413c-8231-2ad9871c1ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:52.696154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4757ac-8135-413c-8231-2ad9871c1ec1 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:52.696632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4757ac-8135-413c-8231-2ad9871c1ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:52.697095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4757ac-8135-413c-8231-2ad9871c1ec1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:52.701347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:52.713064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4757ac-8135-413c-8231-2ad9871c1ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-3c4757ac-8135-413c-8231-2ad9871c1ec1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:52.718966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:52.719852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 00:15:52.720654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:52.722897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 236/479] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:15:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:52.728632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fbc52-4ca7-476d-bf14-9d0e76f4298e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:52.799216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:52.846755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fbc52-4ca7-476d-bf14-9d0e76f4298e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:52.929471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f99e-b1ee-4079-a98e-a693031a201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:52.930260 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f99e-b1ee-4079-a98e-a693031a201e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:52.930724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f99e-b1ee-4079-a98e-a693031a201e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:52.931198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f99e-b1ee-4079-a98e-a693031a201e None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:52.932322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864f99e-b1ee-4079-a98e-a693031a201e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:52.932862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864f99e-b1ee-4079-a98e-a693031a201e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:52.935118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864f99e-b1ee-4079-a98e-a693031a201e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:52.943991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 244/480] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:53.739024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49766-93d6-42fa-9898-ddaae33847be None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:53.740078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49766-93d6-42fa-9898-ddaae33847be None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:53.740569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49766-93d6-42fa-9898-ddaae33847be None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:53.742498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 237/481] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:53.749128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fbd4a-0404-429e-99ff-29f5c7471182 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:53.749657 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fbd4a-0404-429e-99ff-29f5c7471182 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:53.749735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fbd4a-0404-429e-99ff-29f5c7471182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:53.778263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-ca2fbd4a-0404-429e-99ff-29f5c7471182 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:53.779828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ca2fbd4a-0404-429e-99ff-29f5c7471182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:53.883246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 245/482] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:54.291823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f49766-93d6-42fa-9898-ddaae33847be None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:54.343699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73bd5d-5318-4add-9a07-29e7c0e7bef3 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.344338 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73bd5d-5318-4add-9a07-29e7c0e7bef3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.345148 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73bd5d-5318-4add-9a07-29e7c0e7bef3 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.347795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 246/483] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:15:54.354642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3046a8-c2e2-44c9-bc6c-99882cf87c1f None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.355304 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3046a8-c2e2-44c9-bc6c-99882cf87c1f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.355787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3046a8-c2e2-44c9-bc6c-99882cf87c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.395464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-1d3046a8-c2e2-44c9-bc6c-99882cf87c1f None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:54.396770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1d3046a8-c2e2-44c9-bc6c-99882cf87c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:54.506772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f49766-93d6-42fa-9898-ddaae33847be None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:54.520379 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:54.552992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68daa51-fee1-4a12-9591-c22a6c22b8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:54.553527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68daa51-fee1-4a12-9591-c22a6c22b8cf None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.553837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68daa51-fee1-4a12-9591-c22a6c22b8cf None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.554172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68daa51-fee1-4a12-9591-c22a6c22b8cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.565609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 247/484] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:54.565609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088c39f-36d0-4380-846c-5401e8a3e02c None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.565609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088c39f-36d0-4380-846c-5401e8a3e02c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.565609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088c39f-36d0-4380-846c-5401e8a3e02c None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.565609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 248/485] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:54.569930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e007e6f-9ad1-4e74-b69b-c6b3bbb60a01 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.570215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e007e6f-9ad1-4e74-b69b-c6b3bbb60a01 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.570489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e007e6f-9ad1-4e74-b69b-c6b3bbb60a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.579503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68daa51-fee1-4a12-9591-c22a6c22b8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-b68daa51-fee1-4a12-9591-c22a6c22b8cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:54.593647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:54.594748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:15:54.595553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:54.597774 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 238/486] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:15:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:54.603065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68daa51-fee1-4a12-9591-c22a6c22b8cf None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:54.610700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-9e007e6f-9ad1-4e74-b69b-c6b3bbb60a01 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:54.612126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-9e007e6f-9ad1-4e74-b69b-c6b3bbb60a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:54.688648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 249/487] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:15:54.724303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:54.778712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68daa51-fee1-4a12-9591-c22a6c22b8cf None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:54.818297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bdfb9-768e-41aa-b471-e92fc8505ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:54.819184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bdfb9-768e-41aa-b471-e92fc8505ab1 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:54.819604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bdfb9-768e-41aa-b471-e92fc8505ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:54.820037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bdfb9-768e-41aa-b471-e92fc8505ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:54.820847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bdfb9-768e-41aa-b471-e92fc8505ab1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:54.821291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bdfb9-768e-41aa-b471-e92fc8505ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:54.822842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97bdfb9-768e-41aa-b471-e92fc8505ab1 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:54.833400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 239/488] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:15:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:54.841468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e007e6f-9ad1-4e74-b69b-c6b3bbb60a01 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:54.972606 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e007e6f-9ad1-4e74-b69b-c6b3bbb60a01 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:54.989276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:55.015745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b833d-3957-4471-b678-41806134b279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.016396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b833d-3957-4471-b678-41806134b279 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.016676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b833d-3957-4471-b678-41806134b279 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.016951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b833d-3957-4471-b678-41806134b279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.028690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b833d-3957-4471-b678-41806134b279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:55.030574 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b833d-3957-4471-b678-41806134b279 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-785b833d-3957-4471-b678-41806134b279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:55.050371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:55.052084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:55.054101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:55.054101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:55.054101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:55.054101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 250/489] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:55.061847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bdfb9-768e-41aa-b471-e92fc8505ab1 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.074101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b833d-3957-4471-b678-41806134b279 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.188442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b833d-3957-4471-b678-41806134b279 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.213560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bdfb9-768e-41aa-b471-e92fc8505ab1 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.235017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:55.240049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dc599-b6dc-4318-b5a5-cfb0ac04e279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.241069 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dc599-b6dc-4318-b5a5-cfb0ac04e279 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.241404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dc599-b6dc-4318-b5a5-cfb0ac04e279 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.241692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dc599-b6dc-4318-b5a5-cfb0ac04e279 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.257460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e26a5-b512-4d6c-b559-0796ade54371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.258110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e26a5-b512-4d6c-b559-0796ade54371 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.258385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e26a5-b512-4d6c-b559-0796ade54371 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.258645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e26a5-b512-4d6c-b559-0796ade54371 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.258869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530dc599-b6dc-4318-b5a5-cfb0ac04e279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:55.259481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e26a5-b512-4d6c-b559-0796ade54371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:55.259803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e26a5-b512-4d6c-b559-0796ade54371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:55.261200 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e26a5-b512-4d6c-b559-0796ade54371 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-530dc599-b6dc-4318-b5a5-cfb0ac04e279 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:55.265263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:55.266522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 251/490] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:15:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:55.267352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dc599-b6dc-4318-b5a5-cfb0ac04e279 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.274857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 240/491] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:55.276107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ac59c-f6e6-487c-b9fa-1fd9a69ec9b8 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.276514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ac59c-f6e6-487c-b9fa-1fd9a69ec9b8 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.277356 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ac59c-f6e6-487c-b9fa-1fd9a69ec9b8 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.279548 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 241/492] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:55.280549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ac59c-f6e6-487c-b9fa-1fd9a69ec9b8 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.317493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:55.403376 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dc599-b6dc-4318-b5a5-cfb0ac04e279 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.404098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ac59c-f6e6-487c-b9fa-1fd9a69ec9b8 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.455656 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772f0be-9d80-4789-b3c0-85b4c0716486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.456038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772f0be-9d80-4789-b3c0-85b4c0716486 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.456501 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772f0be-9d80-4789-b3c0-85b4c0716486 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.456702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3ba45-a38b-41cc-9963-6b274b470b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.456973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772f0be-9d80-4789-b3c0-85b4c0716486 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.457292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3ba45-a38b-41cc-9963-6b274b470b8f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.457644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3ba45-a38b-41cc-9963-6b274b470b8f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.457915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3ba45-a38b-41cc-9963-6b274b470b8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.458099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772f0be-9d80-4789-b3c0-85b4c0716486 None admin] RBAC: Adding query filter params (name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:55.458419 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772f0be-9d80-4789-b3c0-85b4c0716486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:55.460446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772f0be-9d80-4789-b3c0-85b4c0716486 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:55.471577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3ba45-a38b-41cc-9963-6b274b470b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:55.481289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 242/493] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:15:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:55.481289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772f0be-9d80-4789-b3c0-85b4c0716486 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-4aa3ba45-a38b-41cc-9963-6b274b470b8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:55.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:55.482409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 252/494] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:15:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:55.483232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaef280-3444-4f5c-b047-3b6578e31f88 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.483957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaef280-3444-4f5c-b047-3b6578e31f88 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.483957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaef280-3444-4f5c-b047-3b6578e31f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.505160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0aaef280-3444-4f5c-b047-3b6578e31f88 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:55.506440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0aaef280-3444-4f5c-b047-3b6578e31f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:55.551047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:55.596874 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 253/495] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:55.597778 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaef280-3444-4f5c-b047-3b6578e31f88 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.617992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:55.647218 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772f0be-9d80-4789-b3c0-85b4c0716486 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.691337 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4191b-ec0a-4c6a-a132-80c041bb4bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.692221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4191b-ec0a-4c6a-a132-80c041bb4bfc None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.692642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4191b-ec0a-4c6a-a132-80c041bb4bfc None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.693050 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4191b-ec0a-4c6a-a132-80c041bb4bfc None admin] PATH_INFO: `/v3/users/glance` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.706763 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4191b-ec0a-4c6a-a132-80c041bb4bfc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:55.708909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4191b-ec0a-4c6a-a132-80c041bb4bfc None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:55.725718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaef280-3444-4f5c-b047-3b6578e31f88 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-1fa4191b-ec0a-4c6a-a132-80c041bb4bfc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:15:55.726333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:55.727184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:55.728103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:55.728103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:55.728103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:15:55.728103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:15:55.728103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:15:55.728103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:15:55.728103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:15:55.728103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:15:55.728103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:15:55.728103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:55.731407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 243/496] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:55.732710 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4191b-ec0a-4c6a-a132-80c041bb4bfc None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.778932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0e58f-d131-4a79-96a9-b88de3000266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.779819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0e58f-d131-4a79-96a9-b88de3000266 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.780092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0e58f-d131-4a79-96a9-b88de3000266 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.780434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0e58f-d131-4a79-96a9-b88de3000266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.796788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0e58f-d131-4a79-96a9-b88de3000266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:55.798972 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0e58f-d131-4a79-96a9-b88de3000266 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-1ae0e58f-d131-4a79-96a9-b88de3000266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:55.818849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:55.819860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:55.820838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:55.820838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:55.820838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:55.825674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 254/497] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:55.827981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0e58f-d131-4a79-96a9-b88de3000266 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.859662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:55.862484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4191b-ec0a-4c6a-a132-80c041bb4bfc None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.903608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223a27-4a96-4ed0-8edc-35c4b4341178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.904221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223a27-4a96-4ed0-8edc-35c4b4341178 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.904505 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223a27-4a96-4ed0-8edc-35c4b4341178 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.904833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97223a27-4a96-4ed0-8edc-35c4b4341178 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.905512 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223a27-4a96-4ed0-8edc-35c4b4341178 None admin] RBAC: Adding query filter params (name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:55.905892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223a27-4a96-4ed0-8edc-35c4b4341178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:55.907286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97223a27-4a96-4ed0-8edc-35c4b4341178 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:55.915623 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:55.922045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 244/498] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:15:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:55.922045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223a27-4a96-4ed0-8edc-35c4b4341178 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:55.955034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0e58f-d131-4a79-96a9-b88de3000266 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:55.990061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858ea6c-964f-4061-a7c6-7cba3e50d2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:55.990664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858ea6c-964f-4061-a7c6-7cba3e50d2a6 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:55.990947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858ea6c-964f-4061-a7c6-7cba3e50d2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:55.991222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858ea6c-964f-4061-a7c6-7cba3e50d2a6 None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:55.991984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858ea6c-964f-4061-a7c6-7cba3e50d2a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:55.992291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858ea6c-964f-4061-a7c6-7cba3e50d2a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:55.993814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858ea6c-964f-4061-a7c6-7cba3e50d2a6 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:56.022466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97223a27-4a96-4ed0-8edc-35c4b4341178 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:56.030551 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 255/499] 10.222.0.74 () {56 vars in 1137 bytes} [Wed Aug 31 00:15:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:56.031797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bea4-10c5-40a5-870f-aac62094e3ee None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.032085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bea4-10c5-40a5-870f-aac62094e3ee None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.032368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16bea4-10c5-40a5-870f-aac62094e3ee None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.033566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 256/500] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:15:56.034268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16bea4-10c5-40a5-870f-aac62094e3ee None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:56.059696 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5e64b-458a-4464-89aa-a9e387872d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:56.060316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e64b-458a-4464-89aa-a9e387872d9e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.063150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e64b-458a-4464-89aa-a9e387872d9e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.063150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5e64b-458a-4464-89aa-a9e387872d9e None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.063150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5e64b-458a-4464-89aa-a9e387872d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:56.063150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5e64b-458a-4464-89aa-a9e387872d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:56.063150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5e64b-458a-4464-89aa-a9e387872d9e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:56.076307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 245/501] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:56.077196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5e64b-458a-4464-89aa-a9e387872d9e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:56.103188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:56.154610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16bea4-10c5-40a5-870f-aac62094e3ee None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:56.181472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:56.192546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204e707-139e-4a00-8620-377d98e6fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:56.193178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204e707-139e-4a00-8620-377d98e6fb70 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.193460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204e707-139e-4a00-8620-377d98e6fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.193773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204e707-139e-4a00-8620-377d98e6fb70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.194511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5e64b-458a-4464-89aa-a9e387872d9e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:56.204993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204e707-139e-4a00-8620-377d98e6fb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:56.206637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204e707-139e-4a00-8620-377d98e6fb70 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-9204e707-139e-4a00-8620-377d98e6fb70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:56.224898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:56.225952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:56.226879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:56.226879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:56.226879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:56.226879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 257/502] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:56.226879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204e707-139e-4a00-8620-377d98e6fb70 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:56.237066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df592969-3145-48d1-843a-d7a711d22bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:56.237742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592969-3145-48d1-843a-d7a711d22bc6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.238031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592969-3145-48d1-843a-d7a711d22bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.238310 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df592969-3145-48d1-843a-d7a711d22bc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.249439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df592969-3145-48d1-843a-d7a711d22bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-df592969-3145-48d1-843a-d7a711d22bc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:15:56.254558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:56.255460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:15:56.256317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:56.260492 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 246/503] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:15:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:56.262337 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b5d50-7f31-4c9d-8d79-0643549b9183 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.262622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b5d50-7f31-4c9d-8d79-0643549b9183 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.262899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b5d50-7f31-4c9d-8d79-0643549b9183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.284007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-613b5d50-7f31-4c9d-8d79-0643549b9183 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:56.285235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-613b5d50-7f31-4c9d-8d79-0643549b9183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:15:56.336153 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204e707-139e-4a00-8620-377d98e6fb70 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:56.358325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 247/504] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:15:56.359206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b5d50-7f31-4c9d-8d79-0643549b9183 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:56.373649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:56.396045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af13cf4-eb78-44a8-a0fa-4f6dcfcb0706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:56.397491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af13cf4-eb78-44a8-a0fa-4f6dcfcb0706 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.397816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af13cf4-eb78-44a8-a0fa-4f6dcfcb0706 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.398149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af13cf4-eb78-44a8-a0fa-4f6dcfcb0706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.461882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:56.491648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b5d50-7f31-4c9d-8d79-0643549b9183 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:56.501158 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af13cf4-eb78-44a8-a0fa-4f6dcfcb0706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:56.503183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af13cf4-eb78-44a8-a0fa-4f6dcfcb0706 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:56.536497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e2511-ef26-4c18-8ee5-f647ad6d7d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:56.537138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e2511-ef26-4c18-8ee5-f647ad6d7d05 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.537414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e2511-ef26-4c18-8ee5-f647ad6d7d05 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.539456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e2511-ef26-4c18-8ee5-f647ad6d7d05 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.548039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e2511-ef26-4c18-8ee5-f647ad6d7d05 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:56.549507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e2511-ef26-4c18-8ee5-f647ad6d7d05 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-566e2511-ef26-4c18-8ee5-f647ad6d7d05 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:15:56.563268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:56.564427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:56.565329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:56.565329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:56.565329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:15:56.565329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:15:56.565329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:15:56.565329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:15:56.565329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:15:56.565329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:15:56.565329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:15:56.565329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:56.565329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 248/505] 10.222.0.74 () {56 vars in 1093 bytes} [Wed Aug 31 00:15:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:56.565934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e2511-ef26-4c18-8ee5-f647ad6d7d05 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:56.629886 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 258/506] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:56.630877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af13cf4-eb78-44a8-a0fa-4f6dcfcb0706 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:56.639262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:56.669054 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e2511-ef26-4c18-8ee5-f647ad6d7d05 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:56.706675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478400b-fdbd-4f5c-b25f-7d1d031e8554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:56.707288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478400b-fdbd-4f5c-b25f-7d1d031e8554 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.707569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478400b-fdbd-4f5c-b25f-7d1d031e8554 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.707842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478400b-fdbd-4f5c-b25f-7d1d031e8554 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.708489 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478400b-fdbd-4f5c-b25f-7d1d031e8554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:56.708795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478400b-fdbd-4f5c-b25f-7d1d031e8554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:56.710231 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478400b-fdbd-4f5c-b25f-7d1d031e8554 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:56.713605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:56.723537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 249/507] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:56.727410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478400b-fdbd-4f5c-b25f-7d1d031e8554 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:56.742560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af13cf4-eb78-44a8-a0fa-4f6dcfcb0706 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:56.783951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a0dc-898e-4ae8-9380-cb9cfd1483c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:56.784562 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a0dc-898e-4ae8-9380-cb9cfd1483c0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.784842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a0dc-898e-4ae8-9380-cb9cfd1483c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.785115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4a0dc-898e-4ae8-9380-cb9cfd1483c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.785807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a0dc-898e-4ae8-9380-cb9cfd1483c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:56.786157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a0dc-898e-4ae8-9380-cb9cfd1483c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:56.787561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4a0dc-898e-4ae8-9380-cb9cfd1483c0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:56.796848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 259/508] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:15:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:56.797701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a0dc-898e-4ae8-9380-cb9cfd1483c0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:56.832632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478400b-fdbd-4f5c-b25f-7d1d031e8554 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:56.865413 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:56.870309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b5c92-302a-4cbd-9377-87d42c447df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:56.870949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b5c92-302a-4cbd-9377-87d42c447df0 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.871223 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b5c92-302a-4cbd-9377-87d42c447df0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.871501 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b5c92-302a-4cbd-9377-87d42c447df0 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.872237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b5c92-302a-4cbd-9377-87d42c447df0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:56.872607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b5c92-302a-4cbd-9377-87d42c447df0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:56.874161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b5c92-302a-4cbd-9377-87d42c447df0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:56.907123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4a0dc-898e-4ae8-9380-cb9cfd1483c0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:56.912975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 250/509] 10.222.0.74 () {56 vars in 1133 bytes} [Wed Aug 31 00:15:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:56.913856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b5c92-302a-4cbd-9377-87d42c447df0 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:56.945140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b33b4-4e0f-4306-8546-408d74033e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:56.945806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b33b4-4e0f-4306-8546-408d74033e75 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:56.946088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b33b4-4e0f-4306-8546-408d74033e75 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:56.946367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b33b4-4e0f-4306-8546-408d74033e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:56.955335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:56.959039 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b33b4-4e0f-4306-8546-408d74033e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:56.960551 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b33b4-4e0f-4306-8546-408d74033e75 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-9d9b33b4-4e0f-4306-8546-408d74033e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:56.975697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:56.976694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:56.978458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:56.978458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:56.978458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:56.978458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 260/510] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:56.978458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b33b4-4e0f-4306-8546-408d74033e75 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.027624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b5c92-302a-4cbd-9377-87d42c447df0 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.063899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad266c5-14c3-4b86-afbc-69e61b20438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.064535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad266c5-14c3-4b86-afbc-69e61b20438f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.064815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad266c5-14c3-4b86-afbc-69e61b20438f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.065090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad266c5-14c3-4b86-afbc-69e61b20438f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.076852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad266c5-14c3-4b86-afbc-69e61b20438f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.079103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad266c5-14c3-4b86-afbc-69e61b20438f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.092002 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b33b4-4e0f-4306-8546-408d74033e75 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-aad266c5-14c3-4b86-afbc-69e61b20438f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:57.098905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:57.100015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:57.101002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:57.101002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:57.101002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:57.101002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 251/511] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:57.101002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad266c5-14c3-4b86-afbc-69e61b20438f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.130024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e381b-b692-4b41-b44a-4e0e90265557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.130657 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e381b-b692-4b41-b44a-4e0e90265557 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.130937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e381b-b692-4b41-b44a-4e0e90265557 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.131210 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e381b-b692-4b41-b44a-4e0e90265557 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.139369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e381b-b692-4b41-b44a-4e0e90265557 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.140834 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e381b-b692-4b41-b44a-4e0e90265557 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.149335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-289e381b-b692-4b41-b44a-4e0e90265557 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:15:57.153607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:57.154535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:57.155451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:57.155451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:57.155451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:15:57.155451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:15:57.155451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:15:57.155451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:15:57.155451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:15:57.155451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:15:57.155451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:15:57.155451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:57.155451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 261/512] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:15:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:57.156006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e381b-b692-4b41-b44a-4e0e90265557 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.207625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:57.210294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad266c5-14c3-4b86-afbc-69e61b20438f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.244787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f9914-bc86-4575-acc3-68b72b82ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.245422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f9914-bc86-4575-acc3-68b72b82ca1f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.246577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f9914-bc86-4575-acc3-68b72b82ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.246846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f9914-bc86-4575-acc3-68b72b82ca1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.257661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f9914-bc86-4575-acc3-68b72b82ca1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.259144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f9914-bc86-4575-acc3-68b72b82ca1f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.263772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e381b-b692-4b41-b44a-4e0e90265557 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-048f9914-bc86-4575-acc3-68b72b82ca1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:57.273921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:57.274931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:57.275847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:57.275847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:57.275847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:57.275847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 252/513] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:57.276281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f9914-bc86-4575-acc3-68b72b82ca1f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.304291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6274cb-de1c-43e8-90c9-5ef9f6648706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.304902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6274cb-de1c-43e8-90c9-5ef9f6648706 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.305185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6274cb-de1c-43e8-90c9-5ef9f6648706 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.305467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6274cb-de1c-43e8-90c9-5ef9f6648706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.375761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:57.376763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6274cb-de1c-43e8-90c9-5ef9f6648706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.378290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6274cb-de1c-43e8-90c9-5ef9f6648706 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.382836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f9914-bc86-4575-acc3-68b72b82ca1f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.417224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828e830-7e27-4616-80c4-a84fa032c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.418670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828e830-7e27-4616-80c4-a84fa032c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.418956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828e830-7e27-4616-80c4-a84fa032c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.419585 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828e830-7e27-4616-80c4-a84fa032c9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.420125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828e830-7e27-4616-80c4-a84fa032c9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:57.420424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828e830-7e27-4616-80c4-a84fa032c9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.421811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828e830-7e27-4616-80c4-a84fa032c9a2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.427691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:57.433125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 253/514] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:57.434170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828e830-7e27-4616-80c4-a84fa032c9a2 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.481048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 262/515] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:57.481996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6274cb-de1c-43e8-90c9-5ef9f6648706 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.540277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828e830-7e27-4616-80c4-a84fa032c9a2 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.577219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535134-a051-402c-b415-6e8ad0a20a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.577855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535134-a051-402c-b415-6e8ad0a20a08 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.578191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535134-a051-402c-b415-6e8ad0a20a08 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.578465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98535134-a051-402c-b415-6e8ad0a20a08 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.579111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98535134-a051-402c-b415-6e8ad0a20a08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:57.579413 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98535134-a051-402c-b415-6e8ad0a20a08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.580788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98535134-a051-402c-b415-6e8ad0a20a08 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.592972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 254/516] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:57.594050 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535134-a051-402c-b415-6e8ad0a20a08 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.594165 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6274cb-de1c-43e8-90c9-5ef9f6648706 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.609416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:57.630575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0286dd-7a6d-4c86-a33f-40dc85f7d53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.631185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0286dd-7a6d-4c86-a33f-40dc85f7d53e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.631468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0286dd-7a6d-4c86-a33f-40dc85f7d53e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.631742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0286dd-7a6d-4c86-a33f-40dc85f7d53e None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.632471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0286dd-7a6d-4c86-a33f-40dc85f7d53e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:57.632780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0286dd-7a6d-4c86-a33f-40dc85f7d53e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.634265 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0286dd-7a6d-4c86-a33f-40dc85f7d53e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.652411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 263/517] 10.222.0.74 () {56 vars in 1137 bytes} [Wed Aug 31 00:15:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:57.653209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0286dd-7a6d-4c86-a33f-40dc85f7d53e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.663853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:57.698458 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98535134-a051-402c-b415-6e8ad0a20a08 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.739739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58266b04-dae5-4832-abdc-3cf3a4ab9f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.739739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58266b04-dae5-4832-abdc-3cf3a4ab9f13 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.739739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58266b04-dae5-4832-abdc-3cf3a4ab9f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.739739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58266b04-dae5-4832-abdc-3cf3a4ab9f13 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.743725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58266b04-dae5-4832-abdc-3cf3a4ab9f13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:57.743725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58266b04-dae5-4832-abdc-3cf3a4ab9f13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.743725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58266b04-dae5-4832-abdc-3cf3a4ab9f13 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.755278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 255/518] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:57.756127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58266b04-dae5-4832-abdc-3cf3a4ab9f13 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.771110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0286dd-7a6d-4c86-a33f-40dc85f7d53e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.810474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793655c1-4014-4dc2-a395-ca10e775e1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.811324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793655c1-4014-4dc2-a395-ca10e775e1ca None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.811777 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793655c1-4014-4dc2-a395-ca10e775e1ca None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.812227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793655c1-4014-4dc2-a395-ca10e775e1ca None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.813293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793655c1-4014-4dc2-a395-ca10e775e1ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.815767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793655c1-4014-4dc2-a395-ca10e775e1ca None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.857352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:57.883649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58266b04-dae5-4832-abdc-3cf3a4ab9f13 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:57.921607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 264/519] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:15:57 2022] POST /identity/v3/users => generated 247 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:15:57.921607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793655c1-4014-4dc2-a395-ca10e775e1ca None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.921893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f53093-f168-4dfa-8bf7-ef7d212e4d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:57.921893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53093-f168-4dfa-8bf7-ef7d212e4d46 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:57.921893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53093-f168-4dfa-8bf7-ef7d212e4d46 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:57.922152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f53093-f168-4dfa-8bf7-ef7d212e4d46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:57.939071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f53093-f168-4dfa-8bf7-ef7d212e4d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:57.940600 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f53093-f168-4dfa-8bf7-ef7d212e4d46 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-29f53093-f168-4dfa-8bf7-ef7d212e4d46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:57.956938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:57.958157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:57.959046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:57.959046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:57.959046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:57.959046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 256/520] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:57.959046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f53093-f168-4dfa-8bf7-ef7d212e4d46 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:57.992828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:58.037448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793655c1-4014-4dc2-a395-ca10e775e1ca None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.079863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db8b22-72a9-46e4-b921-3a82492a052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.080430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db8b22-72a9-46e4-b921-3a82492a052d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.081080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db8b22-72a9-46e4-b921-3a82492a052d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.081080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db8b22-72a9-46e4-b921-3a82492a052d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.087221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f53093-f168-4dfa-8bf7-ef7d212e4d46 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.089171 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db8b22-72a9-46e4-b921-3a82492a052d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.091768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db8b22-72a9-46e4-b921-3a82492a052d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-d6db8b22-72a9-46e4-b921-3a82492a052d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:15:58.110553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:58.111487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:58.112478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:15:58.112478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:15:58.112478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:15:58.112478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:15:58.112478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:15:58.112478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:15:58.112478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:15:58.112478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:58.112478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 265/521] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:58.112979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db8b22-72a9-46e4-b921-3a82492a052d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.133073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:58.144045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b317be-227e-4792-b1d0-8e92b347209c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.152180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b317be-227e-4792-b1d0-8e92b347209c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.152180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b317be-227e-4792-b1d0-8e92b347209c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.152180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b317be-227e-4792-b1d0-8e92b347209c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.227051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b317be-227e-4792-b1d0-8e92b347209c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.228644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b317be-227e-4792-b1d0-8e92b347209c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.229426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db8b22-72a9-46e4-b921-3a82492a052d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.257073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:58.269116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9170d-c98c-497a-ae26-d0b4aba63633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.275198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9170d-c98c-497a-ae26-d0b4aba63633 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.275198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9170d-c98c-497a-ae26-d0b4aba63633 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.275198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9170d-c98c-497a-ae26-d0b4aba63633 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.278895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9170d-c98c-497a-ae26-d0b4aba63633 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.280360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9170d-c98c-497a-ae26-d0b4aba63633 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-aad9170d-c98c-497a-ae26-d0b4aba63633 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:15:58.292727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:58.294123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 266/522] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:15:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:58.295607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9170d-c98c-497a-ae26-d0b4aba63633 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.358943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 257/523] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:58.360060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b317be-227e-4792-b1d0-8e92b347209c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.389678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:58.416057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9170d-c98c-497a-ae26-d0b4aba63633 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.459494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b46e3-0b3f-445f-b0ce-02b1153f89b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.460109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b46e3-0b3f-445f-b0ce-02b1153f89b4 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.460389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b46e3-0b3f-445f-b0ce-02b1153f89b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.460667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b46e3-0b3f-445f-b0ce-02b1153f89b4 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.461393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b46e3-0b3f-445f-b0ce-02b1153f89b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:58.461679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b46e3-0b3f-445f-b0ce-02b1153f89b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.463128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b46e3-0b3f-445f-b0ce-02b1153f89b4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.474681 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b317be-227e-4792-b1d0-8e92b347209c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.482720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 267/524] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:58.483730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b46e3-0b3f-445f-b0ce-02b1153f89b4 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.512780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345f3d8-8cd0-426a-8245-b17e3db5d308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.513386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345f3d8-8cd0-426a-8245-b17e3db5d308 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.513773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345f3d8-8cd0-426a-8245-b17e3db5d308 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.514052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345f3d8-8cd0-426a-8245-b17e3db5d308 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.514744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345f3d8-8cd0-426a-8245-b17e3db5d308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:58.515047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345f3d8-8cd0-426a-8245-b17e3db5d308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.516474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345f3d8-8cd0-426a-8245-b17e3db5d308 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.534457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:58.534899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 258/525] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:58.535737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345f3d8-8cd0-426a-8245-b17e3db5d308 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.604392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b46e3-0b3f-445f-b0ce-02b1153f89b4 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.625968 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:58.641539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5656d75-7b09-401f-bd79-689ef620c17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.642000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345f3d8-8cd0-426a-8245-b17e3db5d308 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.642229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5656d75-7b09-401f-bd79-689ef620c17b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.642513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5656d75-7b09-401f-bd79-689ef620c17b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.642857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5656d75-7b09-401f-bd79-689ef620c17b None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.643569 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5656d75-7b09-401f-bd79-689ef620c17b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:58.643878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5656d75-7b09-401f-bd79-689ef620c17b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.645324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5656d75-7b09-401f-bd79-689ef620c17b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.663968 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 268/526] 10.222.0.74 () {56 vars in 1139 bytes} [Wed Aug 31 00:15:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:58.664866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5656d75-7b09-401f-bd79-689ef620c17b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.682323 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddb2fd-cbed-4ff2-9032-4fcf94980fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.683084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddb2fd-cbed-4ff2-9032-4fcf94980fea None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.683385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddb2fd-cbed-4ff2-9032-4fcf94980fea None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.683660 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddb2fd-cbed-4ff2-9032-4fcf94980fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.694003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddb2fd-cbed-4ff2-9032-4fcf94980fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.695463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddb2fd-cbed-4ff2-9032-4fcf94980fea None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-efddb2fd-cbed-4ff2-9032-4fcf94980fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:58.710969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:58.711916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:58.712821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:58.712821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:58.712821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:58.712821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 259/527] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:58.712821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddb2fd-cbed-4ff2-9032-4fcf94980fea None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.781833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5656d75-7b09-401f-bd79-689ef620c17b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.783472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:58.821822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352bef2-a533-415a-97e7-47392adce939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.822450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352bef2-a533-415a-97e7-47392adce939 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.822726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352bef2-a533-415a-97e7-47392adce939 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.823000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e352bef2-a533-415a-97e7-47392adce939 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.827035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddb2fd-cbed-4ff2-9032-4fcf94980fea None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:58.830517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352bef2-a533-415a-97e7-47392adce939 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.831977 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e352bef2-a533-415a-97e7-47392adce939 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-e352bef2-a533-415a-97e7-47392adce939 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:15:58.843536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:58.844431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:58.845353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:15:58.845353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:15:58.845353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:15:58.845353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:15:58.845353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:15:58.845353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:15:58.845353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:15:58.845353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:58.845353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 269/528] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:58.845849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352bef2-a533-415a-97e7-47392adce939 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.869193 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e2d62-eedd-47d8-8353-fbc78db9d179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:58.869829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e2d62-eedd-47d8-8353-fbc78db9d179 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:58.870114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e2d62-eedd-47d8-8353-fbc78db9d179 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:58.870992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e2d62-eedd-47d8-8353-fbc78db9d179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:58.871917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e2d62-eedd-47d8-8353-fbc78db9d179 None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=d8590378b14c49cf9266a0d859db5bf0) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:58.872347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e2d62-eedd-47d8-8353-fbc78db9d179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:58.873806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e2d62-eedd-47d8-8353-fbc78db9d179 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:58.880733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 260/529] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:58 2022] GET /identity/v3/role_assignments?user.id=d8590378b14c49cf9266a0d859db5bf0&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:58.882422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e2d62-eedd-47d8-8353-fbc78db9d179 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:58.885526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:58.987505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e352bef2-a533-415a-97e7-47392adce939 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.029038 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad593b-6c3b-4483-b3ef-475a9e2d3397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.029696 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad593b-6c3b-4483-b3ef-475a9e2d3397 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.029696 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad593b-6c3b-4483-b3ef-475a9e2d3397 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.029982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad593b-6c3b-4483-b3ef-475a9e2d3397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.042112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e2d62-eedd-47d8-8353-fbc78db9d179 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.064600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:59.089635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8bba3-731b-4560-a4ad-3fa343bb86cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.090916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8bba3-731b-4560-a4ad-3fa343bb86cf None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.091705 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8bba3-731b-4560-a4ad-3fa343bb86cf None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.092150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8bba3-731b-4560-a4ad-3fa343bb86cf None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.093199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8bba3-731b-4560-a4ad-3fa343bb86cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:59.093501 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8bba3-731b-4560-a4ad-3fa343bb86cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.095585 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8bba3-731b-4560-a4ad-3fa343bb86cf None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.111616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad593b-6c3b-4483-b3ef-475a9e2d3397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.113093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad593b-6c3b-4483-b3ef-475a9e2d3397 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.117063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 261/530] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:59.118303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8bba3-731b-4560-a4ad-3fa343bb86cf None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.203038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:59.237439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 270/531] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:15:59.239636 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad593b-6c3b-4483-b3ef-475a9e2d3397 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.246899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8bba3-731b-4560-a4ad-3fa343bb86cf None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.285037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c5d2f-c98a-408d-8a85-b4fb2e26af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.285688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5d2f-c98a-408d-8a85-b4fb2e26af7b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.285975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5d2f-c98a-408d-8a85-b4fb2e26af7b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.286385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5d2f-c98a-408d-8a85-b4fb2e26af7b None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.287053 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c5d2f-c98a-408d-8a85-b4fb2e26af7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:59.287367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c5d2f-c98a-408d-8a85-b4fb2e26af7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.289090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c5d2f-c98a-408d-8a85-b4fb2e26af7b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.302932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 262/532] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:15:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:59.303607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c5d2f-c98a-408d-8a85-b4fb2e26af7b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.321984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:59.379440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad593b-6c3b-4483-b3ef-475a9e2d3397 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.424190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c5d2f-c98a-408d-8a85-b4fb2e26af7b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.424961 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eb862-0ede-4afb-a2f6-80f6063484e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.426285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eb862-0ede-4afb-a2f6-80f6063484e5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.426748 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eb862-0ede-4afb-a2f6-80f6063484e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.428159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eb862-0ede-4afb-a2f6-80f6063484e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.438712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900eb862-0ede-4afb-a2f6-80f6063484e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.441005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900eb862-0ede-4afb-a2f6-80f6063484e5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.452681 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-900eb862-0ede-4afb-a2f6-80f6063484e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:15:59.456654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:59.457516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:59.458398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:15:59.458398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:15:59.458398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:15:59.458398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:15:59.458398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:15:59.458398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:15:59.458398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:15:59.458398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:15:59.458398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 271/533] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:59.459406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eb862-0ede-4afb-a2f6-80f6063484e5 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.472442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087031ca-b746-4d4f-92d4-0ee795aab55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.473737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087031ca-b746-4d4f-92d4-0ee795aab55a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.474330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087031ca-b746-4d4f-92d4-0ee795aab55a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.474900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087031ca-b746-4d4f-92d4-0ee795aab55a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.490018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087031ca-b746-4d4f-92d4-0ee795aab55a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.492327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087031ca-b746-4d4f-92d4-0ee795aab55a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-087031ca-b746-4d4f-92d4-0ee795aab55a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:15:59.511273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:15:59.512379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:15:59.513410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:15:59.513410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:15:59.513410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:15:59.515810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 263/534] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:15:59.516769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087031ca-b746-4d4f-92d4-0ee795aab55a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.592339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eb862-0ede-4afb-a2f6-80f6063484e5 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.624201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:59.632595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087031ca-b746-4d4f-92d4-0ee795aab55a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.637712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21251e-43a0-421b-950f-592282b065bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.638130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21251e-43a0-421b-950f-592282b065bd None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.638797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21251e-43a0-421b-950f-592282b065bd None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.639219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21251e-43a0-421b-950f-592282b065bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.640084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21251e-43a0-421b-950f-592282b065bd None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=90147848fe604ca9912d10a214a45227) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:59.640545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21251e-43a0-421b-950f-592282b065bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.642288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21251e-43a0-421b-950f-592282b065bd None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.648388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 272/535] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:59 2022] GET /identity/v3/role_assignments?user.id=90147848fe604ca9912d10a214a45227&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:59.649514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21251e-43a0-421b-950f-592282b065bd None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.672698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77402beb-7af1-4dc2-845a-5a1239bce32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.673500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402beb-7af1-4dc2-845a-5a1239bce32a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.673884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402beb-7af1-4dc2-845a-5a1239bce32a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.674232 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77402beb-7af1-4dc2-845a-5a1239bce32a None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.675261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77402beb-7af1-4dc2-845a-5a1239bce32a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:59.675653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77402beb-7af1-4dc2-845a-5a1239bce32a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.677249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77402beb-7af1-4dc2-845a-5a1239bce32a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.692085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 264/536] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:15:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:59.700678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77402beb-7af1-4dc2-845a-5a1239bce32a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.761716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:59.771129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21251e-43a0-421b-950f-592282b065bd None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.814598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327867f9-4e46-4cca-92be-c68eb34d9336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.815553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327867f9-4e46-4cca-92be-c68eb34d9336 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.818120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327867f9-4e46-4cca-92be-c68eb34d9336 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.818664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327867f9-4e46-4cca-92be-c68eb34d9336 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.820001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327867f9-4e46-4cca-92be-c68eb34d9336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:59.822074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327867f9-4e46-4cca-92be-c68eb34d9336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.824366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327867f9-4e46-4cca-92be-c68eb34d9336 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.861587 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 273/537] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:59.863308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77402beb-7af1-4dc2-845a-5a1239bce32a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:15:59.867967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327867f9-4e46-4cca-92be-c68eb34d9336 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:15:59.909801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5fc7f-e94d-437c-9222-aef83c6880d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:15:59.912596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5fc7f-e94d-437c-9222-aef83c6880d4 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.913786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5fc7f-e94d-437c-9222-aef83c6880d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.914747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5fc7f-e94d-437c-9222-aef83c6880d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.918055 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5fc7f-e94d-437c-9222-aef83c6880d4 None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=75f62fa62f2d420a998f236ff7f9b6b9) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:15:59.918631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5fc7f-e94d-437c-9222-aef83c6880d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:15:59.920537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5fc7f-e94d-437c-9222-aef83c6880d4 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:15:59.932941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 265/538] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:15:59 2022] GET /identity/v3/role_assignments?user.id=75f62fa62f2d420a998f236ff7f9b6b9&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:15:59.962651 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:15:59.968505 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da5dac-efb8-4708-825d-0a78a6530e0b None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.968716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da5dac-efb8-4708-825d-0a78a6530e0b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.968999 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da5dac-efb8-4708-825d-0a78a6530e0b None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.970697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 266/539] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:15:59.976683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d7de5-a5ff-4f74-a02f-094245fd09cf None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:15:59.976962 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d7de5-a5ff-4f74-a02f-094245fd09cf None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:15:59.977231 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d7de5-a5ff-4f74-a02f-094245fd09cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:15:59.997804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-6f9d7de5-a5ff-4f74-a02f-094245fd09cf None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:15:59.999023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6f9d7de5-a5ff-4f74-a02f-094245fd09cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:00.031711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327867f9-4e46-4cca-92be-c68eb34d9336 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:00.109524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedc1dc-2b8c-4e5d-8b25-4af53a2ac595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:00.110706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedc1dc-2b8c-4e5d-8b25-4af53a2ac595 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:00.111167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedc1dc-2b8c-4e5d-8b25-4af53a2ac595 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:00.111787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedc1dc-2b8c-4e5d-8b25-4af53a2ac595 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:00.122697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedc1dc-2b8c-4e5d-8b25-4af53a2ac595 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:00.124597 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedc1dc-2b8c-4e5d-8b25-4af53a2ac595 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:00.134685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 267/540] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-fcedc1dc-2b8c-4e5d-8b25-4af53a2ac595 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:00.139554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:00.140576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:00.141494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:00.141494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:00.141494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:00.141494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:00.141494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:00.141494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:00.141494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:00.141494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:00.142986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 274/541] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:15:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:00.148840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d7de5-a5ff-4f74-a02f-094245fd09cf None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:00.198030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:00.262997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d7de5-a5ff-4f74-a02f-094245fd09cf None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:00.299352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7532154-dcaf-4926-b426-af823d69e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:00.300002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7532154-dcaf-4926-b426-af823d69e0fb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:00.300410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7532154-dcaf-4926-b426-af823d69e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:00.300697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7532154-dcaf-4926-b426-af823d69e0fb None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:00.301405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7532154-dcaf-4926-b426-af823d69e0fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:00.301746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7532154-dcaf-4926-b426-af823d69e0fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:00.303565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7532154-dcaf-4926-b426-af823d69e0fb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:00.317304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 268/542] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:00.323278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedc1dc-2b8c-4e5d-8b25-4af53a2ac595 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:00.446220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedc1dc-2b8c-4e5d-8b25-4af53a2ac595 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:00.455680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:00.495649 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ece3ab-d3d6-455a-9895-fe42c12f7a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:00.496349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ece3ab-d3d6-455a-9895-fe42c12f7a32 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:00.496625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ece3ab-d3d6-455a-9895-fe42c12f7a32 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:00.496896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ece3ab-d3d6-455a-9895-fe42c12f7a32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:00.497641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ece3ab-d3d6-455a-9895-fe42c12f7a32 None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=6f5149b369e34afca6dd41a0082701e6) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:00.497953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ece3ab-d3d6-455a-9895-fe42c12f7a32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:00.499378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ece3ab-d3d6-455a-9895-fe42c12f7a32 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:00.509805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 275/543] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:00 2022] GET /identity/v3/role_assignments?user.id=6f5149b369e34afca6dd41a0082701e6&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:00.577451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7532154-dcaf-4926-b426-af823d69e0fb None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:00.679904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:00.692487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7532154-dcaf-4926-b426-af823d69e0fb None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:00.728644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773130a9-b1aa-4c10-b966-e5923f19231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:00.729301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773130a9-b1aa-4c10-b966-e5923f19231c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:00.729676 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773130a9-b1aa-4c10-b966-e5923f19231c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:00.729981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773130a9-b1aa-4c10-b966-e5923f19231c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:00.740904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773130a9-b1aa-4c10-b966-e5923f19231c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-773130a9-b1aa-4c10-b966-e5923f19231c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:00.746040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:00.747103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:00.748089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:00.750869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 269/544] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:00.758669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ece3ab-d3d6-455a-9895-fe42c12f7a32 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:00.905267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ece3ab-d3d6-455a-9895-fe42c12f7a32 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:00.954328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5062b8-17dc-4018-9b7e-a5f1fd63c1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:00.954962 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5062b8-17dc-4018-9b7e-a5f1fd63c1e2 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:00.955242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5062b8-17dc-4018-9b7e-a5f1fd63c1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:00.955517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5062b8-17dc-4018-9b7e-a5f1fd63c1e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:00.956196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5062b8-17dc-4018-9b7e-a5f1fd63c1e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:00.956497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5062b8-17dc-4018-9b7e-a5f1fd63c1e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:00.957929 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5062b8-17dc-4018-9b7e-a5f1fd63c1e2 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:00.968180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 276/545] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:00.973647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773130a9-b1aa-4c10-b966-e5923f19231c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:01.065221 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1022-e396-4dd4-a087-bcfdeb7e5b45 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:01.065751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1022-e396-4dd4-a087-bcfdeb7e5b45 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:01.065824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1022-e396-4dd4-a087-bcfdeb7e5b45 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:01.068376 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 277/546] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:16:01.072509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915ad2-5e41-4526-8a00-815477d3122a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:01.072799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915ad2-5e41-4526-8a00-815477d3122a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:01.073074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915ad2-5e41-4526-8a00-815477d3122a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:01.093453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-51915ad2-5e41-4526-8a00-815477d3122a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:01.094769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-51915ad2-5e41-4526-8a00-815477d3122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:01.123187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:01.157189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773130a9-b1aa-4c10-b966-e5923f19231c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:01.205248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 278/547] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:16:01.215219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c104d-b4fb-41cc-9281-4989b56d5573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:01.215980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c104d-b4fb-41cc-9281-4989b56d5573 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:01.216353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c104d-b4fb-41cc-9281-4989b56d5573 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:01.216700 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c104d-b4fb-41cc-9281-4989b56d5573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:01.228360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c104d-b4fb-41cc-9281-4989b56d5573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:01.230091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c104d-b4fb-41cc-9281-4989b56d5573 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:01.243704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-944c104d-b4fb-41cc-9281-4989b56d5573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:01.256256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:01.257392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:01.258964 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:01.258964 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:01.258964 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:01.259959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 270/548] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:01.266478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915ad2-5e41-4526-8a00-815477d3122a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:01.415363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915ad2-5e41-4526-8a00-815477d3122a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:01.466509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cc50f-f3e2-4a06-8ebd-50cfcddd31cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:01.467370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cc50f-f3e2-4a06-8ebd-50cfcddd31cc None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:01.467786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cc50f-f3e2-4a06-8ebd-50cfcddd31cc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:01.468296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cc50f-f3e2-4a06-8ebd-50cfcddd31cc None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:01.469089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cc50f-f3e2-4a06-8ebd-50cfcddd31cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:01.469634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cc50f-f3e2-4a06-8ebd-50cfcddd31cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:01.471164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cc50f-f3e2-4a06-8ebd-50cfcddd31cc None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:01.488504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 279/549] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:01.494381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c104d-b4fb-41cc-9281-4989b56d5573 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:01.552433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cc50f-f3e2-4a06-8ebd-50cfcddd31cc None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:01.597924 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:01.665922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c104d-b4fb-41cc-9281-4989b56d5573 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:01.718346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8316d1a-c2f7-4364-8a6f-57ecf3934c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:01.719007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8316d1a-c2f7-4364-8a6f-57ecf3934c0f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:01.719286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8316d1a-c2f7-4364-8a6f-57ecf3934c0f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:01.719559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8316d1a-c2f7-4364-8a6f-57ecf3934c0f None admin] PATH_INFO: `/v3/users/swift` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:01.727006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cc50f-f3e2-4a06-8ebd-50cfcddd31cc None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:01.727857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8316d1a-c2f7-4364-8a6f-57ecf3934c0f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:01.729307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8316d1a-c2f7-4364-8a6f-57ecf3934c0f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:01.763068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4714-8362-4eaf-91cf-2eff31db209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:01.764022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4714-8362-4eaf-91cf-2eff31db209e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:01.764134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4714-8362-4eaf-91cf-2eff31db209e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:01.764350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f4714-8362-4eaf-91cf-2eff31db209e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-a8316d1a-c2f7-4364-8a6f-57ecf3934c0f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:01.764848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:01.765786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:01.766752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:01.766752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:01.766752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:01.766752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:01.766752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:01.766752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:01.766752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:01.766752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:01.766752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:01.766752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:01.766752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 271/550] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:01.772237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8316d1a-c2f7-4364-8a6f-57ecf3934c0f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:01.796156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f4714-8362-4eaf-91cf-2eff31db209e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-544f4714-8362-4eaf-91cf-2eff31db209e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:01.801955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:01.802983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:01.803848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 280/551] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:01.812835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4714-8362-4eaf-91cf-2eff31db209e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:01.927093 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:01.946955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:01.966311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f4714-8362-4eaf-91cf-2eff31db209e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:01.973037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8316d1a-c2f7-4364-8a6f-57ecf3934c0f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.002006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69e32-6bac-4217-8e89-768413c78d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.002615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69e32-6bac-4217-8e89-768413c78d87 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.002986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69e32-6bac-4217-8e89-768413c78d87 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.003256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db69e32-6bac-4217-8e89-768413c78d87 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.003865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db69e32-6bac-4217-8e89-768413c78d87 None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:02.004176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db69e32-6bac-4217-8e89-768413c78d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.005599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db69e32-6bac-4217-8e89-768413c78d87 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.014751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 281/552] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:02.019774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69e32-6bac-4217-8e89-768413c78d87 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.043117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44923b80-aabf-479a-9d30-704fe7d0fde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.043968 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44923b80-aabf-479a-9d30-704fe7d0fde4 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.043968 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44923b80-aabf-479a-9d30-704fe7d0fde4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.044308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44923b80-aabf-479a-9d30-704fe7d0fde4 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.045223 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44923b80-aabf-479a-9d30-704fe7d0fde4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:02.045531 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44923b80-aabf-479a-9d30-704fe7d0fde4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.047001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44923b80-aabf-479a-9d30-704fe7d0fde4 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.085093 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 272/553] 10.222.0.74 () {56 vars in 1135 bytes} [Wed Aug 31 00:16:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:02.091501 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44923b80-aabf-479a-9d30-704fe7d0fde4 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.192462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db69e32-6bac-4217-8e89-768413c78d87 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.228985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dd9ea-45d2-4e16-ace3-bf68ac94745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.230212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd9ea-45d2-4e16-ace3-bf68ac94745d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.230503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd9ea-45d2-4e16-ace3-bf68ac94745d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.230837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd9ea-45d2-4e16-ace3-bf68ac94745d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.242127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dd9ea-45d2-4e16-ace3-bf68ac94745d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.243642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dd9ea-45d2-4e16-ace3-bf68ac94745d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.247085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-625dd9ea-45d2-4e16-ace3-bf68ac94745d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:02.260173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:02.266458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:02.267354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:02.267354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:02.267354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:02.267354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 282/554] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:02.269503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dd9ea-45d2-4e16-ace3-bf68ac94745d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.319271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44923b80-aabf-479a-9d30-704fe7d0fde4 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.363003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:02.391015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dd9ea-45d2-4e16-ace3-bf68ac94745d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.393924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0427d-0112-4da0-bea7-5c253726a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.394541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0427d-0112-4da0-bea7-5c253726a600 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.394820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0427d-0112-4da0-bea7-5c253726a600 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.395090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0427d-0112-4da0-bea7-5c253726a600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.436836 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011b1be-3d6b-4944-8c7b-b5df6f256570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.437447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011b1be-3d6b-4944-8c7b-b5df6f256570 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.438030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011b1be-3d6b-4944-8c7b-b5df6f256570 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.438309 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011b1be-3d6b-4944-8c7b-b5df6f256570 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.439914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011b1be-3d6b-4944-8c7b-b5df6f256570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:02.440238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011b1be-3d6b-4944-8c7b-b5df6f256570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.441707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011b1be-3d6b-4944-8c7b-b5df6f256570 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.456015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 283/555] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:02.457287 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45d8a-209d-40c8-8ce6-122bb261ddbb None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.457552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45d8a-209d-40c8-8ce6-122bb261ddbb None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.457858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc45d8a-209d-40c8-8ce6-122bb261ddbb None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.463292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 284/556] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:02.464555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e05a0-ba6d-436b-a4f7-22b87e093231 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.464841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e05a0-ba6d-436b-a4f7-22b87e093231 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.465124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e05a0-ba6d-436b-a4f7-22b87e093231 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.466378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 285/557] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:02.467367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9402aa-aaf3-4560-a6c5-461e98b82159 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.467644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9402aa-aaf3-4560-a6c5-461e98b82159 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.467916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9402aa-aaf3-4560-a6c5-461e98b82159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.482443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0427d-0112-4da0-bea7-5c253726a600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.483924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0427d-0112-4da0-bea7-5c253726a600 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.489299 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2c9402aa-aaf3-4560-a6c5-461e98b82159 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:02.490555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2c9402aa-aaf3-4560-a6c5-461e98b82159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:02.550790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:02.569363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 286/558] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:02.571076 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9402aa-aaf3-4560-a6c5-461e98b82159 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.613335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 273/559] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:16:02.615900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344c5b8-2d5c-4c5a-bb7b-2b65e089743f None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.616362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344c5b8-2d5c-4c5a-bb7b-2b65e089743f None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.616800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344c5b8-2d5c-4c5a-bb7b-2b65e089743f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.642635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-9344c5b8-2d5c-4c5a-bb7b-2b65e089743f None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:02.643978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9344c5b8-2d5c-4c5a-bb7b-2b65e089743f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:02.663671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:02.704564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9402aa-aaf3-4560-a6c5-461e98b82159 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.728909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 274/560] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:02.730190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344c5b8-2d5c-4c5a-bb7b-2b65e089743f None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.767768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45e7b0-b4ed-45fe-85cc-193fb0c89786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.768666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45e7b0-b4ed-45fe-85cc-193fb0c89786 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.768951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45e7b0-b4ed-45fe-85cc-193fb0c89786 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.769222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45e7b0-b4ed-45fe-85cc-193fb0c89786 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.779914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45e7b0-b4ed-45fe-85cc-193fb0c89786 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.781418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45e7b0-b4ed-45fe-85cc-193fb0c89786 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-0c45e7b0-b4ed-45fe-85cc-193fb0c89786 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:02.797272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:02.798404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:02.799760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:02.799760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:02.799760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:02.799760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:02.799760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:02.799760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:02.799760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:02.799760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:02.799760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:16:02.799760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:02.799760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 287/561] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:02.800565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cb80c-5969-40b7-ba20-d7eb638913c5 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.800565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cb80c-5969-40b7-ba20-d7eb638913c5 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.800565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0cb80c-5969-40b7-ba20-d7eb638913c5 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.805696 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 288/562] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:02.806954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cb80c-5969-40b7-ba20-d7eb638913c5 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:02.859175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344c5b8-2d5c-4c5a-bb7b-2b65e089743f None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.860951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:02.907634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0067f8-af7f-4a3a-b587-b0038ed68d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.908550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0067f8-af7f-4a3a-b587-b0038ed68d02 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.908882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0067f8-af7f-4a3a-b587-b0038ed68d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.909157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0067f8-af7f-4a3a-b587-b0038ed68d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.920626 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0067f8-af7f-4a3a-b587-b0038ed68d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.922101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0067f8-af7f-4a3a-b587-b0038ed68d02 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.924923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0cb80c-5969-40b7-ba20-d7eb638913c5 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:02.930919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-5c0067f8-af7f-4a3a-b587-b0038ed68d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:02.938533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:02.943780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:02.945045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:02.945045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:02.945045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:02.945045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 275/563] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:02.945566 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70244d-1757-4a8b-b1a4-a7f52f649d43 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.945873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70244d-1757-4a8b-b1a4-a7f52f649d43 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.946148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70244d-1757-4a8b-b1a4-a7f52f649d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.964916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c4b3e-d117-4830-8cba-a8b7a5882a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:02.965148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-6d70244d-1757-4a8b-b1a4-a7f52f649d43 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:02.965499 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c4b3e-d117-4830-8cba-a8b7a5882a3a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:02.965867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c4b3e-d117-4830-8cba-a8b7a5882a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:02.966096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c4b3e-d117-4830-8cba-a8b7a5882a3a None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:02.966205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6d70244d-1757-4a8b-b1a4-a7f52f649d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:02.966830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c4b3e-d117-4830-8cba-a8b7a5882a3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:02.967141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c4b3e-d117-4830-8cba-a8b7a5882a3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:02.968588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c4b3e-d117-4830-8cba-a8b7a5882a3a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:02.991053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 289/564] 10.222.0.74 () {56 vars in 1137 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:02.991053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c4b3e-d117-4830-8cba-a8b7a5882a3a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.044246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 276/565] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:03.046053 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70244d-1757-4a8b-b1a4-a7f52f649d43 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.096722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c4b3e-d117-4830-8cba-a8b7a5882a3a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.099820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:03.133896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baa501-2ef7-465b-944b-16006d3185b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.134524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baa501-2ef7-465b-944b-16006d3185b6 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.134803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baa501-2ef7-465b-944b-16006d3185b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.135072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82baa501-2ef7-465b-944b-16006d3185b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.146030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82baa501-2ef7-465b-944b-16006d3185b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-82baa501-2ef7-465b-944b-16006d3185b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:03.150882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:03.152841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:03.154049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 290/566] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:03.154874 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baa501-2ef7-465b-944b-16006d3185b6 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.171565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70244d-1757-4a8b-b1a4-a7f52f649d43 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.205606 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:03.214968 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895994-a7c7-4b1c-9faf-8715f1703a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.215585 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895994-a7c7-4b1c-9faf-8715f1703a3a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.215867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895994-a7c7-4b1c-9faf-8715f1703a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.216139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895994-a7c7-4b1c-9faf-8715f1703a3a None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.217163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9895994-a7c7-4b1c-9faf-8715f1703a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:03.217163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9895994-a7c7-4b1c-9faf-8715f1703a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.218589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9895994-a7c7-4b1c-9faf-8715f1703a3a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.230952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 277/567] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:03.231768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895994-a7c7-4b1c-9faf-8715f1703a3a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.284585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82baa501-2ef7-465b-944b-16006d3185b6 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.321940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997e9c0-227b-4090-ac02-513b26c0f83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.322570 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997e9c0-227b-4090-ac02-513b26c0f83a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.322855 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997e9c0-227b-4090-ac02-513b26c0f83a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.323128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997e9c0-227b-4090-ac02-513b26c0f83a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.334013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997e9c0-227b-4090-ac02-513b26c0f83a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.335508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997e9c0-227b-4090-ac02-513b26c0f83a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.340194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895994-a7c7-4b1c-9faf-8715f1703a3a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-e997e9c0-227b-4090-ac02-513b26c0f83a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:03.349989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:03.350936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:03.351837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:03.351837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:03.351837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:03.351837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 291/568] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:03.351837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997e9c0-227b-4090-ac02-513b26c0f83a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.370749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:03.376944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f5b3a-26ac-47ed-8283-9571c8f72882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.377592 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5b3a-26ac-47ed-8283-9571c8f72882 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.377894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5b3a-26ac-47ed-8283-9571c8f72882 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.378168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5b3a-26ac-47ed-8283-9571c8f72882 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.388233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f5b3a-26ac-47ed-8283-9571c8f72882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-c85f5b3a-26ac-47ed-8283-9571c8f72882 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:03.393496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:03.394687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 278/569] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:03.395549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f5b3a-26ac-47ed-8283-9571c8f72882 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.445094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:03.461080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997e9c0-227b-4090-ac02-513b26c0f83a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.496240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f5b3a-26ac-47ed-8283-9571c8f72882 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.498256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3475e8-61ef-4f35-9dd6-573953faff96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.498860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3475e8-61ef-4f35-9dd6-573953faff96 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.499142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3475e8-61ef-4f35-9dd6-573953faff96 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.499419 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3475e8-61ef-4f35-9dd6-573953faff96 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.500084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3475e8-61ef-4f35-9dd6-573953faff96 None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:03.500388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3475e8-61ef-4f35-9dd6-573953faff96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.501786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3475e8-61ef-4f35-9dd6-573953faff96 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.509849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 292/570] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:03.510638 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3475e8-61ef-4f35-9dd6-573953faff96 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.534431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d1901-917a-482f-b34b-0b07b2a0cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.535118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d1901-917a-482f-b34b-0b07b2a0cff9 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.535345 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d1901-917a-482f-b34b-0b07b2a0cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.535618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d1901-917a-482f-b34b-0b07b2a0cff9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.542931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d1901-917a-482f-b34b-0b07b2a0cff9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.544619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d1901-917a-482f-b34b-0b07b2a0cff9 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-166d1901-917a-482f-b34b-0b07b2a0cff9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:03.556650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:03.557542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:03.558504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:03.558504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:03.558504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:03.558504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:03.558504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:03.558504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:03.558504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:03.558504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:03.558504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 279/571] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:03.559581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d1901-917a-482f-b34b-0b07b2a0cff9 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.594508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:03.616076 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3475e8-61ef-4f35-9dd6-573953faff96 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.648380 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc51f5-44b8-4692-b91d-f6353bd6d30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.648987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc51f5-44b8-4692-b91d-f6353bd6d30d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.649467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc51f5-44b8-4692-b91d-f6353bd6d30d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.649923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc51f5-44b8-4692-b91d-f6353bd6d30d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.657144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d1901-917a-482f-b34b-0b07b2a0cff9 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.662100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc51f5-44b8-4692-b91d-f6353bd6d30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:03.667921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-a7bc51f5-44b8-4692-b91d-f6353bd6d30d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:03.668274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:03.669352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:03.670596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 293/572] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:03.671295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc51f5-44b8-4692-b91d-f6353bd6d30d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.694172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9f700-4f91-462c-9342-207f7cf65c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.694780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f700-4f91-462c-9342-207f7cf65c6d None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.695066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f700-4f91-462c-9342-207f7cf65c6d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.695332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9f700-4f91-462c-9342-207f7cf65c6d None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.695974 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9f700-4f91-462c-9342-207f7cf65c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:03.696278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9f700-4f91-462c-9342-207f7cf65c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.697778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9f700-4f91-462c-9342-207f7cf65c6d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.710930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 280/573] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:03.711746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9f700-4f91-462c-9342-207f7cf65c6d None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.775184 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc51f5-44b8-4692-b91d-f6353bd6d30d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.809337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503ac2e-120f-4953-bcc5-d095c0817a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.809877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ac2e-120f-4953-bcc5-d095c0817a5d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.810160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ac2e-120f-4953-bcc5-d095c0817a5d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.810434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ac2e-120f-4953-bcc5-d095c0817a5d None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.811097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503ac2e-120f-4953-bcc5-d095c0817a5d None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:03.811432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503ac2e-120f-4953-bcc5-d095c0817a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.811707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9f700-4f91-462c-9342-207f7cf65c6d None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.812819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503ac2e-120f-4953-bcc5-d095c0817a5d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.817945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:03.822358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 294/574] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:03.823916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503ac2e-120f-4953-bcc5-d095c0817a5d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.862443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455b73b-8b79-40a4-ac0b-0dc18f1c1dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.863069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455b73b-8b79-40a4-ac0b-0dc18f1c1dff None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.863349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455b73b-8b79-40a4-ac0b-0dc18f1c1dff None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.863618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455b73b-8b79-40a4-ac0b-0dc18f1c1dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.874671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455b73b-8b79-40a4-ac0b-0dc18f1c1dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.876138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455b73b-8b79-40a4-ac0b-0dc18f1c1dff None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-1455b73b-8b79-40a4-ac0b-0dc18f1c1dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:03.891959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:03.892925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:03.893856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:03.893856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:03.893856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:03.893856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 281/575] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:03.893856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455b73b-8b79-40a4-ac0b-0dc18f1c1dff None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:03.925470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:03.927764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503ac2e-120f-4953-bcc5-d095c0817a5d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:03.961950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddadc2-24ca-4399-95a8-2251e976d26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:03.962545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddadc2-24ca-4399-95a8-2251e976d26f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:03.962822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddadc2-24ca-4399-95a8-2251e976d26f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:03.963088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddadc2-24ca-4399-95a8-2251e976d26f None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:03.963767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddadc2-24ca-4399-95a8-2251e976d26f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:03.964727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddadc2-24ca-4399-95a8-2251e976d26f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:03.966229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddadc2-24ca-4399-95a8-2251e976d26f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:03.983997 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 295/576] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:03.984815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddadc2-24ca-4399-95a8-2251e976d26f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.001106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455b73b-8b79-40a4-ac0b-0dc18f1c1dff None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.034701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631ca5-cf66-468f-ba8e-8fdce8d784e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.035310 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631ca5-cf66-468f-ba8e-8fdce8d784e0 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.035598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631ca5-cf66-468f-ba8e-8fdce8d784e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.035933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f631ca5-cf66-468f-ba8e-8fdce8d784e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.036593 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f631ca5-cf66-468f-ba8e-8fdce8d784e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:04.036896 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f631ca5-cf66-468f-ba8e-8fdce8d784e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.038311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f631ca5-cf66-468f-ba8e-8fdce8d784e0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.045513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:04.046372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 282/577] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:04.051196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631ca5-cf66-468f-ba8e-8fdce8d784e0 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.093009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddadc2-24ca-4399-95a8-2251e976d26f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.126174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b377230-96e7-4dcc-ae8e-939578f56017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.126831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b377230-96e7-4dcc-ae8e-939578f56017 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.127116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b377230-96e7-4dcc-ae8e-939578f56017 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.127396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b377230-96e7-4dcc-ae8e-939578f56017 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.130245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:04.134401 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b377230-96e7-4dcc-ae8e-939578f56017 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.136424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b377230-96e7-4dcc-ae8e-939578f56017 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.146523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f631ca5-cf66-468f-ba8e-8fdce8d784e0 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-4b377230-96e7-4dcc-ae8e-939578f56017 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:04.147822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:04.148858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:04.149786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:04.149786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:04.149786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:04.149786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:04.149786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:04.149786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:04.149786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:04.149786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:04.149786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 296/578] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:04.150277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b377230-96e7-4dcc-ae8e-939578f56017 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.181399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1cc86-6cee-420b-9883-b3f3e8ae0853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.182062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1cc86-6cee-420b-9883-b3f3e8ae0853 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.182402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1cc86-6cee-420b-9883-b3f3e8ae0853 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.183252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1cc86-6cee-420b-9883-b3f3e8ae0853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.193554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1cc86-6cee-420b-9883-b3f3e8ae0853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.195028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1cc86-6cee-420b-9883-b3f3e8ae0853 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-e9f1cc86-6cee-420b-9883-b3f3e8ae0853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:04.210340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:04.211456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:04.212400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:04.212400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:04.212400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:04.212400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 283/579] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:04.212634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1cc86-6cee-420b-9883-b3f3e8ae0853 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.254880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b377230-96e7-4dcc-ae8e-939578f56017 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.274325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:04.289203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d472f8-ebdb-4cf4-9baa-7d8e37aa79ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.289833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d472f8-ebdb-4cf4-9baa-7d8e37aa79ab None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.290098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d472f8-ebdb-4cf4-9baa-7d8e37aa79ab None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.290400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d472f8-ebdb-4cf4-9baa-7d8e37aa79ab None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.291037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d472f8-ebdb-4cf4-9baa-7d8e37aa79ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:04.291333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d472f8-ebdb-4cf4-9baa-7d8e37aa79ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.292951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d472f8-ebdb-4cf4-9baa-7d8e37aa79ab None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.304476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 297/580] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:04.305321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d472f8-ebdb-4cf4-9baa-7d8e37aa79ab None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.310639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1cc86-6cee-420b-9883-b3f3e8ae0853 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.345028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec461f-5c0a-420d-b8a6-21ca7b6138d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.345766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec461f-5c0a-420d-b8a6-21ca7b6138d6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.346052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec461f-5c0a-420d-b8a6-21ca7b6138d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.346330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec461f-5c0a-420d-b8a6-21ca7b6138d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.347052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec461f-5c0a-420d-b8a6-21ca7b6138d6 None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=045ff88aba374cc889389ba07e884462) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:04.347364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec461f-5c0a-420d-b8a6-21ca7b6138d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.348835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec461f-5c0a-420d-b8a6-21ca7b6138d6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.351861 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:04.354817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 284/581] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:04 2022] GET /identity/v3/role_assignments?user.id=045ff88aba374cc889389ba07e884462&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:04.355598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec461f-5c0a-420d-b8a6-21ca7b6138d6 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.421666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d472f8-ebdb-4cf4-9baa-7d8e37aa79ab None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.470015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64135b5-352c-4d50-ba4f-f069736ac307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.470282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec461f-5c0a-420d-b8a6-21ca7b6138d6 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.470947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64135b5-352c-4d50-ba4f-f069736ac307 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.471471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64135b5-352c-4d50-ba4f-f069736ac307 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.472319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64135b5-352c-4d50-ba4f-f069736ac307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.486427 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64135b5-352c-4d50-ba4f-f069736ac307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.490093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64135b5-352c-4d50-ba4f-f069736ac307 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-d64135b5-352c-4d50-ba4f-f069736ac307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:04.516621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:04.517703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:04.519021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:04.519021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:04.519021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:04.519021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 298/582] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:04.519021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64135b5-352c-4d50-ba4f-f069736ac307 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.523064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ee949-319c-44b9-8806-cc113554f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.523827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee949-319c-44b9-8806-cc113554f85b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.524203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee949-319c-44b9-8806-cc113554f85b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.524925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee949-319c-44b9-8806-cc113554f85b None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.525798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ee949-319c-44b9-8806-cc113554f85b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:04.526545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ee949-319c-44b9-8806-cc113554f85b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.528097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ee949-319c-44b9-8806-cc113554f85b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.540714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 285/583] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:04.541772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ee949-319c-44b9-8806-cc113554f85b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.554078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:04.610701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:04.629598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64135b5-352c-4d50-ba4f-f069736ac307 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.658520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ee949-319c-44b9-8806-cc113554f85b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.667254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123acf9-99a3-4493-b604-9b34d27a04fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.667912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123acf9-99a3-4493-b604-9b34d27a04fa None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.668270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123acf9-99a3-4493-b604-9b34d27a04fa None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.668549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123acf9-99a3-4493-b604-9b34d27a04fa None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.669200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123acf9-99a3-4493-b604-9b34d27a04fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:04.669504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123acf9-99a3-4493-b604-9b34d27a04fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.671193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123acf9-99a3-4493-b604-9b34d27a04fa None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.688084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 299/584] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:04.688084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123acf9-99a3-4493-b604-9b34d27a04fa None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.700794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905029b-60ec-4db1-9c1a-bf2781450fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.701561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905029b-60ec-4db1-9c1a-bf2781450fb5 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.701930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905029b-60ec-4db1-9c1a-bf2781450fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.702277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905029b-60ec-4db1-9c1a-bf2781450fb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.710066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905029b-60ec-4db1-9c1a-bf2781450fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.711554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905029b-60ec-4db1-9c1a-bf2781450fb5 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-a905029b-60ec-4db1-9c1a-bf2781450fb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:04.723602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:04.724762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:04.726032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:04.726032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:04.726032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:04.726032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:04.726032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:04.726032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:04.726032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:04.726032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:04.726032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:16:04.726032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:04.729615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 286/585] 10.222.0.74 () {56 vars in 1093 bytes} [Wed Aug 31 00:16:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:04.730438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905029b-60ec-4db1-9c1a-bf2781450fb5 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.783933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:04.793769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123acf9-99a3-4493-b604-9b34d27a04fa None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.831823 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457490c-2d8d-4832-850c-03536c52ab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.832555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457490c-2d8d-4832-850c-03536c52ab73 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.832907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457490c-2d8d-4832-850c-03536c52ab73 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.833247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457490c-2d8d-4832-850c-03536c52ab73 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.834047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457490c-2d8d-4832-850c-03536c52ab73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:04.834483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457490c-2d8d-4832-850c-03536c52ab73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.835959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457490c-2d8d-4832-850c-03536c52ab73 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.850301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 300/586] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:04.851041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457490c-2d8d-4832-850c-03536c52ab73 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:04.859716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905029b-60ec-4db1-9c1a-bf2781450fb5 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.895113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:04.913649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75dac9-b932-4d91-89c5-bf6bee9b2df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:04.914433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75dac9-b932-4d91-89c5-bf6bee9b2df0 None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:04.914803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75dac9-b932-4d91-89c5-bf6bee9b2df0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:04.915143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75dac9-b932-4d91-89c5-bf6bee9b2df0 None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/d8590378b14c49cf9266a0d859db5bf0/roles/a6ed0e9279a54b28a542e9a12ad503a3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:04.932186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75dac9-b932-4d91-89c5-bf6bee9b2df0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=d8590378b14c49cf9266a0d859db5bf0, role_id=a6ed0e9279a54b28a542e9a12ad503a3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:04.934381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75dac9-b932-4d91-89c5-bf6bee9b2df0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:04.970331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457490c-2d8d-4832-850c-03536c52ab73 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:04.997609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 287/587] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:16:04 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/d8590378b14c49cf9266a0d859db5bf0/roles/a6ed0e9279a54b28a542e9a12ad503a3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:04.997609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75dac9-b932-4d91-89c5-bf6bee9b2df0 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.025271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b1b46-b874-4c8c-911d-7fec72232141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.026107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b1b46-b874-4c8c-911d-7fec72232141 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.027058 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b1b46-b874-4c8c-911d-7fec72232141 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.027402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b1b46-b874-4c8c-911d-7fec72232141 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.036113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b1b46-b874-4c8c-911d-7fec72232141 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.037838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b1b46-b874-4c8c-911d-7fec72232141 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-ce8b1b46-b874-4c8c-911d-7fec72232141 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:05.051982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:05.053044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:05.054035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:05.054035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:05.054035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:05.054035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:05.054035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:05.054035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:05.054035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:05.054035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:05.054035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:16:05.054035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:05.058815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 301/588] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:16:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:05.059989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b1b46-b874-4c8c-911d-7fec72232141 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.079469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:05.141051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75dac9-b932-4d91-89c5-bf6bee9b2df0 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:05.191589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76061a2e-b657-4923-8974-f00913d655b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.197398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76061a2e-b657-4923-8974-f00913d655b1 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.197398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76061a2e-b657-4923-8974-f00913d655b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.197398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76061a2e-b657-4923-8974-f00913d655b1 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.197398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76061a2e-b657-4923-8974-f00913d655b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:05.197398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76061a2e-b657-4923-8974-f00913d655b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.197398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76061a2e-b657-4923-8974-f00913d655b1 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.199869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b1b46-b874-4c8c-911d-7fec72232141 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:05.217843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 288/589] 10.222.0.74 () {56 vars in 1133 bytes} [Wed Aug 31 00:16:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:05.218702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76061a2e-b657-4923-8974-f00913d655b1 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.242470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c450d73-e6b3-4ccc-bd7f-bfbbaccd850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.243133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c450d73-e6b3-4ccc-bd7f-bfbbaccd850f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.243472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c450d73-e6b3-4ccc-bd7f-bfbbaccd850f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.243748 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c450d73-e6b3-4ccc-bd7f-bfbbaccd850f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.251415 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c450d73-e6b3-4ccc-bd7f-bfbbaccd850f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.252928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c450d73-e6b3-4ccc-bd7f-bfbbaccd850f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-7c450d73-e6b3-4ccc-bd7f-bfbbaccd850f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:05.266324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:05.267457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 302/590] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:05.268536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c450d73-e6b3-4ccc-bd7f-bfbbaccd850f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.269850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:05.347528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76061a2e-b657-4923-8974-f00913d655b1 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:05.356164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:05.388762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5b240-db89-4fa1-ad68-f590ca3c71a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.389668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5b240-db89-4fa1-ad68-f590ca3c71a1 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.390132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5b240-db89-4fa1-ad68-f590ca3c71a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.390560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5b240-db89-4fa1-ad68-f590ca3c71a1 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.391553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5b240-db89-4fa1-ad68-f590ca3c71a1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:05.392050 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5b240-db89-4fa1-ad68-f590ca3c71a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.393734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5b240-db89-4fa1-ad68-f590ca3c71a1 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.394041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c450d73-e6b3-4ccc-bd7f-bfbbaccd850f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:05.414908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 289/591] 10.222.0.74 () {56 vars in 1137 bytes} [Wed Aug 31 00:16:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:05.416121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5b240-db89-4fa1-ad68-f590ca3c71a1 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.444238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a4de9-7379-415f-af9e-81dbb04c9e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.445281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a4de9-7379-415f-af9e-81dbb04c9e70 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.445562 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a4de9-7379-415f-af9e-81dbb04c9e70 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.445856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a4de9-7379-415f-af9e-81dbb04c9e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.461684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a4de9-7379-415f-af9e-81dbb04c9e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.463182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a4de9-7379-415f-af9e-81dbb04c9e70 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-0b5a4de9-7379-415f-af9e-81dbb04c9e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:05.481692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:05.482910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:05.484016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:05.484016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:05.484016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:05.484016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 303/592] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:05.484016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a4de9-7379-415f-af9e-81dbb04c9e70 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.525891 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:05.546110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5b240-db89-4fa1-ad68-f590ca3c71a1 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:05.583685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12ed1d-b5ce-458b-a090-4d839bda0458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.584304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ed1d-b5ce-458b-a090-4d839bda0458 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.584589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ed1d-b5ce-458b-a090-4d839bda0458 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.584865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ed1d-b5ce-458b-a090-4d839bda0458 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.585928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12ed1d-b5ce-458b-a090-4d839bda0458 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:05.586239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12ed1d-b5ce-458b-a090-4d839bda0458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.587742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12ed1d-b5ce-458b-a090-4d839bda0458 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.611690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 290/593] 10.222.0.74 () {56 vars in 1139 bytes} [Wed Aug 31 00:16:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:05.611690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12ed1d-b5ce-458b-a090-4d839bda0458 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.623549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a4de9-7379-415f-af9e-81dbb04c9e70 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:05.656295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:05.673482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e98c3-3d60-4eb1-ab79-374a6640a63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.674924 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e98c3-3d60-4eb1-ab79-374a6640a63a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.675924 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e98c3-3d60-4eb1-ab79-374a6640a63a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.676707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e98c3-3d60-4eb1-ab79-374a6640a63a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.692400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e98c3-3d60-4eb1-ab79-374a6640a63a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.694644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e98c3-3d60-4eb1-ab79-374a6640a63a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-f12e98c3-3d60-4eb1-ab79-374a6640a63a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:05.717607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:05.723839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:05.724775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:05.724775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:05.724775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:05.724960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12ed1d-b5ce-458b-a090-4d839bda0458 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:05.725036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 304/594] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:05.725036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e98c3-3d60-4eb1-ab79-374a6640a63a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.767155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a2fb1-d7f2-4820-b571-49f05362b108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.768002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a2fb1-d7f2-4820-b571-49f05362b108 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.768217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a2fb1-d7f2-4820-b571-49f05362b108 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.768563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a2fb1-d7f2-4820-b571-49f05362b108 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.769337 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a2fb1-d7f2-4820-b571-49f05362b108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:05.769678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a2fb1-d7f2-4820-b571-49f05362b108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.771111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a2fb1-d7f2-4820-b571-49f05362b108 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.783574 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 291/595] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:05.784392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a2fb1-d7f2-4820-b571-49f05362b108 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.789386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:05.869039 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e98c3-3d60-4eb1-ab79-374a6640a63a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:05.905005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a2fb1-d7f2-4820-b571-49f05362b108 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:05.916605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ae9fe-0e59-464d-a16f-ad5d4ceccebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.918022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae9fe-0e59-464d-a16f-ad5d4ceccebe None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.918427 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae9fe-0e59-464d-a16f-ad5d4ceccebe None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.919020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ae9fe-0e59-464d-a16f-ad5d4ceccebe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.934410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ae9fe-0e59-464d-a16f-ad5d4ceccebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.937439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9ae9fe-0e59-464d-a16f-ad5d4ceccebe None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.951559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e6d25-9b50-4050-b66f-65cca0e4c068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:05.952393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6d25-9b50-4050-b66f-65cca0e4c068 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:05.952823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6d25-9b50-4050-b66f-65cca0e4c068 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:05.953251 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6d25-9b50-4050-b66f-65cca0e4c068 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:05.954052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e6d25-9b50-4050-b66f-65cca0e4c068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:05.954492 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e6d25-9b50-4050-b66f-65cca0e4c068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:05.955983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e6d25-9b50-4050-b66f-65cca0e4c068 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-1e9ae9fe-0e59-464d-a16f-ad5d4ceccebe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:05.956167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:05.957241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:05.958331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:05.958331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:05.958331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:05.959488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 305/596] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:05.960348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ae9fe-0e59-464d-a16f-ad5d4ceccebe None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.974600 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 292/597] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:05.976075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e6d25-9b50-4050-b66f-65cca0e4c068 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:05.997689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:06.064008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:06.077646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ae9fe-0e59-464d-a16f-ad5d4ceccebe None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:06.106211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e6d25-9b50-4050-b66f-65cca0e4c068 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:06.116222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ef194-2133-4568-a0e3-1889513d5d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:06.116990 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ef194-2133-4568-a0e3-1889513d5d50 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.117376 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ef194-2133-4568-a0e3-1889513d5d50 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.117800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ef194-2133-4568-a0e3-1889513d5d50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.125910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ef194-2133-4568-a0e3-1889513d5d50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:06.127851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ef194-2133-4568-a0e3-1889513d5d50 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-406ef194-2133-4568-a0e3-1889513d5d50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:06.139964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:06.141070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:06.142167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:06.142167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:06.142167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:06.142167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:06.142167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:06.142167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:06.142167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:06.142167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:06.143722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 306/598] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:06.144751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ef194-2133-4568-a0e3-1889513d5d50 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:06.150086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77acc5-8bb2-4ecf-b205-49591c12d8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:06.151320 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77acc5-8bb2-4ecf-b205-49591c12d8c7 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.151922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77acc5-8bb2-4ecf-b205-49591c12d8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.152459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77acc5-8bb2-4ecf-b205-49591c12d8c7 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.153358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77acc5-8bb2-4ecf-b205-49591c12d8c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:06.153862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77acc5-8bb2-4ecf-b205-49591c12d8c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:06.155482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77acc5-8bb2-4ecf-b205-49591c12d8c7 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:06.171493 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 293/599] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:06.172873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77acc5-8bb2-4ecf-b205-49591c12d8c7 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:06.242061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:06.255642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ef194-2133-4568-a0e3-1889513d5d50 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:06.286172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77acc5-8bb2-4ecf-b205-49591c12d8c7 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:06.296851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655b3ba-c496-4dc7-bed2-3adc33ab2cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:06.297857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655b3ba-c496-4dc7-bed2-3adc33ab2cbe None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.298847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655b3ba-c496-4dc7-bed2-3adc33ab2cbe None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.299321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655b3ba-c496-4dc7-bed2-3adc33ab2cbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.310003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655b3ba-c496-4dc7-bed2-3adc33ab2cbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:06.312292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655b3ba-c496-4dc7-bed2-3adc33ab2cbe None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:06.314185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:06.325185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ac4fe-5c02-45d0-8c04-5c4b67c68626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-5655b3ba-c496-4dc7-bed2-3adc33ab2cbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:06.325341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:06.326852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:06.327994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:06.327994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:06.327994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:06.327994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:06.327994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:06.327994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:06.327994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:06.327994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:06.328433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac4fe-5c02-45d0-8c04-5c4b67c68626 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.328433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac4fe-5c02-45d0-8c04-5c4b67c68626 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.328433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ac4fe-5c02-45d0-8c04-5c4b67c68626 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.328610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 307/600] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:06.328610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655b3ba-c496-4dc7-bed2-3adc33ab2cbe None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:06.331907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ac4fe-5c02-45d0-8c04-5c4b67c68626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:06.333103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ac4fe-5c02-45d0-8c04-5c4b67c68626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:06.334704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ac4fe-5c02-45d0-8c04-5c4b67c68626 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:06.354254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 294/601] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:06.356114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91c2b-1f04-4ccb-9580-b8d3c5315120 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.356408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91c2b-1f04-4ccb-9580-b8d3c5315120 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.356690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91c2b-1f04-4ccb-9580-b8d3c5315120 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.358013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 295/602] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:06.362551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea91c2b-1f04-4ccb-9580-b8d3c5315120 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:06.432868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655b3ba-c496-4dc7-bed2-3adc33ab2cbe None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:06.469207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c46ab-5a8f-41be-8c49-a994e508a1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:06.469864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c46ab-5a8f-41be-8c49-a994e508a1ad None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.470145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c46ab-5a8f-41be-8c49-a994e508a1ad None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.470446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c46ab-5a8f-41be-8c49-a994e508a1ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.472005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea91c2b-1f04-4ccb-9580-b8d3c5315120 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:06.477807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c46ab-5a8f-41be-8c49-a994e508a1ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:06.479266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c46ab-5a8f-41be-8c49-a994e508a1ad None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-5f3c46ab-5a8f-41be-8c49-a994e508a1ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:06.491414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:06.492374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:06.493282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:06.493282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:06.493282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:06.493282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:06.493282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:06.493282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:06.493282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:06.493282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:06.493282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 308/603] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:06.493282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c46ab-5a8f-41be-8c49-a994e508a1ad None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:06.507888 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:06.513776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b76a1-aad0-448e-92bc-4abc5f48f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:06.514546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b76a1-aad0-448e-92bc-4abc5f48f494 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.514860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b76a1-aad0-448e-92bc-4abc5f48f494 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.515297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b76a1-aad0-448e-92bc-4abc5f48f494 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.516094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b76a1-aad0-448e-92bc-4abc5f48f494 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:06.516541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b76a1-aad0-448e-92bc-4abc5f48f494 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:06.518140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b76a1-aad0-448e-92bc-4abc5f48f494 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:06.536637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 296/604] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:06.540288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c69d9-24bb-4dfb-8404-c138cd7afd67 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.540624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c69d9-24bb-4dfb-8404-c138cd7afd67 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.540901 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c69d9-24bb-4dfb-8404-c138cd7afd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.570435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a71c69d9-24bb-4dfb-8404-c138cd7afd67 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:06.571663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a71c69d9-24bb-4dfb-8404-c138cd7afd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:06.616326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:06.620125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c46ab-5a8f-41be-8c49-a994e508a1ad None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:06.644283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 297/605] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:06.644928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c69d9-24bb-4dfb-8404-c138cd7afd67 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:06.670873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b0b4-f8fb-4521-883c-a14faaa95403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:06.671633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b0b4-f8fb-4521-883c-a14faaa95403 None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.671989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b0b4-f8fb-4521-883c-a14faaa95403 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.672327 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8b0b4-f8fb-4521-883c-a14faaa95403 None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/90147848fe604ca9912d10a214a45227/roles/a6ed0e9279a54b28a542e9a12ad503a3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.693502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8b0b4-f8fb-4521-883c-a14faaa95403 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=90147848fe604ca9912d10a214a45227, role_id=a6ed0e9279a54b28a542e9a12ad503a3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:06.695008 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8b0b4-f8fb-4521-883c-a14faaa95403 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:06.759179 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c69d9-24bb-4dfb-8404-c138cd7afd67 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:06.794113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 309/606] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:16:06 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/90147848fe604ca9912d10a214a45227/roles/a6ed0e9279a54b28a542e9a12ad503a3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:06.795958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b0b4-f8fb-4521-883c-a14faaa95403 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:06.815548 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef9590-5da0-40ab-a775-057f4b41118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:06.817236 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9590-5da0-40ab-a775-057f4b41118a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:06.817776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9590-5da0-40ab-a775-057f4b41118a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:06.818338 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9590-5da0-40ab-a775-057f4b41118a None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:06.819798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef9590-5da0-40ab-a775-057f4b41118a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:06.820362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef9590-5da0-40ab-a775-057f4b41118a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:06.822522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef9590-5da0-40ab-a775-057f4b41118a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:06.858553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 298/607] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:06.870165 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef9590-5da0-40ab-a775-057f4b41118a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:06.931410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:06.948786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:06.994756 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8b0b4-f8fb-4521-883c-a14faaa95403 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:07.022031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef9590-5da0-40ab-a775-057f4b41118a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:07.042161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8fcd-c9e8-4461-9bc1-c1119b1dd6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:07.043222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8fcd-c9e8-4461-9bc1-c1119b1dd6e0 None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:07.043499 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8fcd-c9e8-4461-9bc1-c1119b1dd6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:07.043859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f8fcd-c9e8-4461-9bc1-c1119b1dd6e0 None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/75f62fa62f2d420a998f236ff7f9b6b9/roles/a6ed0e9279a54b28a542e9a12ad503a3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:07.061991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f8fcd-c9e8-4461-9bc1-c1119b1dd6e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=75f62fa62f2d420a998f236ff7f9b6b9, role_id=a6ed0e9279a54b28a542e9a12ad503a3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:07.063468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f8fcd-c9e8-4461-9bc1-c1119b1dd6e0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:07.064896 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c4865-4f21-4e65-9677-ed2cf7c6eb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:07.065810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c4865-4f21-4e65-9677-ed2cf7c6eb49 None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:07.066098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c4865-4f21-4e65-9677-ed2cf7c6eb49 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:07.066375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c4865-4f21-4e65-9677-ed2cf7c6eb49 None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/6f5149b369e34afca6dd41a0082701e6/roles/a6ed0e9279a54b28a542e9a12ad503a3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:07.083509 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c4865-4f21-4e65-9677-ed2cf7c6eb49 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=6f5149b369e34afca6dd41a0082701e6, role_id=a6ed0e9279a54b28a542e9a12ad503a3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:07.084985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c4865-4f21-4e65-9677-ed2cf7c6eb49 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:07.158293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 310/608] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:16:06 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/75f62fa62f2d420a998f236ff7f9b6b9/roles/a6ed0e9279a54b28a542e9a12ad503a3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:07.159193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8fcd-c9e8-4461-9bc1-c1119b1dd6e0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:07.195083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 299/609] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:16:06 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/6f5149b369e34afca6dd41a0082701e6/roles/a6ed0e9279a54b28a542e9a12ad503a3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:16:07.197370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f0c4-e71a-46e5-bf7a-f38556f73f96 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:07.197949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f0c4-e71a-46e5-bf7a-f38556f73f96 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:07.200048 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6f0c4-e71a-46e5-bf7a-f38556f73f96 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:07.206072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 300/610] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:07.208280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b90cf9-7c74-4738-92b5-d8ab88048e36 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:07.208823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b90cf9-7c74-4738-92b5-d8ab88048e36 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:07.209312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b90cf9-7c74-4738-92b5-d8ab88048e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:07.244237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-32b90cf9-7c74-4738-92b5-d8ab88048e36 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:07.246707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-32b90cf9-7c74-4738-92b5-d8ab88048e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:07.359180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 301/611] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:16:07.371254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f8fcd-c9e8-4461-9bc1-c1119b1dd6e0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:07.382103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:07.411206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cb027-b3e0-49ac-a366-f8bdd1b34cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:07.411855 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cb027-b3e0-49ac-a366-f8bdd1b34cd0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:07.412134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cb027-b3e0-49ac-a366-f8bdd1b34cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:07.412407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cb027-b3e0-49ac-a366-f8bdd1b34cd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:07.434511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cb027-b3e0-49ac-a366-f8bdd1b34cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-3f7cb027-b3e0-49ac-a366-f8bdd1b34cd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:07.439306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:07.447895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:07.449463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 311/612] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:07.450329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b90cf9-7c74-4738-92b5-d8ab88048e36 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:07.468654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:07.563862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b90cf9-7c74-4738-92b5-d8ab88048e36 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:07.611283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79158d-75c2-4482-a430-a7846106ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:07.611902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79158d-75c2-4482-a430-a7846106ab14 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:07.612185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79158d-75c2-4482-a430-a7846106ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:07.612459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79158d-75c2-4482-a430-a7846106ab14 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:07.613133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79158d-75c2-4482-a430-a7846106ab14 None admin] RBAC: Adding query filter params (name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:07.613445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79158d-75c2-4482-a430-a7846106ab14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:07.614871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79158d-75c2-4482-a430-a7846106ab14 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:07.624567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 302/613] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:07.629822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cb027-b3e0-49ac-a366-f8bdd1b34cd0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:07.676598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79158d-75c2-4482-a430-a7846106ab14 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:07.799352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:07.808491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cb027-b3e0-49ac-a366-f8bdd1b34cd0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:07.847008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79158d-75c2-4482-a430-a7846106ab14 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:07.878613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f9583-e30a-4861-ba36-afe1affe4061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:07.879252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9583-e30a-4861-ba36-afe1affe4061 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:07.879624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9583-e30a-4861-ba36-afe1affe4061 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:07.879898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9583-e30a-4861-ba36-afe1affe4061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:07.902627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f9583-e30a-4861-ba36-afe1affe4061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:07.904559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f9583-e30a-4861-ba36-afe1affe4061 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:07.906624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40307fa5-cbbb-43d1-995a-a56f6fad8177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:07.907321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40307fa5-cbbb-43d1-995a-a56f6fad8177 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:07.907599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40307fa5-cbbb-43d1-995a-a56f6fad8177 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:07.907869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40307fa5-cbbb-43d1-995a-a56f6fad8177 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:07.926142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40307fa5-cbbb-43d1-995a-a56f6fad8177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-40307fa5-cbbb-43d1-995a-a56f6fad8177 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:07.939851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:07.940864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:07.941743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-d44f9583-e30a-4861-ba36-afe1affe4061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:07.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:07.944271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:07.945352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:07.945352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:07.945352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:07.945352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 312/614] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:07.945621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 303/615] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:07.950577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40307fa5-cbbb-43d1-995a-a56f6fad8177 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:07.951188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f9583-e30a-4861-ba36-afe1affe4061 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:07.997863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:08.121024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40307fa5-cbbb-43d1-995a-a56f6fad8177 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:08.158830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78d21e-f982-45c5-b0cf-6989031efc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:08.159719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78d21e-f982-45c5-b0cf-6989031efc50 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.160210 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78d21e-f982-45c5-b0cf-6989031efc50 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.160492 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78d21e-f982-45c5-b0cf-6989031efc50 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.161211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78d21e-f982-45c5-b0cf-6989031efc50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:08.161513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78d21e-f982-45c5-b0cf-6989031efc50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:08.162909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78d21e-f982-45c5-b0cf-6989031efc50 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:08.171810 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f9583-e30a-4861-ba36-afe1affe4061 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:08.177902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:08.195364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 304/616] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:08.200707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78d21e-f982-45c5-b0cf-6989031efc50 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:08.242980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8704-cb62-4822-9f74-1bb9e3f36837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:08.243585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8704-cb62-4822-9f74-1bb9e3f36837 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.243862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8704-cb62-4822-9f74-1bb9e3f36837 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.244134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db8704-cb62-4822-9f74-1bb9e3f36837 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.245716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db8704-cb62-4822-9f74-1bb9e3f36837 None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:08.246118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db8704-cb62-4822-9f74-1bb9e3f36837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:08.247485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db8704-cb62-4822-9f74-1bb9e3f36837 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:08.267876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 313/617] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:08.272860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8704-cb62-4822-9f74-1bb9e3f36837 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:08.373759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78d21e-f982-45c5-b0cf-6989031efc50 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:08.441909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a4733-360d-455a-9949-6137646aea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:08.442550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4733-360d-455a-9949-6137646aea74 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.442683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:08.443092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4733-360d-455a-9949-6137646aea74 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.443092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4733-360d-455a-9949-6137646aea74 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.457945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a4733-360d-455a-9949-6137646aea74 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:08.463727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a4733-360d-455a-9949-6137646aea74 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:08.480033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db8704-cb62-4822-9f74-1bb9e3f36837 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-528a4733-360d-455a-9949-6137646aea74 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:08.490215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:08.491249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:08.492605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:08.492605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:08.492605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:08.492605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:08.492605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:08.492605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:08.492605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:08.492605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:08.492605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:08.492605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:08.492605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 305/618] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:08.500847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a4733-360d-455a-9949-6137646aea74 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:08.554712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203dbf7-eda2-4585-ace6-8cc0434d8905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:08.556494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203dbf7-eda2-4585-ace6-8cc0434d8905 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.556775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203dbf7-eda2-4585-ace6-8cc0434d8905 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.557054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203dbf7-eda2-4585-ace6-8cc0434d8905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.582285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203dbf7-eda2-4585-ace6-8cc0434d8905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:08.583810 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203dbf7-eda2-4585-ace6-8cc0434d8905 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:08.609936 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-2203dbf7-eda2-4585-ace6-8cc0434d8905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:08.614763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:08.615745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:08.616880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:08.616880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:08.616880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:08.616880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 314/619] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:08.622144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203dbf7-eda2-4585-ace6-8cc0434d8905 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:08.665944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a4733-360d-455a-9949-6137646aea74 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:08.702315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24da154-4560-408b-a0ff-671ae5bcf705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:08.702934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24da154-4560-408b-a0ff-671ae5bcf705 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.703212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24da154-4560-408b-a0ff-671ae5bcf705 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.703514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24da154-4560-408b-a0ff-671ae5bcf705 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.704481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24da154-4560-408b-a0ff-671ae5bcf705 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:08.704791 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24da154-4560-408b-a0ff-671ae5bcf705 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:08.709617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24da154-4560-408b-a0ff-671ae5bcf705 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:08.728452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 306/620] 10.222.0.74 () {56 vars in 1135 bytes} [Wed Aug 31 00:16:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:08.735447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24da154-4560-408b-a0ff-671ae5bcf705 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:08.844154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24da154-4560-408b-a0ff-671ae5bcf705 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:08.870556 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:08.882041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f6972-38ca-4a14-9e84-266c0bddef32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:08.883008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f6972-38ca-4a14-9e84-266c0bddef32 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:08.883008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f6972-38ca-4a14-9e84-266c0bddef32 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:08.883296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f6972-38ca-4a14-9e84-266c0bddef32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:08.895323 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f6972-38ca-4a14-9e84-266c0bddef32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:08.896952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f6972-38ca-4a14-9e84-266c0bddef32 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-392f6972-38ca-4a14-9e84-266c0bddef32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:08.913240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:08.914296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:08.915217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:08.915217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:08.915217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:08.915217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 307/621] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:08.922188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f6972-38ca-4a14-9e84-266c0bddef32 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:08.995624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203dbf7-eda2-4585-ace6-8cc0434d8905 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.032764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f6972-38ca-4a14-9e84-266c0bddef32 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.071668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae027d7-5093-438e-a179-7c13b28a6e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.072282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae027d7-5093-438e-a179-7c13b28a6e67 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.073048 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae027d7-5093-438e-a179-7c13b28a6e67 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.073328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae027d7-5093-438e-a179-7c13b28a6e67 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.074020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae027d7-5093-438e-a179-7c13b28a6e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:09.074416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae027d7-5093-438e-a179-7c13b28a6e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.075863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae027d7-5093-438e-a179-7c13b28a6e67 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.090852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 308/622] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:09.096404 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae027d7-5093-438e-a179-7c13b28a6e67 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.124769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c2db9-0e52-43df-9264-519da6c2b758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.125379 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c2db9-0e52-43df-9264-519da6c2b758 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.125686 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c2db9-0e52-43df-9264-519da6c2b758 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.125959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c2db9-0e52-43df-9264-519da6c2b758 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.126607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c2db9-0e52-43df-9264-519da6c2b758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:09.126905 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c2db9-0e52-43df-9264-519da6c2b758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.128281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c2db9-0e52-43df-9264-519da6c2b758 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.130051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:09.143948 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:09.145677 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 315/623] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:09.147227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb332c4-b994-4030-865a-8f9dd607743c None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.149325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb332c4-b994-4030-865a-8f9dd607743c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.149705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb332c4-b994-4030-865a-8f9dd607743c None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.151061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 316/624] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:09.156110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb332c4-b994-4030-865a-8f9dd607743c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.230135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae027d7-5093-438e-a179-7c13b28a6e67 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.267473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb332c4-b994-4030-865a-8f9dd607743c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.276982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a977b-5b24-4e48-9b8a-78a7e02c08a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.277961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a977b-5b24-4e48-9b8a-78a7e02c08a2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.278248 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a977b-5b24-4e48-9b8a-78a7e02c08a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.278520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a977b-5b24-4e48-9b8a-78a7e02c08a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.288266 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a977b-5b24-4e48-9b8a-78a7e02c08a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.289753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a977b-5b24-4e48-9b8a-78a7e02c08a2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-451a977b-5b24-4e48-9b8a-78a7e02c08a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:09.305773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:09.306759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:09.308294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:09.308294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:09.308294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:09.308294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:09.308294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:09.308294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:09.308294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:09.308294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:09.309994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456edb0b-d105-494b-a308-280bb9b699fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.310891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456edb0b-d105-494b-a308-280bb9b699fe None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.311386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456edb0b-d105-494b-a308-280bb9b699fe None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.311848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456edb0b-d105-494b-a308-280bb9b699fe None admin] PATH_INFO: `/v3/users/glance` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.312447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 309/625] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:09.313781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2562-33e0-4367-be56-3e7a3642e2e2 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.314066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2562-33e0-4367-be56-3e7a3642e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.314340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2562-33e0-4367-be56-3e7a3642e2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.321552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456edb0b-d105-494b-a308-280bb9b699fe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.324235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456edb0b-d105-494b-a308-280bb9b699fe None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.335964 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-543e2562-33e0-4367-be56-3e7a3642e2e2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:09.337166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-543e2562-33e0-4367-be56-3e7a3642e2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-456edb0b-d105-494b-a308-280bb9b699fe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:09.338088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:09.339141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:09.340078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:09.340078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:09.340078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:09.340078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:09.340078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:09.340078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:09.340078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:09.340078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:09.340078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 00:16:09.340078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:09.342454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 317/626] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:16:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:09.343454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456edb0b-d105-494b-a308-280bb9b699fe None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.404828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:09.415571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 310/627] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:09.416412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e2562-33e0-4367-be56-3e7a3642e2e2 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.440638 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:09.457109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456edb0b-d105-494b-a308-280bb9b699fe None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.494713 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb7c8e-82d3-4c76-a00d-1f3c5ceac0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.496039 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7c8e-82d3-4c76-a00d-1f3c5ceac0cc None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.496456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7c8e-82d3-4c76-a00d-1f3c5ceac0cc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.496855 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7c8e-82d3-4c76-a00d-1f3c5ceac0cc None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.497669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb7c8e-82d3-4c76-a00d-1f3c5ceac0cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:09.498074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb7c8e-82d3-4c76-a00d-1f3c5ceac0cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.499854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb7c8e-82d3-4c76-a00d-1f3c5ceac0cc None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.518013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 318/628] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:09.519136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a33f9-136c-4745-8910-1ba56a8368bd None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.519520 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a33f9-136c-4745-8910-1ba56a8368bd None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.519893 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a33f9-136c-4745-8910-1ba56a8368bd None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.521493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 319/629] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:09.522278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a33f9-136c-4745-8910-1ba56a8368bd None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.538163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e2562-33e0-4367-be56-3e7a3642e2e2 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.576998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dc271-fd60-4b9d-a3ab-5e01e540a304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.577956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dc271-fd60-4b9d-a3ab-5e01e540a304 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.578412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dc271-fd60-4b9d-a3ab-5e01e540a304 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.579412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dc271-fd60-4b9d-a3ab-5e01e540a304 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.580711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dc271-fd60-4b9d-a3ab-5e01e540a304 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:09.581023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dc271-fd60-4b9d-a3ab-5e01e540a304 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.582983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dc271-fd60-4b9d-a3ab-5e01e540a304 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.606421 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 311/630] 10.222.0.74 () {56 vars in 1137 bytes} [Wed Aug 31 00:16:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:09.608002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d181d-7706-43c7-9290-52e5510bc210 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.608585 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d181d-7706-43c7-9290-52e5510bc210 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.609064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d181d-7706-43c7-9290-52e5510bc210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.628368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a33f9-136c-4745-8910-1ba56a8368bd None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.628808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-606d181d-7706-43c7-9290-52e5510bc210 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:09.630039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-606d181d-7706-43c7-9290-52e5510bc210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:09.645552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:09.667311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5602-c9d1-4fc3-83f8-aa07da8d5a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.668023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5602-c9d1-4fc3-83f8-aa07da8d5a7c None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.668291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5602-c9d1-4fc3-83f8-aa07da8d5a7c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.668557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5602-c9d1-4fc3-83f8-aa07da8d5a7c None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/045ff88aba374cc889389ba07e884462/roles/a6ed0e9279a54b28a542e9a12ad503a3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.686052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c5602-c9d1-4fc3-83f8-aa07da8d5a7c None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=045ff88aba374cc889389ba07e884462, role_id=a6ed0e9279a54b28a542e9a12ad503a3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.687498 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c5602-c9d1-4fc3-83f8-aa07da8d5a7c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.708275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 312/631] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:09.709628 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a568-7be2-48ed-b58c-11538791d9af None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.710221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a568-7be2-48ed-b58c-11538791d9af None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.710221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a568-7be2-48ed-b58c-11538791d9af None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.711477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 313/632] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:09.712179 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029a568-7be2-48ed-b58c-11538791d9af None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.717048 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:09.753912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 320/633] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:16:09 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/045ff88aba374cc889389ba07e884462/roles/a6ed0e9279a54b28a542e9a12ad503a3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:09.754968 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5602-c9d1-4fc3-83f8-aa07da8d5a7c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:09.837558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029a568-7be2-48ed-b58c-11538791d9af None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.878356 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2bb5a-1e20-4983-bae7-5eaccc679c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.879339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2bb5a-1e20-4983-bae7-5eaccc679c63 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.879871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2bb5a-1e20-4983-bae7-5eaccc679c63 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.880366 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2bb5a-1e20-4983-bae7-5eaccc679c63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.889904 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5602-c9d1-4fc3-83f8-aa07da8d5a7c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:09.934839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b08507-ad9f-4ad4-8cd8-f8f1f473120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:09.935481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b08507-ad9f-4ad4-8cd8-f8f1f473120a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.935765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b08507-ad9f-4ad4-8cd8-f8f1f473120a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.936256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b08507-ad9f-4ad4-8cd8-f8f1f473120a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.946923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b08507-ad9f-4ad4-8cd8-f8f1f473120a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-59b08507-ad9f-4ad4-8cd8-f8f1f473120a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:09.954128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:09.955112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:09.955955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 321/634] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:09.956698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99fb62-49a0-44a4-8c63-cc2f4567a46a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:09.956698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99fb62-49a0-44a4-8c63-cc2f4567a46a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:09.957288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99fb62-49a0-44a4-8c63-cc2f4567a46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:09.965317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2bb5a-1e20-4983-bae7-5eaccc679c63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:09.968129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2bb5a-1e20-4983-bae7-5eaccc679c63 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:09.971173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:09.981224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2d99fb62-49a0-44a4-8c63-cc2f4567a46a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:09.982483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2d99fb62-49a0-44a4-8c63-cc2f4567a46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:10.004527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:10.063744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 322/635] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:10.065031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99fb62-49a0-44a4-8c63-cc2f4567a46a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.130958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 314/636] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:16:10.131825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2bb5a-1e20-4983-bae7-5eaccc679c63 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.185960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99fb62-49a0-44a4-8c63-cc2f4567a46a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.233469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc622547-a8be-485f-b7f9-ad917547e871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.234689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622547-a8be-485f-b7f9-ad917547e871 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.234970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622547-a8be-485f-b7f9-ad917547e871 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.235244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622547-a8be-485f-b7f9-ad917547e871 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.236189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc622547-a8be-485f-b7f9-ad917547e871 None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:10.236492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc622547-a8be-485f-b7f9-ad917547e871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.238580 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc622547-a8be-485f-b7f9-ad917547e871 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.246708 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2bb5a-1e20-4983-bae7-5eaccc679c63 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.250111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:10.254785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 323/637] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:10.254785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc622547-a8be-485f-b7f9-ad917547e871 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.277994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:10.296143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27767f-e079-479e-a50a-07dc1810f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.298031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27767f-e079-479e-a50a-07dc1810f813 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.298515 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27767f-e079-479e-a50a-07dc1810f813 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.298998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27767f-e079-479e-a50a-07dc1810f813 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.312795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27767f-e079-479e-a50a-07dc1810f813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-4a27767f-e079-479e-a50a-07dc1810f813 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:10.317881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:10.318822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:10.319687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:10.323895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 315/638] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:10.324773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27767f-e079-479e-a50a-07dc1810f813 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.377287 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc622547-a8be-485f-b7f9-ad917547e871 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.413910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651d474-5486-4fb4-9ceb-ddb4d99f887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.414752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651d474-5486-4fb4-9ceb-ddb4d99f887c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.415103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651d474-5486-4fb4-9ceb-ddb4d99f887c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.415510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651d474-5486-4fb4-9ceb-ddb4d99f887c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.427683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651d474-5486-4fb4-9ceb-ddb4d99f887c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.429261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651d474-5486-4fb4-9ceb-ddb4d99f887c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.430867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27767f-e079-479e-a50a-07dc1810f813 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-0651d474-5486-4fb4-9ceb-ddb4d99f887c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:10.446202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:10.447226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:10.448745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:10.448745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:10.448745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:10.448745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 324/639] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:10.448991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651d474-5486-4fb4-9ceb-ddb4d99f887c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.471276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e205bd-8f38-4396-9ff1-bfa2a03149fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.471967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e205bd-8f38-4396-9ff1-bfa2a03149fd None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.472253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e205bd-8f38-4396-9ff1-bfa2a03149fd None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.472526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e205bd-8f38-4396-9ff1-bfa2a03149fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.484123 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e205bd-8f38-4396-9ff1-bfa2a03149fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.485567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e205bd-8f38-4396-9ff1-bfa2a03149fd None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-45e205bd-8f38-4396-9ff1-bfa2a03149fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:10.502044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:10.503191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:10.504113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:10.504113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:10.504113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:10.504113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 316/640] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:10.504113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e205bd-8f38-4396-9ff1-bfa2a03149fd None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.525230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:10.530903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:10.567019 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651d474-5486-4fb4-9ceb-ddb4d99f887c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.603963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d227024-a1b2-4fc9-8d57-5b5ea9027c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.604970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d227024-a1b2-4fc9-8d57-5b5ea9027c6b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.605263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d227024-a1b2-4fc9-8d57-5b5ea9027c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.605666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d227024-a1b2-4fc9-8d57-5b5ea9027c6b None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.606340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d227024-a1b2-4fc9-8d57-5b5ea9027c6b None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:10.606652 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d227024-a1b2-4fc9-8d57-5b5ea9027c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.608028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d227024-a1b2-4fc9-8d57-5b5ea9027c6b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.608669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e205bd-8f38-4396-9ff1-bfa2a03149fd None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.616585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 325/641] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:10.617395 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d227024-a1b2-4fc9-8d57-5b5ea9027c6b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.646653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91e04c-9300-411e-b705-a8d5e633cb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.647278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e04c-9300-411e-b705-a8d5e633cb14 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.647559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e04c-9300-411e-b705-a8d5e633cb14 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.647832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91e04c-9300-411e-b705-a8d5e633cb14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.660454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91e04c-9300-411e-b705-a8d5e633cb14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-9b91e04c-9300-411e-b705-a8d5e633cb14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:10.665415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:10.666506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 317/642] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:10.668186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91e04c-9300-411e-b705-a8d5e633cb14 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.734793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d227024-a1b2-4fc9-8d57-5b5ea9027c6b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.751244 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:10.767249 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:10.773440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13537-68a6-4355-9102-c3500bc8cd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.776933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13537-68a6-4355-9102-c3500bc8cd5d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.777088 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91e04c-9300-411e-b705-a8d5e633cb14 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.777174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13537-68a6-4355-9102-c3500bc8cd5d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.777174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a13537-68a6-4355-9102-c3500bc8cd5d None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.777174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a13537-68a6-4355-9102-c3500bc8cd5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:10.777174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a13537-68a6-4355-9102-c3500bc8cd5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.777649 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a13537-68a6-4355-9102-c3500bc8cd5d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.790467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 326/643] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:10.791335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13537-68a6-4355-9102-c3500bc8cd5d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.815482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f23af0-325a-4912-a0b8-564a45d8e599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.816090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f23af0-325a-4912-a0b8-564a45d8e599 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.816366 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f23af0-325a-4912-a0b8-564a45d8e599 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.816684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f23af0-325a-4912-a0b8-564a45d8e599 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.817418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f23af0-325a-4912-a0b8-564a45d8e599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:10.817750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f23af0-325a-4912-a0b8-564a45d8e599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.819196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f23af0-325a-4912-a0b8-564a45d8e599 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.837218 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 318/644] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:10.837218 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f23af0-325a-4912-a0b8-564a45d8e599 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.911594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a13537-68a6-4355-9102-c3500bc8cd5d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.949823 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03b2cd-c4c1-44e4-ba7f-c745440fcbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.950215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f23af0-325a-4912-a0b8-564a45d8e599 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:10.950460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03b2cd-c4c1-44e4-ba7f-c745440fcbe0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.950745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03b2cd-c4c1-44e4-ba7f-c745440fcbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.951027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03b2cd-c4c1-44e4-ba7f-c745440fcbe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.963301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03b2cd-c4c1-44e4-ba7f-c745440fcbe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.965604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03b2cd-c4c1-44e4-ba7f-c745440fcbe0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-7a03b2cd-c4c1-44e4-ba7f-c745440fcbe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:10.983646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:10.984690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:10.986263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:10.986263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:10.986263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:10.986263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 327/645] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:10.986263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03b2cd-c4c1-44e4-ba7f-c745440fcbe0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:10.992498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c226bf-a0a2-44c1-afcd-72c9a5bd7106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:10.993110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c226bf-a0a2-44c1-afcd-72c9a5bd7106 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:10.993393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c226bf-a0a2-44c1-afcd-72c9a5bd7106 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:10.993693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c226bf-a0a2-44c1-afcd-72c9a5bd7106 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:10.994355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c226bf-a0a2-44c1-afcd-72c9a5bd7106 None admin] RBAC: Adding query filter params (name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:10.994656 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c226bf-a0a2-44c1-afcd-72c9a5bd7106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:10.996711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c226bf-a0a2-44c1-afcd-72c9a5bd7106 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:10.999494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.007514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 319/646] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:11.011015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c226bf-a0a2-44c1-afcd-72c9a5bd7106 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.035271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.097747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03b2cd-c4c1-44e4-ba7f-c745440fcbe0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.130269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c226bf-a0a2-44c1-afcd-72c9a5bd7106 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.136760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd65f4-df38-4ad7-956d-10aff32c9ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.137392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd65f4-df38-4ad7-956d-10aff32c9ecf None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.137695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd65f4-df38-4ad7-956d-10aff32c9ecf None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.138208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd65f4-df38-4ad7-956d-10aff32c9ecf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.145827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd65f4-df38-4ad7-956d-10aff32c9ecf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.147856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd65f4-df38-4ad7-956d-10aff32c9ecf None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-3fdd65f4-df38-4ad7-956d-10aff32c9ecf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:11.163534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:11.164641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:11.165760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:11.165760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:11.165760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:11.165760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:11.165760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:11.165760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:11.165760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:11.165760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:11.172285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 328/647] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:11.172285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd65f4-df38-4ad7-956d-10aff32c9ecf None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.172507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e715-ced9-4f5a-9507-186d8ac844a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.172507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e715-ced9-4f5a-9507-186d8ac844a1 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.172507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e715-ced9-4f5a-9507-186d8ac844a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.172507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e715-ced9-4f5a-9507-186d8ac844a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.179825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22e715-ced9-4f5a-9507-186d8ac844a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.182023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22e715-ced9-4f5a-9507-186d8ac844a1 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-0f22e715-ced9-4f5a-9507-186d8ac844a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:11.194848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:11.195884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 320/648] 10.222.0.74 () {56 vars in 1093 bytes} [Wed Aug 31 00:16:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:11.196840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e715-ced9-4f5a-9507-186d8ac844a1 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.273312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.288125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd65f4-df38-4ad7-956d-10aff32c9ecf None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.289653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.327048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97625764-91d1-40eb-aa7f-741ca766a86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.327667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97625764-91d1-40eb-aa7f-741ca766a86f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.327836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e715-ced9-4f5a-9507-186d8ac844a1 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.327937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97625764-91d1-40eb-aa7f-741ca766a86f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.328210 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97625764-91d1-40eb-aa7f-741ca766a86f None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.328862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97625764-91d1-40eb-aa7f-741ca766a86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:11.329180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97625764-91d1-40eb-aa7f-741ca766a86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.330606 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97625764-91d1-40eb-aa7f-741ca766a86f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.343998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 329/649] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:11.345130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97625764-91d1-40eb-aa7f-741ca766a86f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.371546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06aee8-331d-4601-8a1d-db8fbbbb18ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.372194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06aee8-331d-4601-8a1d-db8fbbbb18ec None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.372485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06aee8-331d-4601-8a1d-db8fbbbb18ec None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.372763 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06aee8-331d-4601-8a1d-db8fbbbb18ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.384320 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06aee8-331d-4601-8a1d-db8fbbbb18ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.386368 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06aee8-331d-4601-8a1d-db8fbbbb18ec None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-de06aee8-331d-4601-8a1d-db8fbbbb18ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:11.402116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:11.403158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:11.404058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:11.404058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:11.404058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:11.404058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 321/650] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:11.404058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06aee8-331d-4601-8a1d-db8fbbbb18ec None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.461184 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97625764-91d1-40eb-aa7f-741ca766a86f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.497725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417575e0-1a4d-460e-974d-ceded87fe910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.498337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417575e0-1a4d-460e-974d-ceded87fe910 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.498617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417575e0-1a4d-460e-974d-ceded87fe910 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.498890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417575e0-1a4d-460e-974d-ceded87fe910 None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.499586 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417575e0-1a4d-460e-974d-ceded87fe910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:11.499895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417575e0-1a4d-460e-974d-ceded87fe910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.501314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417575e0-1a4d-460e-974d-ceded87fe910 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.513270 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06aee8-331d-4601-8a1d-db8fbbbb18ec None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.513894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 330/651] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:11.514716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417575e0-1a4d-460e-974d-ceded87fe910 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.529852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.542377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.553887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48df24-c00a-48fa-9e42-74d3fd12e20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.554495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df24-c00a-48fa-9e42-74d3fd12e20e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.554778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df24-c00a-48fa-9e42-74d3fd12e20e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.555052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df24-c00a-48fa-9e42-74d3fd12e20e None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.555783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48df24-c00a-48fa-9e42-74d3fd12e20e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:11.556089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48df24-c00a-48fa-9e42-74d3fd12e20e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.558199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48df24-c00a-48fa-9e42-74d3fd12e20e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.582192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 322/652] 10.222.0.74 () {56 vars in 1133 bytes} [Wed Aug 31 00:16:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:11.582192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48df24-c00a-48fa-9e42-74d3fd12e20e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.625188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417575e0-1a4d-460e-974d-ceded87fe910 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.659047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177eb0-4d61-4ec9-829b-e92acc90bd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.659710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177eb0-4d61-4ec9-829b-e92acc90bd9c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.659964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177eb0-4d61-4ec9-829b-e92acc90bd9c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.660248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c177eb0-4d61-4ec9-829b-e92acc90bd9c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.668573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c177eb0-4d61-4ec9-829b-e92acc90bd9c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.670334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c177eb0-4d61-4ec9-829b-e92acc90bd9c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-8c177eb0-4d61-4ec9-829b-e92acc90bd9c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:11.681845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:11.683668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 331/653] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:16:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:11.684627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177eb0-4d61-4ec9-829b-e92acc90bd9c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.694933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48df24-c00a-48fa-9e42-74d3fd12e20e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.729749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30c576-a89f-4eac-b0f7-4296a7504ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.730364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30c576-a89f-4eac-b0f7-4296a7504ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.730649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30c576-a89f-4eac-b0f7-4296a7504ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.730930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30c576-a89f-4eac-b0f7-4296a7504ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.731825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30c576-a89f-4eac-b0f7-4296a7504ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:11.731959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30c576-a89f-4eac-b0f7-4296a7504ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.733471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30c576-a89f-4eac-b0f7-4296a7504ef1 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.745500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 323/654] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:11.746537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30c576-a89f-4eac-b0f7-4296a7504ef1 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.774615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.779589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:11.791985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c177eb0-4d61-4ec9-829b-e92acc90bd9c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.825815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a52d4-8908-45f2-a7c2-de9845019c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.826340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a52d4-8908-45f2-a7c2-de9845019c23 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.826628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a52d4-8908-45f2-a7c2-de9845019c23 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.826904 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a52d4-8908-45f2-a7c2-de9845019c23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.827622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a52d4-8908-45f2-a7c2-de9845019c23 None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=d8590378b14c49cf9266a0d859db5bf0) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:11.827932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a52d4-8908-45f2-a7c2-de9845019c23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.829375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a52d4-8908-45f2-a7c2-de9845019c23 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:11.835779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 332/655] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:11 2022] GET /identity/v3/role_assignments?user.id=d8590378b14c49cf9266a0d859db5bf0&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:11.836564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a52d4-8908-45f2-a7c2-de9845019c23 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:11.852632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30c576-a89f-4eac-b0f7-4296a7504ef1 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.900018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f553c-f48d-4265-8e93-ea83c3798c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:11.901646 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f553c-f48d-4265-8e93-ea83c3798c46 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:11.901933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f553c-f48d-4265-8e93-ea83c3798c46 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:11.902208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f553c-f48d-4265-8e93-ea83c3798c46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:11.957035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a52d4-8908-45f2-a7c2-de9845019c23 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:11.983162 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f553c-f48d-4265-8e93-ea83c3798c46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:11.985736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f553c-f48d-4265-8e93-ea83c3798c46 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.000028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05bd78-2e50-4b58-a1b0-3fa7f3a9f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.000646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05bd78-2e50-4b58-a1b0-3fa7f3a9f70f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.000926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05bd78-2e50-4b58-a1b0-3fa7f3a9f70f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.001200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05bd78-2e50-4b58-a1b0-3fa7f3a9f70f None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.001975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05bd78-2e50-4b58-a1b0-3fa7f3a9f70f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:12.002297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05bd78-2e50-4b58-a1b0-3fa7f3a9f70f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.003710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05bd78-2e50-4b58-a1b0-3fa7f3a9f70f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.020557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:12.022912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 333/656] 10.222.0.74 () {56 vars in 1137 bytes} [Wed Aug 31 00:16:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:12.024833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05bd78-2e50-4b58-a1b0-3fa7f3a9f70f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.030646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:12.104939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 324/657] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:16:12.106210 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a79391-714a-4f72-983b-e1e57f0da4fd None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.106496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a79391-714a-4f72-983b-e1e57f0da4fd None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.106770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a79391-714a-4f72-983b-e1e57f0da4fd None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.108150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 325/658] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:12.108691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a79391-714a-4f72-983b-e1e57f0da4fd None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.141495 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05bd78-2e50-4b58-a1b0-3fa7f3a9f70f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.178230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5092e-ecae-4d6b-9529-5f2a11af45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.178868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5092e-ecae-4d6b-9529-5f2a11af45a3 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.179156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5092e-ecae-4d6b-9529-5f2a11af45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.179429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5092e-ecae-4d6b-9529-5f2a11af45a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.186611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5092e-ecae-4d6b-9529-5f2a11af45a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.188048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5092e-ecae-4d6b-9529-5f2a11af45a3 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-cad5092e-ecae-4d6b-9529-5f2a11af45a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:12.200285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:12.201285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:12.202275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:12.202275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:12.202275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:12.202275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:12.202275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:12.202275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:12.202275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:12.202275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:12.202275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 00:16:12.202275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:12.202275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 334/659] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:12.202900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e17e84-6e72-4b8c-8183-ad78feb9c944 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.202900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e17e84-6e72-4b8c-8183-ad78feb9c944 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.203389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e17e84-6e72-4b8c-8183-ad78feb9c944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.222665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-73e17e84-6e72-4b8c-8183-ad78feb9c944 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:12.224192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-73e17e84-6e72-4b8c-8183-ad78feb9c944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:12.227202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a79391-714a-4f72-983b-e1e57f0da4fd None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.256827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:12.267033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458e5fe-4152-40d2-a3cf-8a277eafb677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.267655 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458e5fe-4152-40d2-a3cf-8a277eafb677 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.267938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458e5fe-4152-40d2-a3cf-8a277eafb677 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.268213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458e5fe-4152-40d2-a3cf-8a277eafb677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.295318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:12.313447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 335/660] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:12.313447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e17e84-6e72-4b8c-8183-ad78feb9c944 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.358992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458e5fe-4152-40d2-a3cf-8a277eafb677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.360382 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458e5fe-4152-40d2-a3cf-8a277eafb677 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.441056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e17e84-6e72-4b8c-8183-ad78feb9c944 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.471042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 326/661] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:16:12.472031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458e5fe-4152-40d2-a3cf-8a277eafb677 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.482876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bf189-ae61-41d5-b48b-60778c7ea27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.483517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bf189-ae61-41d5-b48b-60778c7ea27a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.483796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bf189-ae61-41d5-b48b-60778c7ea27a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.484070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bf189-ae61-41d5-b48b-60778c7ea27a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.498206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bf189-ae61-41d5-b48b-60778c7ea27a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.500125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bf189-ae61-41d5-b48b-60778c7ea27a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.503121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-376bf189-ae61-41d5-b48b-60778c7ea27a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:12.518721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:12.519942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:12.525466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:12.525466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:12.525466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:12.525466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 336/662] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:12.525466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bf189-ae61-41d5-b48b-60778c7ea27a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.581047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:12.594443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458e5fe-4152-40d2-a3cf-8a277eafb677 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.631900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca1ffc-5bdb-4994-91d1-df52cc15f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.632477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca1ffc-5bdb-4994-91d1-df52cc15f29a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.632701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca1ffc-5bdb-4994-91d1-df52cc15f29a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.632970 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca1ffc-5bdb-4994-91d1-df52cc15f29a None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.633829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca1ffc-5bdb-4994-91d1-df52cc15f29a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:12.634133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca1ffc-5bdb-4994-91d1-df52cc15f29a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.636364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca1ffc-5bdb-4994-91d1-df52cc15f29a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.644604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bf189-ae61-41d5-b48b-60778c7ea27a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.653553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 327/663] 10.222.0.74 () {56 vars in 1139 bytes} [Wed Aug 31 00:16:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:12.654395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca1ffc-5bdb-4994-91d1-df52cc15f29a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.687283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3093c-624a-4aec-9669-cfb631da8b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.687918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3093c-624a-4aec-9669-cfb631da8b8c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.688195 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3093c-624a-4aec-9669-cfb631da8b8c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.688475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3093c-624a-4aec-9669-cfb631da8b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.699461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3093c-624a-4aec-9669-cfb631da8b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.700930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3093c-624a-4aec-9669-cfb631da8b8c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-85e3093c-624a-4aec-9669-cfb631da8b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:12.716460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:12.717547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:12.718475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:12.718475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:12.718475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:12.718475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 337/664] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:12.718475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3093c-624a-4aec-9669-cfb631da8b8c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.754182 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:12.771028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca1ffc-5bdb-4994-91d1-df52cc15f29a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.810649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdbccd-24cc-4994-b3ad-b1e3e94b2f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.811256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdbccd-24cc-4994-b3ad-b1e3e94b2f9b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.811540 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdbccd-24cc-4994-b3ad-b1e3e94b2f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.811813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdbccd-24cc-4994-b3ad-b1e3e94b2f9b None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.812455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdbccd-24cc-4994-b3ad-b1e3e94b2f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:12.812826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdbccd-24cc-4994-b3ad-b1e3e94b2f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:12.814235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdbccd-24cc-4994-b3ad-b1e3e94b2f9b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:12.830714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 328/665] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:12.830714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdbccd-24cc-4994-b3ad-b1e3e94b2f9b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.836498 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:12.842059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3093c-624a-4aec-9669-cfb631da8b8c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.881305 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f5e28-caf4-4dee-972b-f03ebf32cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.882033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f5e28-caf4-4dee-972b-f03ebf32cc4a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.882268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f5e28-caf4-4dee-972b-f03ebf32cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.882535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f5e28-caf4-4dee-972b-f03ebf32cc4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.894420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f5e28-caf4-4dee-972b-f03ebf32cc4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-8f8f5e28-caf4-4dee-972b-f03ebf32cc4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:12.899852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:12.900818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 338/666] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:12.902619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f5e28-caf4-4dee-972b-f03ebf32cc4a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:12.946462 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdbccd-24cc-4994-b3ad-b1e3e94b2f9b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:12.981712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d3b15-0043-4b32-9ee6-57ab042cf2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:12.982307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d3b15-0043-4b32-9ee6-57ab042cf2bb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:12.982588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d3b15-0043-4b32-9ee6-57ab042cf2bb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:12.982863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d3b15-0043-4b32-9ee6-57ab042cf2bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:12.999850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:13.016072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f5e28-caf4-4dee-972b-f03ebf32cc4a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.050606 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe4f3-4e12-4429-89a5-4676d6004226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.051212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe4f3-4e12-4429-89a5-4676d6004226 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.051488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe4f3-4e12-4429-89a5-4676d6004226 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.051761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbe4f3-4e12-4429-89a5-4676d6004226 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.052399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbe4f3-4e12-4429-89a5-4676d6004226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:13.052699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbe4f3-4e12-4429-89a5-4676d6004226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.054098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbe4f3-4e12-4429-89a5-4676d6004226 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.061040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d3b15-0043-4b32-9ee6-57ab042cf2bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.062526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d3b15-0043-4b32-9ee6-57ab042cf2bb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.070957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 339/667] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:13.070957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe4f3-4e12-4429-89a5-4676d6004226 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.090830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:13.173649 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbe4f3-4e12-4429-89a5-4676d6004226 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.178020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 329/668] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:16:13.179085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d3b15-0043-4b32-9ee6-57ab042cf2bb None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.212303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c086f01-0cb2-487f-a35d-ccbeb18de4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.212933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c086f01-0cb2-487f-a35d-ccbeb18de4c9 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.213209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c086f01-0cb2-487f-a35d-ccbeb18de4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.213700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c086f01-0cb2-487f-a35d-ccbeb18de4c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.220853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c086f01-0cb2-487f-a35d-ccbeb18de4c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.222321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c086f01-0cb2-487f-a35d-ccbeb18de4c9 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.227522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-9c086f01-0cb2-487f-a35d-ccbeb18de4c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:13.233949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:13.234873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:13.242989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:13.242989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:13.242989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:13.242989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:13.242989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:13.242989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:13.242989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:13.242989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:13.242989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 340/669] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:13.242989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c086f01-0cb2-487f-a35d-ccbeb18de4c9 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.287381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d3b15-0043-4b32-9ee6-57ab042cf2bb None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.325230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:13.327809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd4349-10ed-4834-92ee-e97f2aeba519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.328437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4349-10ed-4834-92ee-e97f2aeba519 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.328780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4349-10ed-4834-92ee-e97f2aeba519 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.329072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd4349-10ed-4834-92ee-e97f2aeba519 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.329757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd4349-10ed-4834-92ee-e97f2aeba519 None admin] RBAC: Adding query filter params (name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:13.330303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd4349-10ed-4834-92ee-e97f2aeba519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.331444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd4349-10ed-4834-92ee-e97f2aeba519 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.340460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 330/670] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:13.341096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd4349-10ed-4834-92ee-e97f2aeba519 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.352898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c086f01-0cb2-487f-a35d-ccbeb18de4c9 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.392660 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855b38c-f6e6-4f4e-b3af-8bbea1afdcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.393296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b38c-f6e6-4f4e-b3af-8bbea1afdcd5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.393590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b38c-f6e6-4f4e-b3af-8bbea1afdcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.393868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855b38c-f6e6-4f4e-b3af-8bbea1afdcd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.401360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855b38c-f6e6-4f4e-b3af-8bbea1afdcd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.402837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855b38c-f6e6-4f4e-b3af-8bbea1afdcd5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-7855b38c-f6e6-4f4e-b3af-8bbea1afdcd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:13.414448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:13.415849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:13.417859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:13.417859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:13.417859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:13.417859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:13.417859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:13.417859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:13.417859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:13.417859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:13.417859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 341/671] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:13.417859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855b38c-f6e6-4f4e-b3af-8bbea1afdcd5 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.476678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd4349-10ed-4834-92ee-e97f2aeba519 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.486411 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:13.513641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8d002-5296-403a-acbb-e0cf3b8d0a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.514282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8d002-5296-403a-acbb-e0cf3b8d0a38 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.514604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8d002-5296-403a-acbb-e0cf3b8d0a38 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.514841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8d002-5296-403a-acbb-e0cf3b8d0a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.525478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8d002-5296-403a-acbb-e0cf3b8d0a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.527185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8d002-5296-403a-acbb-e0cf3b8d0a38 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.527371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855b38c-f6e6-4f4e-b3af-8bbea1afdcd5 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-d6d8d002-5296-403a-acbb-e0cf3b8d0a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:13.545261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:13.546314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:13.547221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:13.547221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:13.547221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:13.547221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 331/672] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:13.547221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8d002-5296-403a-acbb-e0cf3b8d0a38 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.568541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e61fe6-d038-44cf-9d75-8a37da3c15fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.569151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e61fe6-d038-44cf-9d75-8a37da3c15fd None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.569435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e61fe6-d038-44cf-9d75-8a37da3c15fd None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.569743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e61fe6-d038-44cf-9d75-8a37da3c15fd None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.570547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e61fe6-d038-44cf-9d75-8a37da3c15fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:13.570863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e61fe6-d038-44cf-9d75-8a37da3c15fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.572283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e61fe6-d038-44cf-9d75-8a37da3c15fd None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.579593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:13.590235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 342/673] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:13.590235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e61fe6-d038-44cf-9d75-8a37da3c15fd None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.654245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8d002-5296-403a-acbb-e0cf3b8d0a38 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.692638 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104b1cd-d702-4c37-a24d-5475fe00e62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.693365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104b1cd-d702-4c37-a24d-5475fe00e62b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.693755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104b1cd-d702-4c37-a24d-5475fe00e62b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.694085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e61fe6-d038-44cf-9d75-8a37da3c15fd None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.694200 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104b1cd-d702-4c37-a24d-5475fe00e62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.704949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104b1cd-d702-4c37-a24d-5475fe00e62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.706542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104b1cd-d702-4c37-a24d-5475fe00e62b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-6104b1cd-d702-4c37-a24d-5475fe00e62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:13.724673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:13.725871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:13.726878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:13.726878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:13.726878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:13.726878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 332/674] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:13.727458 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104b1cd-d702-4c37-a24d-5475fe00e62b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.735393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e949f7-24db-465b-93c5-f26250ca8b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.736007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e949f7-24db-465b-93c5-f26250ca8b5c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.736285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e949f7-24db-465b-93c5-f26250ca8b5c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.736553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e949f7-24db-465b-93c5-f26250ca8b5c None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.737245 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e949f7-24db-465b-93c5-f26250ca8b5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:13.737547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e949f7-24db-465b-93c5-f26250ca8b5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.738999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e949f7-24db-465b-93c5-f26250ca8b5c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.755836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:13.758706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 343/675] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:13.759523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e949f7-24db-465b-93c5-f26250ca8b5c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.826618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:13.860444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104b1cd-d702-4c37-a24d-5475fe00e62b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.870015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e949f7-24db-465b-93c5-f26250ca8b5c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:13.895796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04737504-172d-47ee-96a3-1717dcda47cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.896413 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737504-172d-47ee-96a3-1717dcda47cf None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.896690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737504-172d-47ee-96a3-1717dcda47cf None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.896962 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04737504-172d-47ee-96a3-1717dcda47cf None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.897618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04737504-172d-47ee-96a3-1717dcda47cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:13.897923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04737504-172d-47ee-96a3-1717dcda47cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.899300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04737504-172d-47ee-96a3-1717dcda47cf None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.909024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a66d68-35b2-4710-862a-51a27417b93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:13.909655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a66d68-35b2-4710-862a-51a27417b93c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:13.909934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a66d68-35b2-4710-862a-51a27417b93c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:13.910371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a66d68-35b2-4710-862a-51a27417b93c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:13.911098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a66d68-35b2-4710-862a-51a27417b93c None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=90147848fe604ca9912d10a214a45227) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:13.911408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a66d68-35b2-4710-862a-51a27417b93c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:13.911850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 333/676] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:13.912667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04737504-172d-47ee-96a3-1717dcda47cf None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.913043 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a66d68-35b2-4710-862a-51a27417b93c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:13.920310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 344/677] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/role_assignments?user.id=90147848fe604ca9912d10a214a45227&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:13.921099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a66d68-35b2-4710-862a-51a27417b93c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:13.997411 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:14.033289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04737504-172d-47ee-96a3-1717dcda47cf None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.051288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a66d68-35b2-4710-862a-51a27417b93c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.075670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc60471-f9b4-4765-9e45-2ab8667f2eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.076649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc60471-f9b4-4765-9e45-2ab8667f2eb6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.077040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc60471-f9b4-4765-9e45-2ab8667f2eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.077384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc60471-f9b4-4765-9e45-2ab8667f2eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.078143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc60471-f9b4-4765-9e45-2ab8667f2eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:14.078455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc60471-f9b4-4765-9e45-2ab8667f2eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.079182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:14.080637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc60471-f9b4-4765-9e45-2ab8667f2eb6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.092652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 334/678] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:14.094420 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1bd2-7b48-441f-86cc-a172751ca6c7 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.094830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1bd2-7b48-441f-86cc-a172751ca6c7 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.095203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1bd2-7b48-441f-86cc-a172751ca6c7 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.096465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 335/679] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:14.097348 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e1bd2-7b48-441f-86cc-a172751ca6c7 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:14.098278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8677c-dfeb-4cec-b03a-a0dfaee18b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.098960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8677c-dfeb-4cec-b03a-a0dfaee18b22 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.099433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8677c-dfeb-4cec-b03a-a0dfaee18b22 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.099781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8677c-dfeb-4cec-b03a-a0dfaee18b22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.100593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8677c-dfeb-4cec-b03a-a0dfaee18b22 None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=75f62fa62f2d420a998f236ff7f9b6b9) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:14.100905 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8677c-dfeb-4cec-b03a-a0dfaee18b22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.102397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8677c-dfeb-4cec-b03a-a0dfaee18b22 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.109176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 345/680] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:13 2022] GET /identity/v3/role_assignments?user.id=75f62fa62f2d420a998f236ff7f9b6b9&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:14.110101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8677c-dfeb-4cec-b03a-a0dfaee18b22 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:14.250100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e1bd2-7b48-441f-86cc-a172751ca6c7 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.250589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8677c-dfeb-4cec-b03a-a0dfaee18b22 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.292340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:14.299479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b262-8bf9-4b6c-ae40-76b18a183ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.300122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b262-8bf9-4b6c-ae40-76b18a183ae7 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.300401 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b262-8bf9-4b6c-ae40-76b18a183ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.300672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b262-8bf9-4b6c-ae40-76b18a183ae7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.304786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812a54e-0987-492a-890a-e52dff6e9a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.305730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812a54e-0987-492a-890a-e52dff6e9a23 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.305730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812a54e-0987-492a-890a-e52dff6e9a23 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.305993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812a54e-0987-492a-890a-e52dff6e9a23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.315403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812a54e-0987-492a-890a-e52dff6e9a23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.327454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561b262-8bf9-4b6c-ae40-76b18a183ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.327589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812a54e-0987-492a-890a-e52dff6e9a23 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.327684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561b262-8bf9-4b6c-ae40-76b18a183ae7 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-3812a54e-0987-492a-890a-e52dff6e9a23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:14.329062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:14.329967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:14.330903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:14.330903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:14.330903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:14.330903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:14.330903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:14.330903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:14.330903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:14.330903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-b561b262-8bf9-4b6c-ae40-76b18a183ae7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:14.331352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:14.332843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:14.335147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:14.335147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:14.335147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:14.335147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:14.335147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:14.335147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:14.335147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:14.335147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:14.335147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:14.335147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:14.337882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 336/681] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:14.337882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423421-9ea1-4e51-8251-a5be015422c4 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.337882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423421-9ea1-4e51-8251-a5be015422c4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.337882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a423421-9ea1-4e51-8251-a5be015422c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.338150 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 346/682] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:14.338150 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b262-8bf9-4b6c-ae40-76b18a183ae7 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:14.359277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-7a423421-9ea1-4e51-8251-a5be015422c4 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:14.360973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7a423421-9ea1-4e51-8251-a5be015422c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:14.400948 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:14.445295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 337/683] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:14.446311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a423421-9ea1-4e51-8251-a5be015422c4 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:14.465965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b262-8bf9-4b6c-ae40-76b18a183ae7 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.511526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27a320-bcfd-4558-913f-351684930283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.512497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27a320-bcfd-4558-913f-351684930283 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.512993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27a320-bcfd-4558-913f-351684930283 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.513598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27a320-bcfd-4558-913f-351684930283 None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.514477 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27a320-bcfd-4558-913f-351684930283 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:14.515017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27a320-bcfd-4558-913f-351684930283 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.516732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27a320-bcfd-4558-913f-351684930283 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.542305 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 347/684] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:14.548075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27a320-bcfd-4558-913f-351684930283 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:14.565854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a423421-9ea1-4e51-8251-a5be015422c4 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.595941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:14.610425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc74bf-8828-4243-9817-d651e40fdd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.611045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc74bf-8828-4243-9817-d651e40fdd06 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.611327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc74bf-8828-4243-9817-d651e40fdd06 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.611605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc74bf-8828-4243-9817-d651e40fdd06 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.612779 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc74bf-8828-4243-9817-d651e40fdd06 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:14.613091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc74bf-8828-4243-9817-d651e40fdd06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.614858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc74bf-8828-4243-9817-d651e40fdd06 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.641601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 338/685] 10.222.0.74 () {56 vars in 1135 bytes} [Wed Aug 31 00:16:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:14.646986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc74bf-8828-4243-9817-d651e40fdd06 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:14.683324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27a320-bcfd-4558-913f-351684930283 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.692323 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:14.730546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60cc61-4445-481e-9275-06baba414db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.731444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60cc61-4445-481e-9275-06baba414db0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.731902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60cc61-4445-481e-9275-06baba414db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.732349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60cc61-4445-481e-9275-06baba414db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.733270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60cc61-4445-481e-9275-06baba414db0 None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=6f5149b369e34afca6dd41a0082701e6) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:14.733746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60cc61-4445-481e-9275-06baba414db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:14.735496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60cc61-4445-481e-9275-06baba414db0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:14.748750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 348/686] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:14 2022] GET /identity/v3/role_assignments?user.id=6f5149b369e34afca6dd41a0082701e6&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:14.827180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc74bf-8828-4243-9817-d651e40fdd06 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.848417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60cc61-4445-481e-9275-06baba414db0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:14.888970 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac0b95-7cfe-4c95-be62-9abd791ac8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:14.889251 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0b95-7cfe-4c95-be62-9abd791ac8d7 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:14.889661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0b95-7cfe-4c95-be62-9abd791ac8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:14.890036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0b95-7cfe-4c95-be62-9abd791ac8d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:14.971248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60cc61-4445-481e-9275-06baba414db0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:14.978687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:15.005389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac0b95-7cfe-4c95-be62-9abd791ac8d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.006928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac0b95-7cfe-4c95-be62-9abd791ac8d7 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:15.016262 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b585a8-d55f-4acc-b1e3-26a9fb8334e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:15.017540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b585a8-d55f-4acc-b1e3-26a9fb8334e1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.017996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b585a8-d55f-4acc-b1e3-26a9fb8334e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.018416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b585a8-d55f-4acc-b1e3-26a9fb8334e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.033054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b585a8-d55f-4acc-b1e3-26a9fb8334e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.035181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b585a8-d55f-4acc-b1e3-26a9fb8334e1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-10b585a8-d55f-4acc-b1e3-26a9fb8334e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:15.054981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:15.056182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:15.057545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:15.057545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:15.057545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:15.059945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 349/687] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:15.065668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b585a8-d55f-4acc-b1e3-26a9fb8334e1 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:15.099162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:15.128412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 339/688] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:16:15.135501 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac0b95-7cfe-4c95-be62-9abd791ac8d7 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:15.252545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b585a8-d55f-4acc-b1e3-26a9fb8334e1 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:15.288194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac0b95-7cfe-4c95-be62-9abd791ac8d7 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:15.300635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:15.329462 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f59d0-e5b1-444f-ae06-64cd3181906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:15.330373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f59d0-e5b1-444f-ae06-64cd3181906a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.330803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f59d0-e5b1-444f-ae06-64cd3181906a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.331309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f59d0-e5b1-444f-ae06-64cd3181906a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.332177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bce07f-cd5f-4f60-82c4-2cef93ff5528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:15.332901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bce07f-cd5f-4f60-82c4-2cef93ff5528 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.333285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bce07f-cd5f-4f60-82c4-2cef93ff5528 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.333707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bce07f-cd5f-4f60-82c4-2cef93ff5528 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.334440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bce07f-cd5f-4f60-82c4-2cef93ff5528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:15.334815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bce07f-cd5f-4f60-82c4-2cef93ff5528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.336268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bce07f-cd5f-4f60-82c4-2cef93ff5528 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:15.344484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f59d0-e5b1-444f-ae06-64cd3181906a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.347348 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f59d0-e5b1-444f-ae06-64cd3181906a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-c11f59d0-e5b1-444f-ae06-64cd3181906a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:15.365209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:15.366321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:15.367258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:15.367258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:15.367258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:15.369402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 340/689] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:15.373863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 350/690] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:15.380714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f59d0-e5b1-444f-ae06-64cd3181906a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:15.382067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bce07f-cd5f-4f60-82c4-2cef93ff5528 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:15.519117 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:15.539252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bce07f-cd5f-4f60-82c4-2cef93ff5528 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:15.577881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e9ca6-a692-471c-b680-bc5b5f2563c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:15.578498 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e9ca6-a692-471c-b680-bc5b5f2563c7 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.578789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e9ca6-a692-471c-b680-bc5b5f2563c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.579069 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e9ca6-a692-471c-b680-bc5b5f2563c7 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.579716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e9ca6-a692-471c-b680-bc5b5f2563c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:15.580023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e9ca6-a692-471c-b680-bc5b5f2563c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.581399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e9ca6-a692-471c-b680-bc5b5f2563c7 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:15.595080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f59d0-e5b1-444f-ae06-64cd3181906a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:15.610408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 351/691] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:15.617283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e9ca6-a692-471c-b680-bc5b5f2563c7 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:15.659626 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:15.669589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224d5e9-caca-4eec-9e3d-64453a2108aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:15.671690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224d5e9-caca-4eec-9e3d-64453a2108aa None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.671690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224d5e9-caca-4eec-9e3d-64453a2108aa None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.671690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224d5e9-caca-4eec-9e3d-64453a2108aa None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.671690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224d5e9-caca-4eec-9e3d-64453a2108aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.673077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224d5e9-caca-4eec-9e3d-64453a2108aa None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:15.758114 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e9ca6-a692-471c-b680-bc5b5f2563c7 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:15.776853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 341/692] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:16:15 2022] POST /identity/v3/users => generated 254 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:15.797978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb315e82-fa9b-4766-ab06-066a51401dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:15.798642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb315e82-fa9b-4766-ab06-066a51401dd0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:15.798910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb315e82-fa9b-4766-ab06-066a51401dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:15.799178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb315e82-fa9b-4766-ab06-066a51401dd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:15.808081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb315e82-fa9b-4766-ab06-066a51401dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:15.809710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb315e82-fa9b-4766-ab06-066a51401dd0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-bb315e82-fa9b-4766-ab06-066a51401dd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:15.822504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:15.824081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:15.824981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:15.824981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:15.824981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:15.824981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:15.824981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:15.824981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:15.824981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:15.824981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:15.824981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 352/693] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:15.830804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224d5e9-caca-4eec-9e3d-64453a2108aa None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.076806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224d5e9-caca-4eec-9e3d-64453a2108aa None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.116633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ae45b-85d4-4b69-af90-de377cdf938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.117252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ae45b-85d4-4b69-af90-de377cdf938f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.117533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ae45b-85d4-4b69-af90-de377cdf938f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.117906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ae45b-85d4-4b69-af90-de377cdf938f None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.118616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ae45b-85d4-4b69-af90-de377cdf938f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:16.118925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ae45b-85d4-4b69-af90-de377cdf938f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.120950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ae45b-85d4-4b69-af90-de377cdf938f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.134328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 342/694] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:16.140263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb315e82-fa9b-4766-ab06-066a51401dd0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.143217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:16.248801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb315e82-fa9b-4766-ab06-066a51401dd0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.286643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d98357-e166-41f9-b77a-6ee06068ca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.287254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d98357-e166-41f9-b77a-6ee06068ca15 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.287540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d98357-e166-41f9-b77a-6ee06068ca15 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.287819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d98357-e166-41f9-b77a-6ee06068ca15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.288610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d98357-e166-41f9-b77a-6ee06068ca15 None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=045ff88aba374cc889389ba07e884462) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:16.288926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d98357-e166-41f9-b77a-6ee06068ca15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.290392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d98357-e166-41f9-b77a-6ee06068ca15 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.298436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 353/695] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:16 2022] GET /identity/v3/role_assignments?user.id=045ff88aba374cc889389ba07e884462&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:16.409303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04804b2-a218-4696-a728-de28b93080b3 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.409476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04804b2-a218-4696-a728-de28b93080b3 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.410015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04804b2-a218-4696-a728-de28b93080b3 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.411392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 343/696] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:16.412566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3889d-a08b-4566-b6f1-c948b10637ca None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.412856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3889d-a08b-4566-b6f1-c948b10637ca None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.413136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3889d-a08b-4566-b6f1-c948b10637ca None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.414734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 354/697] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:16.418471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e580dc-e8f6-4765-bc9c-e219fcef162f None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.418766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e580dc-e8f6-4765-bc9c-e219fcef162f None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.419045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e580dc-e8f6-4765-bc9c-e219fcef162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.423190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f9f4c-01fa-47d3-a933-915515d849e7 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.423762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f9f4c-01fa-47d3-a933-915515d849e7 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.424237 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f9f4c-01fa-47d3-a933-915515d849e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.443309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-29e580dc-e8f6-4765-bc9c-e219fcef162f None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:16.444506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-a68f9f4c-01fa-47d3-a933-915515d849e7 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:16.444790 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-29e580dc-e8f6-4765-bc9c-e219fcef162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:16.446032 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a68f9f4c-01fa-47d3-a933-915515d849e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:16.504432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:16.521820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:16.532495 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 355/698] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:16:16.534587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 344/699] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:16.815938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f9f4c-01fa-47d3-a933-915515d849e7 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.817838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e580dc-e8f6-4765-bc9c-e219fcef162f None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.933776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e580dc-e8f6-4765-bc9c-e219fcef162f None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.936491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f9f4c-01fa-47d3-a933-915515d849e7 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:16.971732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab4e01-d864-4831-a8f9-67e4af17aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.972571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab4e01-d864-4831-a8f9-67e4af17aed6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.972950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab4e01-d864-4831-a8f9-67e4af17aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.973329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab4e01-d864-4831-a8f9-67e4af17aed6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.974059 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab4e01-d864-4831-a8f9-67e4af17aed6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:16.974341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8217f0-fbfc-4f04-a044-8f310b688e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:16.974975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8217f0-fbfc-4f04-a044-8f310b688e8d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:16.975258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8217f0-fbfc-4f04-a044-8f310b688e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:16.975452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab4e01-d864-4831-a8f9-67e4af17aed6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:16.975559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8217f0-fbfc-4f04-a044-8f310b688e8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-beab4e01-d864-4831-a8f9-67e4af17aed6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:16.986848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:16.987939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:16:16.988811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:16.989560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8217f0-fbfc-4f04-a044-8f310b688e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:16.989671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 345/700] 10.222.0.74 () {56 vars in 1129 bytes} [Wed Aug 31 00:16:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-7d8217f0-fbfc-4f04-a044-8f310b688e8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:16.993368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:16.994539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:16.995691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:16.996378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab4e01-d864-4831-a8f9-67e4af17aed6 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:16.998370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 356/701] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:17.004833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8217f0-fbfc-4f04-a044-8f310b688e8d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:17.049931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:17.086008 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:17.184990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab4e01-d864-4831-a8f9-67e4af17aed6 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:17.215604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8217f0-fbfc-4f04-a044-8f310b688e8d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:17.248294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d10966-21f5-4ad0-9bf5-6e4f6b4e9e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:17.248973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d10966-21f5-4ad0-9bf5-6e4f6b4e9e32 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.249260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d10966-21f5-4ad0-9bf5-6e4f6b4e9e32 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.249535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d10966-21f5-4ad0-9bf5-6e4f6b4e9e32 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.250208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d10966-21f5-4ad0-9bf5-6e4f6b4e9e32 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:17.250515 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d10966-21f5-4ad0-9bf5-6e4f6b4e9e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:17.252574 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d10966-21f5-4ad0-9bf5-6e4f6b4e9e32 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:17.259058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 346/702] 10.222.0.74 () {56 vars in 1124 bytes} [Wed Aug 31 00:16:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:17.265190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737cde-ce4f-4145-a063-86e8a83cf3d3 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.265482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737cde-ce4f-4145-a063-86e8a83cf3d3 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.265794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737cde-ce4f-4145-a063-86e8a83cf3d3 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.271511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 347/703] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:17.271511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19737cde-ce4f-4145-a063-86e8a83cf3d3 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:17.283018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520e3d3-6138-4a38-8e9a-100c935900ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:17.283830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520e3d3-6138-4a38-8e9a-100c935900ab None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.284308 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520e3d3-6138-4a38-8e9a-100c935900ab None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.284753 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520e3d3-6138-4a38-8e9a-100c935900ab None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.286207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520e3d3-6138-4a38-8e9a-100c935900ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:17.286698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520e3d3-6138-4a38-8e9a-100c935900ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:17.288642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520e3d3-6138-4a38-8e9a-100c935900ab None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:17.301547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 357/704] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:16:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:17.303746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294e03f-a460-415f-819b-7a0f8cd0894d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.304289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294e03f-a460-415f-819b-7a0f8cd0894d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.307236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294e03f-a460-415f-819b-7a0f8cd0894d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.326420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-8294e03f-a460-415f-819b-7a0f8cd0894d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:17.328658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8294e03f-a460-415f-819b-7a0f8cd0894d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:17.398049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19737cde-ce4f-4145-a063-86e8a83cf3d3 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:17.408416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:17.420737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 358/705] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:17.422467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294e03f-a460-415f-819b-7a0f8cd0894d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:17.457714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671f5f7-7035-4e8b-bf17-7359f7a15299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:17.458418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671f5f7-7035-4e8b-bf17-7359f7a15299 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.458810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671f5f7-7035-4e8b-bf17-7359f7a15299 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.459149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671f5f7-7035-4e8b-bf17-7359f7a15299 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.460191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671f5f7-7035-4e8b-bf17-7359f7a15299 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:17.460565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671f5f7-7035-4e8b-bf17-7359f7a15299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:17.462362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671f5f7-7035-4e8b-bf17-7359f7a15299 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:17.469664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 348/706] 10.222.0.74 () {56 vars in 1124 bytes} [Wed Aug 31 00:16:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:17.539148 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:17.617504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294e03f-a460-415f-819b-7a0f8cd0894d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:17.654824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a146f-57cd-4f29-95e1-0e3d5f3c58f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:17.655390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a146f-57cd-4f29-95e1-0e3d5f3c58f4 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.655673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a146f-57cd-4f29-95e1-0e3d5f3c58f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.655948 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a146f-57cd-4f29-95e1-0e3d5f3c58f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.672022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a146f-57cd-4f29-95e1-0e3d5f3c58f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:17.673514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a146f-57cd-4f29-95e1-0e3d5f3c58f4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-628a146f-57cd-4f29-95e1-0e3d5f3c58f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:17.691983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:17.693056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:17.694013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:17.694013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:17.694013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:17.694013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 359/707] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:17.699757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671f5f7-7035-4e8b-bf17-7359f7a15299 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:17.808494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671f5f7-7035-4e8b-bf17-7359f7a15299 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:17.837860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a146f-57cd-4f29-95e1-0e3d5f3c58f4 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:17.871881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c645c91-815a-4aa4-a83f-0a4fffd7ad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:17.872557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c645c91-815a-4aa4-a83f-0a4fffd7ad6d None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:17.872770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c645c91-815a-4aa4-a83f-0a4fffd7ad6d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:17.873038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c645c91-815a-4aa4-a83f-0a4fffd7ad6d None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:17.873718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c645c91-815a-4aa4-a83f-0a4fffd7ad6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:17.874098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c645c91-815a-4aa4-a83f-0a4fffd7ad6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:17.875455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c645c91-815a-4aa4-a83f-0a4fffd7ad6d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:17.895457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 349/708] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:17.903672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c645c91-815a-4aa4-a83f-0a4fffd7ad6d None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:17.968310 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:18.047055 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c645c91-815a-4aa4-a83f-0a4fffd7ad6d None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:18.050787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:18.055812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a146f-57cd-4f29-95e1-0e3d5f3c58f4 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:18.098293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525c97a-4dd6-46d5-bac9-efddb39604e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:18.098941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525c97a-4dd6-46d5-bac9-efddb39604e6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.099280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525c97a-4dd6-46d5-bac9-efddb39604e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.099388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3ce63-17d1-4954-89fd-d98589ea815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:18.099585 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525c97a-4dd6-46d5-bac9-efddb39604e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.099913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3ce63-17d1-4954-89fd-d98589ea815e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.100198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3ce63-17d1-4954-89fd-d98589ea815e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.100476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3ce63-17d1-4954-89fd-d98589ea815e None admin] PATH_INFO: `/v3/services/network` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.101071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3ce63-17d1-4954-89fd-d98589ea815e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:18.102482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3ce63-17d1-4954-89fd-d98589ea815e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:18.107888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525c97a-4dd6-46d5-bac9-efddb39604e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-6eb3ce63-17d1-4954-89fd-d98589ea815e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:18.114664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:18.115654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:18.116515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 360/709] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:17 2022] GET /identity/v3/services/network => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:18.118260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525c97a-4dd6-46d5-bac9-efddb39604e6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:18.122003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3ce63-17d1-4954-89fd-d98589ea815e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-3525c97a-4dd6-46d5-bac9-efddb39604e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:18.142776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:18.144995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:18.147245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:18.147245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:18.147245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:18.147245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:18.147245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:18.147245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:18.147245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:18.147245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:18.147245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:16:18.147245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:18.153683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 350/710] 10.222.0.74 () {56 vars in 1093 bytes} [Wed Aug 31 00:16:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:18.153683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525c97a-4dd6-46d5-bac9-efddb39604e6 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:18.254843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3ce63-17d1-4954-89fd-d98589ea815e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:18.294267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9ffa6-d78a-4a2d-a720-82d6ef52508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:18.295642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9ffa6-d78a-4a2d-a720-82d6ef52508e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.297107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9ffa6-d78a-4a2d-a720-82d6ef52508e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.297625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9ffa6-d78a-4a2d-a720-82d6ef52508e None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.298676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9ffa6-d78a-4a2d-a720-82d6ef52508e None admin] RBAC: Adding query filter params (name=network) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:18.299928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9ffa6-d78a-4a2d-a720-82d6ef52508e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:18.302369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9ffa6-d78a-4a2d-a720-82d6ef52508e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:18.311651 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 361/711] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:18.317607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9ffa6-d78a-4a2d-a720-82d6ef52508e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:18.347105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:18.385533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:18.407916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525c97a-4dd6-46d5-bac9-efddb39604e6 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:18.448480 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9ffa6-d78a-4a2d-a720-82d6ef52508e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:18.457077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc0c20-af7d-4d83-b285-a1e68a4f2fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:18.457908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0c20-af7d-4d83-b285-a1e68a4f2fd0 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.458187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0c20-af7d-4d83-b285-a1e68a4f2fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.458456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc0c20-af7d-4d83-b285-a1e68a4f2fd0 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.459296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc0c20-af7d-4d83-b285-a1e68a4f2fd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:18.459605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc0c20-af7d-4d83-b285-a1e68a4f2fd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:18.461120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc0c20-af7d-4d83-b285-a1e68a4f2fd0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:18.481134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 351/712] 10.222.0.74 () {56 vars in 1133 bytes} [Wed Aug 31 00:16:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:18.486602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc0c20-af7d-4d83-b285-a1e68a4f2fd0 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:18.487002 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd3921-07c9-483c-8b72-2873bb9c2064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:18.487541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3921-07c9-483c-8b72-2873bb9c2064 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.487820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3921-07c9-483c-8b72-2873bb9c2064 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.488094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3921-07c9-483c-8b72-2873bb9c2064 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.488726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd3921-07c9-483c-8b72-2873bb9c2064 None admin] RBAC: Adding query filter params (type=network) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:18.489026 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd3921-07c9-483c-8b72-2873bb9c2064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:18.490415 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd3921-07c9-483c-8b72-2873bb9c2064 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:18.497119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 362/713] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:18.647091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc0c20-af7d-4d83-b285-a1e68a4f2fd0 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:18.681472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3dd8-2a89-43fb-960e-3b3ac4e3ebc5 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.681472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3dd8-2a89-43fb-960e-3b3ac4e3ebc5 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.681472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3dd8-2a89-43fb-960e-3b3ac4e3ebc5 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.683747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 363/714] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:18.689327 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d92b-4644-42a7-ae1e-590959038250 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.689662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d92b-4644-42a7-ae1e-590959038250 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.689939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d92b-4644-42a7-ae1e-590959038250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.705295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31292a0d-3e4b-4308-96b7-848501c64592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:18.706283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292a0d-3e4b-4308-96b7-848501c64592 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:18.706859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292a0d-3e4b-4308-96b7-848501c64592 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:18.707331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31292a0d-3e4b-4308-96b7-848501c64592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:18.710408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-5e74d92b-4644-42a7-ae1e-590959038250 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:18.712035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5e74d92b-4644-42a7-ae1e-590959038250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:18.731229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:18.793025 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31292a0d-3e4b-4308-96b7-848501c64592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:18.795463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31292a0d-3e4b-4308-96b7-848501c64592 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:18.796831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 364/715] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:18.961168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 352/716] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 00:16:18.967503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74d92b-4644-42a7-ae1e-590959038250 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.012169 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:19.028535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e8439-70b5-46d7-9130-1156aae4ff86 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.028861 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e8439-70b5-46d7-9130-1156aae4ff86 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.029088 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e8439-70b5-46d7-9130-1156aae4ff86 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.030892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 353/717] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:19.037372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0c504-c170-4afa-8111-31cb7a93a11c None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.037735 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0c504-c170-4afa-8111-31cb7a93a11c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.038128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0c504-c170-4afa-8111-31cb7a93a11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.072084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-4fc0c504-c170-4afa-8111-31cb7a93a11c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:19.078579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4fc0c504-c170-4afa-8111-31cb7a93a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:19.133284 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74d92b-4644-42a7-ae1e-590959038250 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.154542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:19.178205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcda5e-5cb8-4d19-8354-be66a472dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.179294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcda5e-5cb8-4d19-8354-be66a472dd48 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.179773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcda5e-5cb8-4d19-8354-be66a472dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.185694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 354/718] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 00:16:19.185694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0c504-c170-4afa-8111-31cb7a93a11c None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.185951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcda5e-5cb8-4d19-8354-be66a472dd48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.203881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcda5e-5cb8-4d19-8354-be66a472dd48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:19.205346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcda5e-5cb8-4d19-8354-be66a472dd48 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-f3fcda5e-5cb8-4d19-8354-be66a472dd48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:19.229322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:19.230567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:19.231475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:19.231475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:19.231475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:19.231475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 365/719] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:19.238118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcda5e-5cb8-4d19-8354-be66a472dd48 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.360119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0c504-c170-4afa-8111-31cb7a93a11c None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.361953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:19.414577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcda5e-5cb8-4d19-8354-be66a472dd48 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.430109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b55b-aabf-4941-9dc4-d81223d470e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.430745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b55b-aabf-4941-9dc4-d81223d470e1 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.431015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b55b-aabf-4941-9dc4-d81223d470e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.431285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b55b-aabf-4941-9dc4-d81223d470e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.454238 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9b55b-aabf-4941-9dc4-d81223d470e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-02e9b55b-aabf-4941-9dc4-d81223d470e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:19.458990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:19.459917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:19.460788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:19.462046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 355/720] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:19.468932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b55b-aabf-4941-9dc4-d81223d470e1 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.503622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b5495-0849-4b3a-8a78-a06f7490567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.504238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b5495-0849-4b3a-8a78-a06f7490567a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.504516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b5495-0849-4b3a-8a78-a06f7490567a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.504790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b5495-0849-4b3a-8a78-a06f7490567a None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.505437 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b5495-0849-4b3a-8a78-a06f7490567a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:19.505764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b5495-0849-4b3a-8a78-a06f7490567a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:19.507355 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b5495-0849-4b3a-8a78-a06f7490567a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:19.518177 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:19.536315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 366/721] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:19.557641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b5495-0849-4b3a-8a78-a06f7490567a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.586023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b55b-aabf-4941-9dc4-d81223d470e1 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.622364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4eb53-3226-42e2-9d3c-66dfc7ce1928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.622971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4eb53-3226-42e2-9d3c-66dfc7ce1928 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.623248 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4eb53-3226-42e2-9d3c-66dfc7ce1928 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.623516 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4eb53-3226-42e2-9d3c-66dfc7ce1928 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.624171 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4eb53-3226-42e2-9d3c-66dfc7ce1928 None admin] RBAC: Adding query filter params (name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:19.624471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4eb53-3226-42e2-9d3c-66dfc7ce1928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:19.625863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4eb53-3226-42e2-9d3c-66dfc7ce1928 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:19.637610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 356/722] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:19.637610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4eb53-3226-42e2-9d3c-66dfc7ce1928 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.657235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b5495-0849-4b3a-8a78-a06f7490567a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.694450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4380b-10e0-4b1e-9a0c-818b8911cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.695501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4380b-10e0-4b1e-9a0c-818b8911cf50 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.695983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4380b-10e0-4b1e-9a0c-818b8911cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.696528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4380b-10e0-4b1e-9a0c-818b8911cf50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.698891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:19.705229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4380b-10e0-4b1e-9a0c-818b8911cf50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:19.707186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4380b-10e0-4b1e-9a0c-818b8911cf50 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-aad4380b-10e0-4b1e-9a0c-818b8911cf50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:19.720716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:19.721718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:19.722816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:19.722816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:19.722816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:19.722816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:19.722816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:19.722816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:19.722816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:19.722816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:19.725007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 367/723] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:19.726037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4380b-10e0-4b1e-9a0c-818b8911cf50 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.749993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4eb53-3226-42e2-9d3c-66dfc7ce1928 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.753203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:19.801139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09772ff4-fd15-4647-acb7-c41f087e3e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.802742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772ff4-fd15-4647-acb7-c41f087e3e4a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.803031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772ff4-fd15-4647-acb7-c41f087e3e4a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.803307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772ff4-fd15-4647-acb7-c41f087e3e4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.817735 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09772ff4-fd15-4647-acb7-c41f087e3e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-09772ff4-fd15-4647-acb7-c41f087e3e4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:19.824887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:19.825902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:19.826747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:19.831272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 357/724] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:19.832294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09772ff4-fd15-4647-acb7-c41f087e3e4a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.852897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4380b-10e0-4b1e-9a0c-818b8911cf50 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.899844 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde499eb-ff09-4041-a673-22e92ac786ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:19.901438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde499eb-ff09-4041-a673-22e92ac786ab None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:19.901989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde499eb-ff09-4041-a673-22e92ac786ab None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:19.902528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde499eb-ff09-4041-a673-22e92ac786ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:19.914554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde499eb-ff09-4041-a673-22e92ac786ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:19.916683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde499eb-ff09-4041-a673-22e92ac786ab None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-cde499eb-ff09-4041-a673-22e92ac786ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:19.932644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:19.933730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:19.934658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:19.934658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:19.934658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:19.938373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 368/725] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:19.939145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde499eb-ff09-4041-a673-22e92ac786ab None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:19.966166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09772ff4-fd15-4647-acb7-c41f087e3e4a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:19.993505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:20.000906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5afad-5823-4589-9d1c-455a901b0a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.001521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5afad-5823-4589-9d1c-455a901b0a88 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.001833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5afad-5823-4589-9d1c-455a901b0a88 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.002106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5afad-5823-4589-9d1c-455a901b0a88 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.002803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5afad-5823-4589-9d1c-455a901b0a88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:20.006435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5afad-5823-4589-9d1c-455a901b0a88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.006435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5afad-5823-4589-9d1c-455a901b0a88 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.016991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 358/726] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:20.018079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26232a-cf04-4c06-9309-1725eb365968 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.018356 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26232a-cf04-4c06-9309-1725eb365968 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.018633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26232a-cf04-4c06-9309-1725eb365968 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.019840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 359/727] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:20.022312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26232a-cf04-4c06-9309-1725eb365968 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.047280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:20.065514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde499eb-ff09-4041-a673-22e92ac786ab None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.104362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3217e00-284a-4f02-b7fd-394f97aae7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.105106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3217e00-284a-4f02-b7fd-394f97aae7b6 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.105475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3217e00-284a-4f02-b7fd-394f97aae7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.105789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3217e00-284a-4f02-b7fd-394f97aae7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.106458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3217e00-284a-4f02-b7fd-394f97aae7b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:20.106766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3217e00-284a-4f02-b7fd-394f97aae7b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.108226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3217e00-284a-4f02-b7fd-394f97aae7b6 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.116956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 369/728] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:16:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:20.117621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3217e00-284a-4f02-b7fd-394f97aae7b6 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.139698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26232a-cf04-4c06-9309-1725eb365968 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.177955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28122ffb-e36b-40f4-9ec4-0f8c437197ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.178508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28122ffb-e36b-40f4-9ec4-0f8c437197ec None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.178792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28122ffb-e36b-40f4-9ec4-0f8c437197ec None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.179082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28122ffb-e36b-40f4-9ec4-0f8c437197ec None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.179947 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28122ffb-e36b-40f4-9ec4-0f8c437197ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:20.180076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28122ffb-e36b-40f4-9ec4-0f8c437197ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.181363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28122ffb-e36b-40f4-9ec4-0f8c437197ec None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.193431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 360/729] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:20.194731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25e2d-a088-449d-9938-5bd9e0135746 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.195018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25e2d-a088-449d-9938-5bd9e0135746 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.195286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af25e2d-a088-449d-9938-5bd9e0135746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.213994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-7af25e2d-a088-449d-9938-5bd9e0135746 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:20.215211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7af25e2d-a088-449d-9938-5bd9e0135746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:20.235303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3217e00-284a-4f02-b7fd-394f97aae7b6 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.245347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:20.271347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fc066-2643-4d07-83d8-2a272ee5b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.271956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc066-2643-4d07-83d8-2a272ee5b4bf None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.272235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc066-2643-4d07-83d8-2a272ee5b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.272929 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc066-2643-4d07-83d8-2a272ee5b4bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.273695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fc066-2643-4d07-83d8-2a272ee5b4bf None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=90147848fe604ca9912d10a214a45227) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:20.274146 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fc066-2643-4d07-83d8-2a272ee5b4bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.276138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fc066-2643-4d07-83d8-2a272ee5b4bf None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.289599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 370/730] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:20 2022] GET /identity/v3/role_assignments?user.id=90147848fe604ca9912d10a214a45227&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:20.289599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fc066-2643-4d07-83d8-2a272ee5b4bf None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.301746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 361/731] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:20.302732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af25e2d-a088-449d-9938-5bd9e0135746 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.325209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:20.471857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fc066-2643-4d07-83d8-2a272ee5b4bf None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.511049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539e707-b22c-4c00-ab09-73324ff265c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.511819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539e707-b22c-4c00-ab09-73324ff265c7 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.512102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539e707-b22c-4c00-ab09-73324ff265c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.512377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539e707-b22c-4c00-ab09-73324ff265c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.524526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539e707-b22c-4c00-ab09-73324ff265c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.526891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539e707-b22c-4c00-ab09-73324ff265c7 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.528490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af25e2d-a088-449d-9938-5bd9e0135746 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-1539e707-b22c-4c00-ab09-73324ff265c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:20.543334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:20.544343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:20.545703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:20.545703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:20.545703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:20.545703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 371/732] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:20.558918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539e707-b22c-4c00-ab09-73324ff265c7 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.574725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2367dfd-8959-4f47-94fa-137e015cdbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.575429 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2367dfd-8959-4f47-94fa-137e015cdbf6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.575659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2367dfd-8959-4f47-94fa-137e015cdbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.575940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2367dfd-8959-4f47-94fa-137e015cdbf6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.583739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2367dfd-8959-4f47-94fa-137e015cdbf6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.585199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2367dfd-8959-4f47-94fa-137e015cdbf6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.602031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-a2367dfd-8959-4f47-94fa-137e015cdbf6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:20.605469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:20.606403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:20.607609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:20.607609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:20.607609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:20.607609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:20.607609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:20.607609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:20.607609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:20.607609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:20.607609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:20.607609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:20.607609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 362/733] 10.222.0.74 () {56 vars in 1117 bytes} [Wed Aug 31 00:16:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:20.618608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2367dfd-8959-4f47-94fa-137e015cdbf6 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.676514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539e707-b22c-4c00-ab09-73324ff265c7 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.695820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:20.711938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd1e1-aa48-4305-8444-42327315ca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.712554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd1e1-aa48-4305-8444-42327315ca76 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.712897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd1e1-aa48-4305-8444-42327315ca76 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.713215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd1e1-aa48-4305-8444-42327315ca76 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.714005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd1e1-aa48-4305-8444-42327315ca76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:20.714300 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd1e1-aa48-4305-8444-42327315ca76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.715685 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd1e1-aa48-4305-8444-42327315ca76 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.728153 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 372/734] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:20.729516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd1e1-aa48-4305-8444-42327315ca76 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.732587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2367dfd-8959-4f47-94fa-137e015cdbf6 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.772117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20255412-0a0e-435c-8d47-10431563f049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.773126 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255412-0a0e-435c-8d47-10431563f049 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.773718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255412-0a0e-435c-8d47-10431563f049 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.774301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255412-0a0e-435c-8d47-10431563f049 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.775235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20255412-0a0e-435c-8d47-10431563f049 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:20.776507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20255412-0a0e-435c-8d47-10431563f049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.778566 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20255412-0a0e-435c-8d47-10431563f049 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.801815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 363/735] 10.222.0.74 () {56 vars in 1149 bytes} [Wed Aug 31 00:16:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:20.803219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20255412-0a0e-435c-8d47-10431563f049 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.842217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:20.857321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd1e1-aa48-4305-8444-42327315ca76 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.895975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accb1de-b99b-44e3-8aac-fcf7b69dfea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.896670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb1de-b99b-44e3-8aac-fcf7b69dfea2 None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.896965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb1de-b99b-44e3-8aac-fcf7b69dfea2 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.897239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb1de-b99b-44e3-8aac-fcf7b69dfea2 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.898062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accb1de-b99b-44e3-8aac-fcf7b69dfea2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.899434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accb1de-b99b-44e3-8aac-fcf7b69dfea2 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.936252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20255412-0a0e-435c-8d47-10431563f049 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:20.962825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:20.970837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c343a-3132-4e85-85dc-1af350c0e369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:20.971498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c343a-3132-4e85-85dc-1af350c0e369 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:20.971752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c343a-3132-4e85-85dc-1af350c0e369 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:20.972027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c343a-3132-4e85-85dc-1af350c0e369 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:20.979619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c343a-3132-4e85-85dc-1af350c0e369 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:20.981081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c343a-3132-4e85-85dc-1af350c0e369 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:20.992779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 373/736] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:16:20 2022] POST /identity/v3/services => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:20.993875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accb1de-b99b-44e3-8aac-fcf7b69dfea2 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-298c343a-3132-4e85-85dc-1af350c0e369 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:20.998389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:20.999383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:21.000386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:21.000386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:21.000386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:21.000386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:21.000386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:21.000386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:21.000386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:21.000386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:21.000386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:21.000386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:21.000386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 364/737] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:21.001568 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a746b-ac2b-459b-8409-28a15cf8bff3 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.001819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a746b-ac2b-459b-8409-28a15cf8bff3 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.002313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a746b-ac2b-459b-8409-28a15cf8bff3 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.005361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 365/738] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:21.006270 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a746b-ac2b-459b-8409-28a15cf8bff3 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:21.178636 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accb1de-b99b-44e3-8aac-fcf7b69dfea2 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:21.178821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a746b-ac2b-459b-8409-28a15cf8bff3 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:21.221834 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81031c1-0860-4780-94bc-3136398f3129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:21.222745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81031c1-0860-4780-94bc-3136398f3129 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.223268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81031c1-0860-4780-94bc-3136398f3129 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.223764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81031c1-0860-4780-94bc-3136398f3129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.231224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0de72-401c-4558-bedc-c87451904c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:21.231224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0de72-401c-4558-bedc-c87451904c26 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.231512 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0de72-401c-4558-bedc-c87451904c26 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.231666 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0de72-401c-4558-bedc-c87451904c26 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.232399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0de72-401c-4558-bedc-c87451904c26 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:21.232711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0de72-401c-4558-bedc-c87451904c26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:21.237111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0de72-401c-4558-bedc-c87451904c26 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:21.239190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:21.262919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 366/739] 10.222.0.74 () {56 vars in 1135 bytes} [Wed Aug 31 00:16:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:21.265484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a19e1a-36c1-45fc-92a2-e3b70fdc3b74 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.266019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a19e1a-36c1-45fc-92a2-e3b70fdc3b74 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.266711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a19e1a-36c1-45fc-92a2-e3b70fdc3b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.293455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-e0a19e1a-36c1-45fc-92a2-e3b70fdc3b74 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:21.295505 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e0a19e1a-36c1-45fc-92a2-e3b70fdc3b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:21.302490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81031c1-0860-4780-94bc-3136398f3129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:21.303952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81031c1-0860-4780-94bc-3136398f3129 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:21.349117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:21.406043 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 367/740] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 00:16:21.406587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a19e1a-36c1-45fc-92a2-e3b70fdc3b74 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:21.448708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 374/741] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:20 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:16:21.459659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81031c1-0860-4780-94bc-3136398f3129 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:21.535831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a19e1a-36c1-45fc-92a2-e3b70fdc3b74 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:21.563950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:21.580006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4f363-791c-498a-a0bc-cb8e2fc94906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:21.580980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4f363-791c-498a-a0bc-cb8e2fc94906 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.581470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4f363-791c-498a-a0bc-cb8e2fc94906 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.581971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4f363-791c-498a-a0bc-cb8e2fc94906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.632357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:21.664755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4f363-791c-498a-a0bc-cb8e2fc94906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:21.666706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4f363-791c-498a-a0bc-cb8e2fc94906 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:21.709095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81031c1-0860-4780-94bc-3136398f3129 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:21.772234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7d192-a07e-436c-86ef-f7678139ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:21.772860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d192-a07e-436c-86ef-f7678139ba68 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.773138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d192-a07e-436c-86ef-f7678139ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.773408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7d192-a07e-436c-86ef-f7678139ba68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.782112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 368/742] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:21 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 00:16:21.783262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4f363-791c-498a-a0bc-cb8e2fc94906 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:21.788101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7d192-a07e-436c-86ef-f7678139ba68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:21.789561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7d192-a07e-436c-86ef-f7678139ba68 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:21.866704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:21.908520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4f363-791c-498a-a0bc-cb8e2fc94906 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-2db7d192-a07e-436c-86ef-f7678139ba68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:21.922384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:21.923413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:21.924306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:21.924306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:21.924306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:21.924306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 375/743] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 464 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:21.929447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7d192-a07e-436c-86ef-f7678139ba68 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:21.958342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dd84b-9871-4b24-81fc-307596a9a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:21.959009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd84b-9871-4b24-81fc-307596a9a356 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:21.959346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd84b-9871-4b24-81fc-307596a9a356 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:21.959565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dd84b-9871-4b24-81fc-307596a9a356 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:21.960217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dd84b-9871-4b24-81fc-307596a9a356 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:21.961607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dd84b-9871-4b24-81fc-307596a9a356 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:22.038234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:22.045957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 369/744] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:16:21 2022] POST /identity/v3/services => generated 240 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:22.045957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dd84b-9871-4b24-81fc-307596a9a356 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:22.052503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7d192-a07e-436c-86ef-f7678139ba68 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:22.113394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1081c2a-5ca6-4ea3-879a-d3fbdfd0c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:22.115625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1081c2a-5ca6-4ea3-879a-d3fbdfd0c427 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:22.115997 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1081c2a-5ca6-4ea3-879a-d3fbdfd0c427 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:22.116324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1081c2a-5ca6-4ea3-879a-d3fbdfd0c427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:22.141475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1081c2a-5ca6-4ea3-879a-d3fbdfd0c427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:22.144542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1081c2a-5ca6-4ea3-879a-d3fbdfd0c427 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-d1081c2a-5ca6-4ea3-879a-d3fbdfd0c427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:22.177949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:22.179006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:22.179903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:22.179903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:22.179903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:22.179903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 376/745] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:22.189099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1081c2a-5ca6-4ea3-879a-d3fbdfd0c427 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:22.265638 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dd84b-9871-4b24-81fc-307596a9a356 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:22.304334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:22.311400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51579a0e-300e-456c-81bf-f65244e0fd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:22.311400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51579a0e-300e-456c-81bf-f65244e0fd18 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:22.311668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51579a0e-300e-456c-81bf-f65244e0fd18 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:22.311991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51579a0e-300e-456c-81bf-f65244e0fd18 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:22.312712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51579a0e-300e-456c-81bf-f65244e0fd18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:22.313127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51579a0e-300e-456c-81bf-f65244e0fd18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:22.315412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51579a0e-300e-456c-81bf-f65244e0fd18 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:22.332580 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 370/746] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:22.339346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51579a0e-300e-456c-81bf-f65244e0fd18 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:22.344015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1081c2a-5ca6-4ea3-879a-d3fbdfd0c427 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:22.385485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f802a-9c1d-4092-a585-b3598d539db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:22.386141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f802a-9c1d-4092-a585-b3598d539db0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:22.386426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f802a-9c1d-4092-a585-b3598d539db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:22.386704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f802a-9c1d-4092-a585-b3598d539db0 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:22.387359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f802a-9c1d-4092-a585-b3598d539db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:22.387665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f802a-9c1d-4092-a585-b3598d539db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:22.389040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f802a-9c1d-4092-a585-b3598d539db0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:22.399210 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:22.403298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 377/747] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:22.404548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208d9b3-b939-4fdd-9bf2-8431c3fd15dd None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:22.404911 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208d9b3-b939-4fdd-9bf2-8431c3fd15dd None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:22.405414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208d9b3-b939-4fdd-9bf2-8431c3fd15dd None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:22.406968 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 378/748] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:22.408843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208d9b3-b939-4fdd-9bf2-8431c3fd15dd None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:22.477214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51579a0e-300e-456c-81bf-f65244e0fd18 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:22.525427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35902c1-7d43-4416-8704-6523dee81b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:22.526031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35902c1-7d43-4416-8704-6523dee81b4d None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:22.526683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35902c1-7d43-4416-8704-6523dee81b4d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:22.526683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35902c1-7d43-4416-8704-6523dee81b4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:22.529794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208d9b3-b939-4fdd-9bf2-8431c3fd15dd None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:22.536875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35902c1-7d43-4416-8704-6523dee81b4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:22.538633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35902c1-7d43-4416-8704-6523dee81b4d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-b35902c1-7d43-4416-8704-6523dee81b4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:22.550140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:22.551113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:22.552828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:22.552828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:22.552828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:22.552828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:22.552828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:22.552828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:22.552828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:22.552828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:22.552828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 371/749] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:22.552828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c492f-0da3-4895-b47e-cf402db5554b None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:22.553369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c492f-0da3-4895-b47e-cf402db5554b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:22.553369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c492f-0da3-4895-b47e-cf402db5554b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:22.572238 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2e2c492f-0da3-4895-b47e-cf402db5554b None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:22.574068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc09618-187e-42e7-889e-4219a3ab26bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:22.574212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2e2c492f-0da3-4895-b47e-cf402db5554b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:22.575105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc09618-187e-42e7-889e-4219a3ab26bf None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:22.575615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc09618-187e-42e7-889e-4219a3ab26bf None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:22.576235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc09618-187e-42e7-889e-4219a3ab26bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:22.584063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc09618-187e-42e7-889e-4219a3ab26bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:22.586129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc09618-187e-42e7-889e-4219a3ab26bf None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-ecc09618-187e-42e7-889e-4219a3ab26bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:22.599092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:22.600226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:22.601348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:22.601348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:22.601348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:22.601348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:22.601348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:22.601348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:22.601348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:22.601348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:22.602841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 379/750] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:22.610157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc09618-187e-42e7-889e-4219a3ab26bf None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:22.638470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:22.660084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 372/751] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:22.666980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c492f-0da3-4895-b47e-cf402db5554b None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:22.679390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:22.723261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc09618-187e-42e7-889e-4219a3ab26bf None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:22.762797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866598fb-6f5c-4210-9a91-a18449d0d276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:22.763653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866598fb-6f5c-4210-9a91-a18449d0d276 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:22.764102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866598fb-6f5c-4210-9a91-a18449d0d276 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:22.764516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866598fb-6f5c-4210-9a91-a18449d0d276 None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:22.765352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866598fb-6f5c-4210-9a91-a18449d0d276 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:22.765831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866598fb-6f5c-4210-9a91-a18449d0d276 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:22.767457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866598fb-6f5c-4210-9a91-a18449d0d276 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:22.781601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 380/752] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:22.794627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866598fb-6f5c-4210-9a91-a18449d0d276 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:22.906523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866598fb-6f5c-4210-9a91-a18449d0d276 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:22.928653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:22.929606 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c492f-0da3-4895-b47e-cf402db5554b None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:22.945599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51641b3f-55f2-4431-8d1a-c39c3d8a706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:22.945599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51641b3f-55f2-4431-8d1a-c39c3d8a706e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:22.945599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51641b3f-55f2-4431-8d1a-c39c3d8a706e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:22.945599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51641b3f-55f2-4431-8d1a-c39c3d8a706e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:22.946003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51641b3f-55f2-4431-8d1a-c39c3d8a706e None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=b15b4c00f7214835b42e2775c4023032) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:22.946003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51641b3f-55f2-4431-8d1a-c39c3d8a706e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:22.947524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51641b3f-55f2-4431-8d1a-c39c3d8a706e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:22.953512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 381/753] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:22 2022] GET /identity/v3/role_assignments?user.id=b15b4c00f7214835b42e2775c4023032&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:22.982081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51641b3f-55f2-4431-8d1a-c39c3d8a706e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:23.007375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff678c-ede0-4774-b913-919e960d72a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:23.009514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff678c-ede0-4774-b913-919e960d72a6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.009933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff678c-ede0-4774-b913-919e960d72a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.010344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff678c-ede0-4774-b913-919e960d72a6 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.011421 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff678c-ede0-4774-b913-919e960d72a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:23.011733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff678c-ede0-4774-b913-919e960d72a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:23.016888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff678c-ede0-4774-b913-919e960d72a6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:23.040850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 373/754] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:23.049451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff678c-ede0-4774-b913-919e960d72a6 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:23.137798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:23.165120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51641b3f-55f2-4431-8d1a-c39c3d8a706e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:23.207474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d08c5-2b72-4cca-a71b-cd0d31e7ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:23.208166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d08c5-2b72-4cca-a71b-cd0d31e7ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.208455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d08c5-2b72-4cca-a71b-cd0d31e7ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.208708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d08c5-2b72-4cca-a71b-cd0d31e7ccd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.221604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d08c5-2b72-4cca-a71b-cd0d31e7ccd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-ed3d08c5-2b72-4cca-a71b-cd0d31e7ccd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:23.227315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:23.228269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:23.230277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 382/755] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:23.232276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff678c-ede0-4774-b913-919e960d72a6 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:23.235700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7423f-343b-4a34-a12e-977cf3c325f0 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.235700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7423f-343b-4a34-a12e-977cf3c325f0 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.236018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7423f-343b-4a34-a12e-977cf3c325f0 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.237533 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 383/756] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:23.241818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7423f-343b-4a34-a12e-977cf3c325f0 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:23.281657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc31e1-b616-47b7-bd86-531a22c848c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:23.282745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc31e1-b616-47b7-bd86-531a22c848c8 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.283235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc31e1-b616-47b7-bd86-531a22c848c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.283725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc31e1-b616-47b7-bd86-531a22c848c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.284663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc31e1-b616-47b7-bd86-531a22c848c8 None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=045ff88aba374cc889389ba07e884462) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:23.285196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc31e1-b616-47b7-bd86-531a22c848c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:23.287417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc31e1-b616-47b7-bd86-531a22c848c8 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:23.293371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:23.297660 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 374/757] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:23 2022] GET /identity/v3/role_assignments?user.id=045ff88aba374cc889389ba07e884462&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:23.299607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7a6f-763c-4921-88eb-c724baf0feaf None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.300117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7a6f-763c-4921-88eb-c724baf0feaf None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.300724 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7a6f-763c-4921-88eb-c724baf0feaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.343884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-12be7a6f-763c-4921-88eb-c724baf0feaf None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:23.345095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-12be7a6f-763c-4921-88eb-c724baf0feaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:23.412656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7423f-343b-4a34-a12e-977cf3c325f0 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:23.467912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531fc0-345d-4f45-b973-2953c4c5390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:23.468550 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531fc0-345d-4f45-b973-2953c4c5390a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.469433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531fc0-345d-4f45-b973-2953c4c5390a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.469433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab531fc0-345d-4f45-b973-2953c4c5390a None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.469878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab531fc0-345d-4f45-b973-2953c4c5390a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:23.470244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab531fc0-345d-4f45-b973-2953c4c5390a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:23.471704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab531fc0-345d-4f45-b973-2953c4c5390a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:23.486189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 375/758] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:23.497297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 384/759] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:16:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:23.498746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be7a6f-763c-4921-88eb-c724baf0feaf None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:23.553269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:23.632286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be7a6f-763c-4921-88eb-c724baf0feaf None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:23.679137 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81436dda-8d36-451e-ae0c-d1d6d30d59b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:23.679780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81436dda-8d36-451e-ae0c-d1d6d30d59b2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.680056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81436dda-8d36-451e-ae0c-d1d6d30d59b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.680327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81436dda-8d36-451e-ae0c-d1d6d30d59b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.692848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81436dda-8d36-451e-ae0c-d1d6d30d59b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:23.694334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81436dda-8d36-451e-ae0c-d1d6d30d59b2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-81436dda-8d36-451e-ae0c-d1d6d30d59b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:23.714803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:23.715810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:23.716694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:23.716694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:23.716694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:23.718287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 376/760] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:23.726667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531fc0-345d-4f45-b973-2953c4c5390a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:23.865472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab531fc0-345d-4f45-b973-2953c4c5390a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:23.875675 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:23.910451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81436dda-8d36-451e-ae0c-d1d6d30d59b2 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:23.927748 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ae9ac-a305-4034-9804-ecfca8880dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:23.928371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae9ac-a305-4034-9804-ecfca8880dac None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:23.928658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae9ac-a305-4034-9804-ecfca8880dac None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:23.928939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae9ac-a305-4034-9804-ecfca8880dac None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:23.930220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ae9ac-a305-4034-9804-ecfca8880dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:23.930538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ae9ac-a305-4034-9804-ecfca8880dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:23.932803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ae9ac-a305-4034-9804-ecfca8880dac None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:23.950350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 385/761] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:23.952357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ae9ac-a305-4034-9804-ecfca8880dac None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.068618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ae9ac-a305-4034-9804-ecfca8880dac None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.112638 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77c84b-1b57-4070-a8d1-707c5befe278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.113382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77c84b-1b57-4070-a8d1-707c5befe278 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.113878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77c84b-1b57-4070-a8d1-707c5befe278 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.114226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77c84b-1b57-4070-a8d1-707c5befe278 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.124479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77c84b-1b57-4070-a8d1-707c5befe278 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.126320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77c84b-1b57-4070-a8d1-707c5befe278 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-7f77c84b-1b57-4070-a8d1-707c5befe278 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:24.140389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:24.141375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:24.142370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:24.142370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:24.142370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:24.142370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:24.142370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:24.142370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:24.142370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:24.142370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:24.142370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:16:24.142370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:24.142370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 386/762] 10.222.0.74 () {56 vars in 1093 bytes} [Wed Aug 31 00:16:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:24.147722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77c84b-1b57-4070-a8d1-707c5befe278 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.150622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:24.183323 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:24.188544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81436dda-8d36-451e-ae0c-d1d6d30d59b2 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.264237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59767ce8-8099-41db-ae21-aeb398671afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.264981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59767ce8-8099-41db-ae21-aeb398671afb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.265269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59767ce8-8099-41db-ae21-aeb398671afb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.266737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59767ce8-8099-41db-ae21-aeb398671afb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.267346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59767ce8-8099-41db-ae21-aeb398671afb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.268720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59767ce8-8099-41db-ae21-aeb398671afb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-59767ce8-8099-41db-ae21-aeb398671afb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:24.288361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:24.289409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:24.290288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 377/763] 10.222.0.74 () {56 vars in 1129 bytes} [Wed Aug 31 00:16:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:24.297943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59767ce8-8099-41db-ae21-aeb398671afb None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.323759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77c84b-1b57-4070-a8d1-707c5befe278 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.372275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d64400-1599-4598-876c-3ea942060e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.373312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64400-1599-4598-876c-3ea942060e4f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.373627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64400-1599-4598-876c-3ea942060e4f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.373914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64400-1599-4598-876c-3ea942060e4f None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.374987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d64400-1599-4598-876c-3ea942060e4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:24.375239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d64400-1599-4598-876c-3ea942060e4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.376734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d64400-1599-4598-876c-3ea942060e4f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.408313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 387/764] 10.222.0.74 () {56 vars in 1133 bytes} [Wed Aug 31 00:16:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:24.414009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d64400-1599-4598-876c-3ea942060e4f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.504750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59767ce8-8099-41db-ae21-aeb398671afb None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.543751 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbcf15-1a90-42b4-a9e4-ce3a69bcae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.544367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbcf15-1a90-42b4-a9e4-ce3a69bcae23 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.545005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbcf15-1a90-42b4-a9e4-ce3a69bcae23 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.545311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbcf15-1a90-42b4-a9e4-ce3a69bcae23 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.546028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbcf15-1a90-42b4-a9e4-ce3a69bcae23 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:24.546294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:24.546399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbcf15-1a90-42b4-a9e4-ce3a69bcae23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.547764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbcf15-1a90-42b4-a9e4-ce3a69bcae23 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.553612 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 378/765] 10.222.0.74 () {56 vars in 1124 bytes} [Wed Aug 31 00:16:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:24.566599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbcf15-1a90-42b4-a9e4-ce3a69bcae23 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.569631 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d64400-1599-4598-876c-3ea942060e4f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.598417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:24.623831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a520fffc-c018-459f-ba0e-1f30f3538f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.624488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520fffc-c018-459f-ba0e-1f30f3538f5b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.624768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520fffc-c018-459f-ba0e-1f30f3538f5b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.625108 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a520fffc-c018-459f-ba0e-1f30f3538f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.643622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520fffc-c018-459f-ba0e-1f30f3538f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.645791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a520fffc-c018-459f-ba0e-1f30f3538f5b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-a520fffc-c018-459f-ba0e-1f30f3538f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:24.665342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:24.666755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:24.667809 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:24.667809 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:24.667809 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:24.667809 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 388/766] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:24.669139 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eaf28-b1f8-4ea6-811f-09112199adf7 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.670418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eaf28-b1f8-4ea6-811f-09112199adf7 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.670418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eaf28-b1f8-4ea6-811f-09112199adf7 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.672034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 389/767] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:24.672809 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eaf28-b1f8-4ea6-811f-09112199adf7 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.719716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbcf15-1a90-42b4-a9e4-ce3a69bcae23 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.767162 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e6b92-132a-400c-8575-986b40743d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.768014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e6b92-132a-400c-8575-986b40743d16 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.768408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e6b92-132a-400c-8575-986b40743d16 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.768686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e6b92-132a-400c-8575-986b40743d16 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.769321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e6b92-132a-400c-8575-986b40743d16 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:24.769893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e6b92-132a-400c-8575-986b40743d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.772137 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e6b92-132a-400c-8575-986b40743d16 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.778110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 379/768] 10.222.0.74 () {56 vars in 1124 bytes} [Wed Aug 31 00:16:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:24.779793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c35a3e-2d2d-4771-b155-6fa818b4d0f9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.780076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c35a3e-2d2d-4771-b155-6fa818b4d0f9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.780345 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c35a3e-2d2d-4771-b155-6fa818b4d0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.803844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-69c35a3e-2d2d-4771-b155-6fa818b4d0f9 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:24.805202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-69c35a3e-2d2d-4771-b155-6fa818b4d0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:24.818845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eaf28-b1f8-4ea6-811f-09112199adf7 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:24.864641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a352588-99a7-409a-86a3-ae170cb5b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:24.865399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352588-99a7-409a-86a3-ae170cb5b98c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:24.865818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352588-99a7-409a-86a3-ae170cb5b98c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:24.866734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a352588-99a7-409a-86a3-ae170cb5b98c None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:24.867500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a352588-99a7-409a-86a3-ae170cb5b98c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:24.868160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a352588-99a7-409a-86a3-ae170cb5b98c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:24.870026 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a352588-99a7-409a-86a3-ae170cb5b98c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:24.874016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:24.896876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 380/769] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:24.896876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c35a3e-2d2d-4771-b155-6fa818b4d0f9 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.897663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 390/770] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:24.898731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a352588-99a7-409a-86a3-ae170cb5b98c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:24.904197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:25.000544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c35a3e-2d2d-4771-b155-6fa818b4d0f9 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.037684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4321f-4b92-4df3-b927-606446e6c0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.038402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4321f-4b92-4df3-b927-606446e6c0f5 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.038682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4321f-4b92-4df3-b927-606446e6c0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.038953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4321f-4b92-4df3-b927-606446e6c0f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.039654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4321f-4b92-4df3-b927-606446e6c0f5 None admin] RBAC: Adding query filter params (interface=public, service_id=705f3c47464a4376a4ebf14562703841, region_id=RegionOne) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:25.039961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4321f-4b92-4df3-b927-606446e6c0f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.041996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4321f-4b92-4df3-b927-606446e6c0f5 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.050647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 381/771] 10.222.0.74 () {56 vars in 1251 bytes} [Wed Aug 31 00:16:24 2022] GET /identity/v3/endpoints?service_id=705f3c47464a4376a4ebf14562703841&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:25.056339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4321f-4b92-4df3-b927-606446e6c0f5 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.088337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a352588-99a7-409a-86a3-ae170cb5b98c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.142657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:25.146980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d2534-896e-43e0-964d-1af7deaf3671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.147573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d2534-896e-43e0-964d-1af7deaf3671 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.147853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d2534-896e-43e0-964d-1af7deaf3671 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.148124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d2534-896e-43e0-964d-1af7deaf3671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.155938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d2534-896e-43e0-964d-1af7deaf3671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.157384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d2534-896e-43e0-964d-1af7deaf3671 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.170721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4321f-4b92-4df3-b927-606446e6c0f5 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-a12d2534-896e-43e0-964d-1af7deaf3671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:25.176577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:25.177485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:25.178430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:25.178430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:25.178430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:25.178430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:25.178430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:25.178430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:25.178430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:25.178430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:25.178430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 391/772] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:25.194641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d2534-896e-43e0-964d-1af7deaf3671 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.214855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137f14-6c6f-4cb0-b195-092a64af2852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.215472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137f14-6c6f-4cb0-b195-092a64af2852 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.215749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137f14-6c6f-4cb0-b195-092a64af2852 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.216023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d137f14-6c6f-4cb0-b195-092a64af2852 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.216634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d137f14-6c6f-4cb0-b195-092a64af2852 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.218264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d137f14-6c6f-4cb0-b195-092a64af2852 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.224299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 382/773] 10.222.0.74 () {56 vars in 1087 bytes} [Wed Aug 31 00:16:25 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:25.225248 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137f14-6c6f-4cb0-b195-092a64af2852 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.307953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:25.359050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d2534-896e-43e0-964d-1af7deaf3671 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.378798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d137f14-6c6f-4cb0-b195-092a64af2852 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.411217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae78e9-efc2-40a6-b9d0-2700cf4c3155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.411931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae78e9-efc2-40a6-b9d0-2700cf4c3155 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.412211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae78e9-efc2-40a6-b9d0-2700cf4c3155 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.412823 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae78e9-efc2-40a6-b9d0-2700cf4c3155 None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.413967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae78e9-efc2-40a6-b9d0-2700cf4c3155 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:25.414224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae78e9-efc2-40a6-b9d0-2700cf4c3155 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.416771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae78e9-efc2-40a6-b9d0-2700cf4c3155 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.433738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da458f5c-142a-4454-9b5a-12f92445548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.434436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458f5c-142a-4454-9b5a-12f92445548e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.434670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 392/774] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:25.436142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826a4b-f259-4390-b956-2d16dd45ad5c None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.436634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826a4b-f259-4390-b956-2d16dd45ad5c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.437110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826a4b-f259-4390-b956-2d16dd45ad5c None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.437958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458f5c-142a-4454-9b5a-12f92445548e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.438248 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458f5c-142a-4454-9b5a-12f92445548e None admin] PATH_INFO: `/v3/services/network` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.438913 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da458f5c-142a-4454-9b5a-12f92445548e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.439289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 393/775] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:25.440167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23826a4b-f259-4390-b956-2d16dd45ad5c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.440715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da458f5c-142a-4454-9b5a-12f92445548e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-da458f5c-142a-4454-9b5a-12f92445548e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:25.454397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:25.455472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:25.456379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 383/776] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:25 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:25.457205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36be5c-bcdb-44da-b9c7-b066d8a3c6b0 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.457205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36be5c-bcdb-44da-b9c7-b066d8a3c6b0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.457950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36be5c-bcdb-44da-b9c7-b066d8a3c6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.466981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:25.478881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2c36be5c-bcdb-44da-b9c7-b066d8a3c6b0 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:25.480205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2c36be5c-bcdb-44da-b9c7-b066d8a3c6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:25.563664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23826a4b-f259-4390-b956-2d16dd45ad5c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.567956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 384/777] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:25.569503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36be5c-bcdb-44da-b9c7-b066d8a3c6b0 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.587249 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:25.607110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87647e09-e086-42e6-b2a3-a73dbc0a6731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.608338 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87647e09-e086-42e6-b2a3-a73dbc0a6731 None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.608818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87647e09-e086-42e6-b2a3-a73dbc0a6731 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.609282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87647e09-e086-42e6-b2a3-a73dbc0a6731 None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/90147848fe604ca9912d10a214a45227/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.611452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87647e09-e086-42e6-b2a3-a73dbc0a6731 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=90147848fe604ca9912d10a214a45227, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.613192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87647e09-e086-42e6-b2a3-a73dbc0a6731 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.689389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36be5c-bcdb-44da-b9c7-b066d8a3c6b0 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.698012 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 394/778] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:16:25 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/90147848fe604ca9912d10a214a45227/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:25.701045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b1118-e7f9-43f7-a3d6-e78f23acbe11 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.701556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b1118-e7f9-43f7-a3d6-e78f23acbe11 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.702158 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b1118-e7f9-43f7-a3d6-e78f23acbe11 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.703864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 395/779] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:25.710079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636fc05-2fe7-491c-8f3e-e3196653a29c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.711139 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636fc05-2fe7-491c-8f3e-e3196653a29c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.711679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636fc05-2fe7-491c-8f3e-e3196653a29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.741606 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:25.753052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-e636fc05-2fe7-491c-8f3e-e3196653a29c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:25.754745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23d06d-2907-4754-96f6-681701567be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.755506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23d06d-2907-4754-96f6-681701567be3 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.755794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23d06d-2907-4754-96f6-681701567be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.756073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23d06d-2907-4754-96f6-681701567be3 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.756770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23d06d-2907-4754-96f6-681701567be3 None admin] RBAC: Adding query filter params (name=network) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:25.757041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23d06d-2907-4754-96f6-681701567be3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.758295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e636fc05-2fe7-491c-8f3e-e3196653a29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:25.762147 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23d06d-2907-4754-96f6-681701567be3 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.779820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 385/780] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:25.787697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23d06d-2907-4754-96f6-681701567be3 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.851600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 396/781] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:25.854246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636fc05-2fe7-491c-8f3e-e3196653a29c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:25.948363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23d06d-2907-4754-96f6-681701567be3 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.979795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636fc05-2fe7-491c-8f3e-e3196653a29c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:25.987251 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc8f2d-0cb6-4f1e-9c56-0552f40a41f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:25.988041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:25.989401 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8f2d-0cb6-4f1e-9c56-0552f40a41f7 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:25.989915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8f2d-0cb6-4f1e-9c56-0552f40a41f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:25.990447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc8f2d-0cb6-4f1e-9c56-0552f40a41f7 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:25.991279 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc8f2d-0cb6-4f1e-9c56-0552f40a41f7 None admin] RBAC: Adding query filter params (type=network) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:25.991780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc8f2d-0cb6-4f1e-9c56-0552f40a41f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:25.993385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc8f2d-0cb6-4f1e-9c56-0552f40a41f7 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:25.999547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 386/782] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:26.004771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc8f2d-0cb6-4f1e-9c56-0552f40a41f7 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.016335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08d48b-9238-46ed-a1bb-e2bc7bd60718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.016974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08d48b-9238-46ed-a1bb-e2bc7bd60718 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.017258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08d48b-9238-46ed-a1bb-e2bc7bd60718 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.017620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08d48b-9238-46ed-a1bb-e2bc7bd60718 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.029135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08d48b-9238-46ed-a1bb-e2bc7bd60718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-7f08d48b-9238-46ed-a1bb-e2bc7bd60718 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:26.034616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:26.035666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:26.036537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:26.039185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 397/783] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:26.046059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08d48b-9238-46ed-a1bb-e2bc7bd60718 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.077977 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:26.124737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc8f2d-0cb6-4f1e-9c56-0552f40a41f7 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.180334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad883d-aa82-4faa-9774-7e85c9ed411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.180995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad883d-aa82-4faa-9774-7e85c9ed411b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.181221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad883d-aa82-4faa-9774-7e85c9ed411b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.182056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad883d-aa82-4faa-9774-7e85c9ed411b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.182817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad883d-aa82-4faa-9774-7e85c9ed411b None admin] RBAC: Adding query filter params (interface=public, service_id=6cb6240e1468491b97cb8ad2202a14c5, region_id=RegionOne) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:26.183130 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad883d-aa82-4faa-9774-7e85c9ed411b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:26.184513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad883d-aa82-4faa-9774-7e85c9ed411b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:26.188515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08d48b-9238-46ed-a1bb-e2bc7bd60718 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.203756 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 387/784] 10.222.0.74 () {56 vars in 1251 bytes} [Wed Aug 31 00:16:26 2022] GET /identity/v3/endpoints?service_id=6cb6240e1468491b97cb8ad2202a14c5&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:26.206472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad883d-aa82-4faa-9774-7e85c9ed411b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.255118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd4c1-f343-47fd-a51c-8d3de54cf6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.256518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd4c1-f343-47fd-a51c-8d3de54cf6d5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.257135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd4c1-f343-47fd-a51c-8d3de54cf6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.257645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bd4c1-f343-47fd-a51c-8d3de54cf6d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.258525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bd4c1-f343-47fd-a51c-8d3de54cf6d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:26.259022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bd4c1-f343-47fd-a51c-8d3de54cf6d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:26.261357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bd4c1-f343-47fd-a51c-8d3de54cf6d5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:26.271110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 398/785] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:26.272259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd4c1-f343-47fd-a51c-8d3de54cf6d5 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.304699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:26.358793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad883d-aa82-4faa-9774-7e85c9ed411b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.411526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:26.419499 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bd4c1-f343-47fd-a51c-8d3de54cf6d5 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.437608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c54d7-4319-4a5c-98be-a7613e9f3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.437608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c54d7-4319-4a5c-98be-a7613e9f3e92 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.437608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c54d7-4319-4a5c-98be-a7613e9f3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.437608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c54d7-4319-4a5c-98be-a7613e9f3e92 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.438021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c54d7-4319-4a5c-98be-a7613e9f3e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:26.441600 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c54d7-4319-4a5c-98be-a7613e9f3e92 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:26.455521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 388/786] 10.222.0.74 () {56 vars in 1087 bytes} [Wed Aug 31 00:16:26 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:26.455521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c54d7-4319-4a5c-98be-a7613e9f3e92 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.500098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973974-6dcb-4164-9024-13197aec6b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.500757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973974-6dcb-4164-9024-13197aec6b75 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.501033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973974-6dcb-4164-9024-13197aec6b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.501304 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973974-6dcb-4164-9024-13197aec6b75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.538323 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74973974-6dcb-4164-9024-13197aec6b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-74973974-6dcb-4164-9024-13197aec6b75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:26.545123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:26.546199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:26.547067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:26.568115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 399/787] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:26.569097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973974-6dcb-4164-9024-13197aec6b75 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.672236 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c54d7-4319-4a5c-98be-a7613e9f3e92 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.701817 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:26.728822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973974-6dcb-4164-9024-13197aec6b75 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:26.729037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723bf67-81aa-41bb-9885-f66d61884679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.729037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723bf67-81aa-41bb-9885-f66d61884679 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.729037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723bf67-81aa-41bb-9885-f66d61884679 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.729037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723bf67-81aa-41bb-9885-f66d61884679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.732947 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723bf67-81aa-41bb-9885-f66d61884679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:26.734488 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723bf67-81aa-41bb-9885-f66d61884679 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:26.761608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b703ac-60c2-43e2-91ef-a644016ef494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:26.761608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b703ac-60c2-43e2-91ef-a644016ef494 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:26.761608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b703ac-60c2-43e2-91ef-a644016ef494 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:26.761608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b703ac-60c2-43e2-91ef-a644016ef494 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:26.765978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b703ac-60c2-43e2-91ef-a644016ef494 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:26.769601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b703ac-60c2-43e2-91ef-a644016ef494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:26.769601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b703ac-60c2-43e2-91ef-a644016ef494 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-4723bf67-81aa-41bb-9885-f66d61884679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:26.769778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:26.770669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:26.771594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:26.771594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:26.771594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:26.773202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 389/788] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:26.778514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723bf67-81aa-41bb-9885-f66d61884679 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.795284 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 400/789] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:26.796134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b703ac-60c2-43e2-91ef-a644016ef494 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:26.871782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:26.990567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723bf67-81aa-41bb-9885-f66d61884679 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:27.004555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b703ac-60c2-43e2-91ef-a644016ef494 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:27.062162 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32c193-43c1-4cb6-bdbc-046026d39119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:27.062780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32c193-43c1-4cb6-bdbc-046026d39119 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.063115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32c193-43c1-4cb6-bdbc-046026d39119 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.063388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32c193-43c1-4cb6-bdbc-046026d39119 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.064082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32c193-43c1-4cb6-bdbc-046026d39119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:27.064391 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32c193-43c1-4cb6-bdbc-046026d39119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:27.065782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32c193-43c1-4cb6-bdbc-046026d39119 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:27.077162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd12873-3ae9-4d47-bfc8-20dbc3501ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:27.077835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd12873-3ae9-4d47-bfc8-20dbc3501ebf None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.078114 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd12873-3ae9-4d47-bfc8-20dbc3501ebf None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.078388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd12873-3ae9-4d47-bfc8-20dbc3501ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.094475 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 390/790] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:27.096489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd12873-3ae9-4d47-bfc8-20dbc3501ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:27.098075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd12873-3ae9-4d47-bfc8-20dbc3501ebf None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:27.102452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32c193-43c1-4cb6-bdbc-046026d39119 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-5fd12873-3ae9-4d47-bfc8-20dbc3501ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:27.129412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:27.130616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:27.131521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:27.131521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:27.131521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:27.132668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 401/791] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:27.139356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd12873-3ae9-4d47-bfc8-20dbc3501ebf None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:27.147449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:27.306363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:27.315707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32c193-43c1-4cb6-bdbc-046026d39119 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:27.353005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd12873-3ae9-4d47-bfc8-20dbc3501ebf None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:27.393636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788a82a-b32a-4215-a6ad-caf72d58790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:27.394368 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788a82a-b32a-4215-a6ad-caf72d58790e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.394697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788a82a-b32a-4215-a6ad-caf72d58790e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.394973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788a82a-b32a-4215-a6ad-caf72d58790e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.408336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788a82a-b32a-4215-a6ad-caf72d58790e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:27.409894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788a82a-b32a-4215-a6ad-caf72d58790e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-6788a82a-b32a-4215-a6ad-caf72d58790e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:27.436198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:27.437234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:27.438619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:27.438619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:27.438619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:27.438619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:27.438619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:27.438619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:27.438619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:27.438619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:27.438619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:27.438619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:27.438619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 391/792] 10.222.0.74 () {56 vars in 1117 bytes} [Wed Aug 31 00:16:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:27.439211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738d81-24b9-40a7-8c44-091c75138c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:27.439587 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738d81-24b9-40a7-8c44-091c75138c89 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.439751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738d81-24b9-40a7-8c44-091c75138c89 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.440830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff738d81-24b9-40a7-8c44-091c75138c89 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.440830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff738d81-24b9-40a7-8c44-091c75138c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:27.440992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff738d81-24b9-40a7-8c44-091c75138c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:27.442370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff738d81-24b9-40a7-8c44-091c75138c89 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:27.445998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788a82a-b32a-4215-a6ad-caf72d58790e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:27.465151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 402/793] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:27.470615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738d81-24b9-40a7-8c44-091c75138c89 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:27.581336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:27.630431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788a82a-b32a-4215-a6ad-caf72d58790e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:27.649133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff738d81-24b9-40a7-8c44-091c75138c89 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:27.686379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59fa5b-8145-4614-b5ec-a3c1ad56c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:27.687265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59fa5b-8145-4614-b5ec-a3c1ad56c0fb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.687562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59fa5b-8145-4614-b5ec-a3c1ad56c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.688271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59fa5b-8145-4614-b5ec-a3c1ad56c0fb None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.689350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59fa5b-8145-4614-b5ec-a3c1ad56c0fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:27.689697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59fa5b-8145-4614-b5ec-a3c1ad56c0fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:27.692184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59fa5b-8145-4614-b5ec-a3c1ad56c0fb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:27.696620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b5357-ac50-44c7-83c8-6d4024bbc1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:27.698170 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5357-ac50-44c7-83c8-6d4024bbc1fe None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.699037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5357-ac50-44c7-83c8-6d4024bbc1fe None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.699477 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b5357-ac50-44c7-83c8-6d4024bbc1fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.708763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b5357-ac50-44c7-83c8-6d4024bbc1fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:27.711211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b5357-ac50-44c7-83c8-6d4024bbc1fe None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:27.713536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 392/794] 10.222.0.74 () {56 vars in 1149 bytes} [Wed Aug 31 00:16:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:27.715565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf8be-8c8a-4094-b330-b42d7aa31c0a None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.715858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf8be-8c8a-4094-b330-b42d7aa31c0a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.716143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5faf8be-8c8a-4094-b330-b42d7aa31c0a None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.717913 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 393/795] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:27.723555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faf8be-8c8a-4094-b330-b42d7aa31c0a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-625b5357-ac50-44c7-83c8-6d4024bbc1fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:27.732468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:27.733664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:27.734725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:27.734725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:27.734725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:27.734725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:27.734725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:27.734725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:27.734725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:27.734725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:27.734725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:27.734725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:27.735508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 403/796] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:27.736537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10373-8ebc-4f1d-a0d5-d880d03ba207 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.736816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10373-8ebc-4f1d-a0d5-d880d03ba207 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.737090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e10373-8ebc-4f1d-a0d5-d880d03ba207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.752091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:27.761258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-a1e10373-8ebc-4f1d-a0d5-d880d03ba207 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:27.762805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a1e10373-8ebc-4f1d-a0d5-d880d03ba207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:27.841682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 404/797] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:27.841682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10373-8ebc-4f1d-a0d5-d880d03ba207 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:27.868681 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5faf8be-8c8a-4094-b330-b42d7aa31c0a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:27.934102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:27.937657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d55f68-eb40-46f7-a913-067c9ceb4399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:27.938297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55f68-eb40-46f7-a913-067c9ceb4399 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:27.938572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55f68-eb40-46f7-a913-067c9ceb4399 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:27.938841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d55f68-eb40-46f7-a913-067c9ceb4399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:27.953611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d55f68-eb40-46f7-a913-067c9ceb4399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:27.953611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d55f68-eb40-46f7-a913-067c9ceb4399 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-18d55f68-eb40-46f7-a913-067c9ceb4399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:27.980937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:27.982026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:27.982939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:27.982939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:27.982939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:27.982939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 394/798] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:27.989257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d55f68-eb40-46f7-a913-067c9ceb4399 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.023518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e10373-8ebc-4f1d-a0d5-d880d03ba207 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.079214 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72165f9d-328c-4d60-b289-723cbf7bcf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.079828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165f9d-328c-4d60-b289-723cbf7bcf97 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.080111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165f9d-328c-4d60-b289-723cbf7bcf97 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.080389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165f9d-328c-4d60-b289-723cbf7bcf97 None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.081127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72165f9d-328c-4d60-b289-723cbf7bcf97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:28.081436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72165f9d-328c-4d60-b289-723cbf7bcf97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.082928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72165f9d-328c-4d60-b289-723cbf7bcf97 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.097312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:28.107038 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 405/799] 10.222.0.74 () {56 vars in 1135 bytes} [Wed Aug 31 00:16:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:28.117704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1d8f3-cd07-459e-bf0b-ac6a1b007302 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.117704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1d8f3-cd07-459e-bf0b-ac6a1b007302 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.117704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1d8f3-cd07-459e-bf0b-ac6a1b007302 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.117704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 406/800] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:28.120652 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4648-3e47-4182-ba37-612c0913ba83 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.121383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4648-3e47-4182-ba37-612c0913ba83 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.122106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4648-3e47-4182-ba37-612c0913ba83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.129613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d55f68-eb40-46f7-a913-067c9ceb4399 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.144848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-a54a4648-3e47-4182-ba37-612c0913ba83 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:28.146200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a54a4648-3e47-4182-ba37-612c0913ba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:28.171832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897832b-9f06-4139-9fe6-3fca4f267e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.172451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897832b-9f06-4139-9fe6-3fca4f267e29 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.172744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897832b-9f06-4139-9fe6-3fca4f267e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.173021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897832b-9f06-4139-9fe6-3fca4f267e29 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.173699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897832b-9f06-4139-9fe6-3fca4f267e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:28.174005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897832b-9f06-4139-9fe6-3fca4f267e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.175381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897832b-9f06-4139-9fe6-3fca4f267e29 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.192264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 395/801] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:28.193140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897832b-9f06-4139-9fe6-3fca4f267e29 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.241701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 407/802] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:28.241701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a4648-3e47-4182-ba37-612c0913ba83 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.292122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:28.313978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897832b-9f06-4139-9fe6-3fca4f267e29 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.347826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:28.355727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6535352-a5e3-4313-b1a5-2fff65517c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.356373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535352-a5e3-4313-b1a5-2fff65517c16 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.360338 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535352-a5e3-4313-b1a5-2fff65517c16 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.360338 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6535352-a5e3-4313-b1a5-2fff65517c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.371428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6535352-a5e3-4313-b1a5-2fff65517c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.373565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6535352-a5e3-4313-b1a5-2fff65517c16 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.377678 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a4648-3e47-4182-ba37-612c0913ba83 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-b6535352-a5e3-4313-b1a5-2fff65517c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:28.398115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:28.399149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:28.400063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:28.400063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:28.400063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:28.403092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 396/803] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:28.404072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6535352-a5e3-4313-b1a5-2fff65517c16 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.430175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8e3ec-cf20-493c-b4d5-8a344e1de419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.431165 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e3ec-cf20-493c-b4d5-8a344e1de419 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.432203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e3ec-cf20-493c-b4d5-8a344e1de419 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.432688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8e3ec-cf20-493c-b4d5-8a344e1de419 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.433848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8e3ec-cf20-493c-b4d5-8a344e1de419 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.435945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8e3ec-cf20-493c-b4d5-8a344e1de419 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-3db8e3ec-cf20-493c-b4d5-8a344e1de419 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:28.448010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:28.449053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 00:16:28.450176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:28.451270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 408/804] 10.222.0.74 () {56 vars in 1129 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:28.452424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8e3ec-cf20-493c-b4d5-8a344e1de419 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.551377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6535352-a5e3-4313-b1a5-2fff65517c16 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.571964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8e3ec-cf20-493c-b4d5-8a344e1de419 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.575110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:28.597657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87088208-2158-493c-9043-18f77ecb1da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.598416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088208-2158-493c-9043-18f77ecb1da8 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.598644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088208-2158-493c-9043-18f77ecb1da8 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.598925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088208-2158-493c-9043-18f77ecb1da8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.606504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87088208-2158-493c-9043-18f77ecb1da8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.607959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87088208-2158-493c-9043-18f77ecb1da8 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.608381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d430d-4110-4949-bd78-c81df0ae686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.609153 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d430d-4110-4949-bd78-c81df0ae686c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.609735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d430d-4110-4949-bd78-c81df0ae686c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.610149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d430d-4110-4949-bd78-c81df0ae686c None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.610988 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d430d-4110-4949-bd78-c81df0ae686c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:28.611430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d430d-4110-4949-bd78-c81df0ae686c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.613348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d430d-4110-4949-bd78-c81df0ae686c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-87088208-2158-493c-9043-18f77ecb1da8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:28.620065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:28.621096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:28.626746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:28.626746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:28.626746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:28.626746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:28.626746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:28.626746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:28.626746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:28.626746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:28.626746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 397/805] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:28.626746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87088208-2158-493c-9043-18f77ecb1da8 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.629274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 409/806] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:28.633912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d430d-4110-4949-bd78-c81df0ae686c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.668870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:28.741113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87088208-2158-493c-9043-18f77ecb1da8 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.743515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d430d-4110-4949-bd78-c81df0ae686c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.778629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3b49-dc0e-4006-b19a-034963d17ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.779083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714d8f-fd0f-4352-a113-3e7866214986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.779292 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3b49-dc0e-4006-b19a-034963d17ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.779522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3b49-dc0e-4006-b19a-034963d17ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.779707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714d8f-fd0f-4352-a113-3e7866214986 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.779804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3b49-dc0e-4006-b19a-034963d17ad8 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.779984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714d8f-fd0f-4352-a113-3e7866214986 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.780253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714d8f-fd0f-4352-a113-3e7866214986 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.780408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff3b49-dc0e-4006-b19a-034963d17ad8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:28.780723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff3b49-dc0e-4006-b19a-034963d17ad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.782125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff3b49-dc0e-4006-b19a-034963d17ad8 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.786865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 398/807] 10.222.0.74 () {56 vars in 1124 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:28.787495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3b49-dc0e-4006-b19a-034963d17ad8 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.799073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4714d8f-fd0f-4352-a113-3e7866214986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-b4714d8f-fd0f-4352-a113-3e7866214986 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:28.805163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:28.806193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:28.807687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:28.811659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 410/808] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:28.812498 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714d8f-fd0f-4352-a113-3e7866214986 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.839963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:28.894830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3b49-dc0e-4006-b19a-034963d17ad8 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.902570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:28.917457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714d8f-fd0f-4352-a113-3e7866214986 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:28.929751 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f5915-518b-4813-8927-560488cdbc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.930363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f5915-518b-4813-8927-560488cdbc6a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.930645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f5915-518b-4813-8927-560488cdbc6a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.930920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f5915-518b-4813-8927-560488cdbc6a None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.931653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f5915-518b-4813-8927-560488cdbc6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:28.931960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f5915-518b-4813-8927-560488cdbc6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.933416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f5915-518b-4813-8927-560488cdbc6a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.945057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 399/809] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:28.945882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f5915-518b-4813-8927-560488cdbc6a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:28.957633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8b1ee-6165-4f0a-a641-c81835629e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:28.958275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8b1ee-6165-4f0a-a641-c81835629e54 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.958558 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8b1ee-6165-4f0a-a641-c81835629e54 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.958830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8b1ee-6165-4f0a-a641-c81835629e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.966144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8b1ee-6165-4f0a-a641-c81835629e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:28.967581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8b1ee-6165-4f0a-a641-c81835629e54 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-6ba8b1ee-6165-4f0a-a641-c81835629e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:28.979618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:28.980766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:28.981877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:28.981877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:28.981877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:28.981877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:28.981877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:28.981877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:28.981877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:28.981877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:28.981877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 411/810] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:28.981877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23855a-1a2c-4074-9ccc-e4b9f26a9e79 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:28.982442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23855a-1a2c-4074-9ccc-e4b9f26a9e79 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:28.982442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23855a-1a2c-4074-9ccc-e4b9f26a9e79 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:28.987550 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 412/811] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:28.988381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23855a-1a2c-4074-9ccc-e4b9f26a9e79 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.051998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f5915-518b-4813-8927-560488cdbc6a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.077642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:29.086197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e5384-a3d5-4703-af81-b51493e2b3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.086808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5384-a3d5-4703-af81-b51493e2b3fe None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.088274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5384-a3d5-4703-af81-b51493e2b3fe None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.088274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e5384-a3d5-4703-af81-b51493e2b3fe None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.088716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e5384-a3d5-4703-af81-b51493e2b3fe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:29.089077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e5384-a3d5-4703-af81-b51493e2b3fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.090482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e5384-a3d5-4703-af81-b51493e2b3fe None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.094731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23855a-1a2c-4074-9ccc-e4b9f26a9e79 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.095302 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 400/812] 10.222.0.74 () {56 vars in 1124 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:29.096055 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e5384-a3d5-4703-af81-b51493e2b3fe None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.129271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:29.132195 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdb2aa-c150-470f-9dcc-30fba504dca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.132799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdb2aa-c150-470f-9dcc-30fba504dca1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.133152 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdb2aa-c150-470f-9dcc-30fba504dca1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.133363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdb2aa-c150-470f-9dcc-30fba504dca1 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.134058 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdb2aa-c150-470f-9dcc-30fba504dca1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:29.134365 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdb2aa-c150-470f-9dcc-30fba504dca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.136168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdb2aa-c150-470f-9dcc-30fba504dca1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.144868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 413/813] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:16:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:29.145764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdb2aa-c150-470f-9dcc-30fba504dca1 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.204611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e5384-a3d5-4703-af81-b51493e2b3fe None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.239996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f368815-d5d9-4d96-aa7c-f93446136036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.240652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f368815-d5d9-4d96-aa7c-f93446136036 None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.240931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f368815-d5d9-4d96-aa7c-f93446136036 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.241202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f368815-d5d9-4d96-aa7c-f93446136036 None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/b15b4c00f7214835b42e2775c4023032/roles/a6ed0e9279a54b28a542e9a12ad503a3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.249558 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdb2aa-c150-470f-9dcc-30fba504dca1 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.256711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f368815-d5d9-4d96-aa7c-f93446136036 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=b15b4c00f7214835b42e2775c4023032, role_id=a6ed0e9279a54b28a542e9a12ad503a3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.258193 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f368815-d5d9-4d96-aa7c-f93446136036 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.283958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332abd7-7e3c-41fd-91a4-ed09b46bc5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.284552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332abd7-7e3c-41fd-91a4-ed09b46bc5c2 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.284834 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332abd7-7e3c-41fd-91a4-ed09b46bc5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.285110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332abd7-7e3c-41fd-91a4-ed09b46bc5c2 None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.285831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332abd7-7e3c-41fd-91a4-ed09b46bc5c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:29.286141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332abd7-7e3c-41fd-91a4-ed09b46bc5c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.287570 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332abd7-7e3c-41fd-91a4-ed09b46bc5c2 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.310267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 414/814] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:29.315531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c3a2e-dfc8-40c5-9187-7daac199d4ef None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.315531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c3a2e-dfc8-40c5-9187-7daac199d4ef None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.315531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c3a2e-dfc8-40c5-9187-7daac199d4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.326441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:29.331977 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-7d8c3a2e-dfc8-40c5-9187-7daac199d4ef None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:29.333190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7d8c3a2e-dfc8-40c5-9187-7daac199d4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:29.340894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 401/815] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:16:29 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/b15b4c00f7214835b42e2775c4023032/roles/a6ed0e9279a54b28a542e9a12ad503a3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:29.341892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f368815-d5d9-4d96-aa7c-f93446136036 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.416907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 415/816] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:29.417764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c3a2e-dfc8-40c5-9187-7daac199d4ef None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.456026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:29.469678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f368815-d5d9-4d96-aa7c-f93446136036 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.515689 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5b4bd-6e6f-401c-bd56-4c43a37d527d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.516665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b4bd-6e6f-401c-bd56-4c43a37d527d None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.517157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b4bd-6e6f-401c-bd56-4c43a37d527d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.517689 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b4bd-6e6f-401c-bd56-4c43a37d527d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.518736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5b4bd-6e6f-401c-bd56-4c43a37d527d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.520220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5b4bd-6e6f-401c-bd56-4c43a37d527d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.553975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c3a2e-dfc8-40c5-9187-7daac199d4ef None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.591896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd78792-767a-4659-8aac-92b4d151d415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.592897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd78792-767a-4659-8aac-92b4d151d415 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.593406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd78792-767a-4659-8aac-92b4d151d415 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.593899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd78792-767a-4659-8aac-92b4d151d415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.597188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:29.606539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd78792-767a-4659-8aac-92b4d151d415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.608353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd78792-767a-4659-8aac-92b4d151d415 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-ccd78792-767a-4659-8aac-92b4d151d415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:29.624272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:29.625317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:29.626257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:29.626257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:29.626257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:29.628347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 416/817] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:29.629487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd78792-767a-4659-8aac-92b4d151d415 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.635360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 402/818] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:29.636188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5b4bd-6e6f-401c-bd56-4c43a37d527d None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.788434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd78792-767a-4659-8aac-92b4d151d415 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.809440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5b4bd-6e6f-401c-bd56-4c43a37d527d None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:29.835076 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aafc36-31c0-44ea-a3c2-1ebc40409bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.836094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aafc36-31c0-44ea-a3c2-1ebc40409bc3 None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.836565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aafc36-31c0-44ea-a3c2-1ebc40409bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.836879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aafc36-31c0-44ea-a3c2-1ebc40409bc3 None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/045ff88aba374cc889389ba07e884462/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.839514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aafc36-31c0-44ea-a3c2-1ebc40409bc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=045ff88aba374cc889389ba07e884462, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.840959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aafc36-31c0-44ea-a3c2-1ebc40409bc3 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.847619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:29.852820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7636a-c880-45a3-a06c-a2da320b8641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:29.854075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7636a-c880-45a3-a06c-a2da320b8641 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:29.855480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7636a-c880-45a3-a06c-a2da320b8641 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:29.855480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7636a-c880-45a3-a06c-a2da320b8641 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:29.855480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7636a-c880-45a3-a06c-a2da320b8641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:29.855725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7636a-c880-45a3-a06c-a2da320b8641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:29.857052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7636a-c880-45a3-a06c-a2da320b8641 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:29.870228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 403/819] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:29.870920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7636a-c880-45a3-a06c-a2da320b8641 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:29.934721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 417/820] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:16:29 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/045ff88aba374cc889389ba07e884462/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:29.936438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aafc36-31c0-44ea-a3c2-1ebc40409bc3 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.042853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:30.083675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7636a-c880-45a3-a06c-a2da320b8641 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.105609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aafc36-31c0-44ea-a3c2-1ebc40409bc3 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.152717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40069abb-528f-4355-968c-8a6b3809239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.153668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40069abb-528f-4355-968c-8a6b3809239f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.154029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40069abb-528f-4355-968c-8a6b3809239f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.154304 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40069abb-528f-4355-968c-8a6b3809239f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.164406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40069abb-528f-4355-968c-8a6b3809239f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.167150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d4b90-b086-4e13-a78f-7b8ef7cc036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.167546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40069abb-528f-4355-968c-8a6b3809239f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.167928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d4b90-b086-4e13-a78f-7b8ef7cc036f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.168447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d4b90-b086-4e13-a78f-7b8ef7cc036f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.168785 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d4b90-b086-4e13-a78f-7b8ef7cc036f None admin] PATH_INFO: `/v3/services/network` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.169450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d4b90-b086-4e13-a78f-7b8ef7cc036f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.172080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d4b90-b086-4e13-a78f-7b8ef7cc036f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-1b1d4b90-b086-4e13-a78f-7b8ef7cc036f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:30.182410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:30.183451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 00:16:30.184765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-40069abb-528f-4355-968c-8a6b3809239f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:30.185780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:30.186803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:30.187957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:30.187957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:30.187957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:30.187957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:30.187957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:30.187957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:30.187957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:30.187957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:30.187957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:16:30.187957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:30.193191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 404/821] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:29 2022] GET /identity/v3/services/network => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:30.193281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 418/822] 10.222.0.74 () {56 vars in 1093 bytes} [Wed Aug 31 00:16:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:30.193363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d4b90-b086-4e13-a78f-7b8ef7cc036f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.197599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40069abb-528f-4355-968c-8a6b3809239f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.286479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:30.331536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40069abb-528f-4355-968c-8a6b3809239f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.341457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:30.367611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51740445-24ff-4d3d-a50b-4bb7855609b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.368462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740445-24ff-4d3d-a50b-4bb7855609b3 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.369510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740445-24ff-4d3d-a50b-4bb7855609b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.370017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51740445-24ff-4d3d-a50b-4bb7855609b3 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.370833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51740445-24ff-4d3d-a50b-4bb7855609b3 None admin] RBAC: Adding query filter params (name=network) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:30.371283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51740445-24ff-4d3d-a50b-4bb7855609b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.372800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51740445-24ff-4d3d-a50b-4bb7855609b3 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.378605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 419/823] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:30.379818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d4b90-b086-4e13-a78f-7b8ef7cc036f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.395504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51740445-24ff-4d3d-a50b-4bb7855609b3 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.450907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d235e-8c5a-404f-8a53-978b6cdc2515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.451548 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d235e-8c5a-404f-8a53-978b6cdc2515 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.451829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d235e-8c5a-404f-8a53-978b6cdc2515 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.452103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d235e-8c5a-404f-8a53-978b6cdc2515 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.452849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d235e-8c5a-404f-8a53-978b6cdc2515 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:30.453161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d235e-8c5a-404f-8a53-978b6cdc2515 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.454634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d235e-8c5a-404f-8a53-978b6cdc2515 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.488134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 405/824] 10.222.0.74 () {56 vars in 1133 bytes} [Wed Aug 31 00:16:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:30.495428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d235e-8c5a-404f-8a53-978b6cdc2515 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.543790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51740445-24ff-4d3d-a50b-4bb7855609b3 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.618213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d235e-8c5a-404f-8a53-978b6cdc2515 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.626331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526b1a5-e0c1-4996-a199-4ab7592fdbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.630354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526b1a5-e0c1-4996-a199-4ab7592fdbd7 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.630831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526b1a5-e0c1-4996-a199-4ab7592fdbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.631284 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526b1a5-e0c1-4996-a199-4ab7592fdbd7 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.632083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526b1a5-e0c1-4996-a199-4ab7592fdbd7 None admin] RBAC: Adding query filter params (type=network) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:30.632548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526b1a5-e0c1-4996-a199-4ab7592fdbd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.636742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526b1a5-e0c1-4996-a199-4ab7592fdbd7 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.647523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 420/825] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:30.648902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526b1a5-e0c1-4996-a199-4ab7592fdbd7 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:30.654929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:30.713950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:30.714785 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77643c36-1c1c-44da-9375-5642a176fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.715409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77643c36-1c1c-44da-9375-5642a176fff3 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.715693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77643c36-1c1c-44da-9375-5642a176fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.716025 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77643c36-1c1c-44da-9375-5642a176fff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.778724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526b1a5-e0c1-4996-a199-4ab7592fdbd7 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:30.833871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77643c36-1c1c-44da-9375-5642a176fff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.835624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77643c36-1c1c-44da-9375-5642a176fff3 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.866557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e35076-814e-4f74-bc92-f5a4caf224c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:30.868952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e35076-814e-4f74-bc92-f5a4caf224c9 None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:30.869555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e35076-814e-4f74-bc92-f5a4caf224c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:30.871024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e35076-814e-4f74-bc92-f5a4caf224c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:30.871857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e35076-814e-4f74-bc92-f5a4caf224c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:30.874578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e35076-814e-4f74-bc92-f5a4caf224c9 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:30.972718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 421/826] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:30 2022] POST /identity/v3/endpoints => generated 337 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:30.983119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 406/827] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:16:30.989967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e35076-814e-4f74-bc92-f5a4caf224c9 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.119544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:31.141394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e35076-814e-4f74-bc92-f5a4caf224c9 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.186038 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed71709-3dd0-4d4d-b2d1-87f35b7e9369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.186935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71709-3dd0-4d4d-b2d1-87f35b7e9369 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.187366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71709-3dd0-4d4d-b2d1-87f35b7e9369 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.187786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed71709-3dd0-4d4d-b2d1-87f35b7e9369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.205312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed71709-3dd0-4d4d-b2d1-87f35b7e9369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.207043 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed71709-3dd0-4d4d-b2d1-87f35b7e9369 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-7ed71709-3dd0-4d4d-b2d1-87f35b7e9369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:31.224345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:31.225420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:31.226851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:31.226851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:31.226851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:31.226851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 422/828] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:31.234119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77643c36-1c1c-44da-9375-5642a176fff3 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.265771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:31.370483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77643c36-1c1c-44da-9375-5642a176fff3 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.407815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad89964-d4bf-45b1-aa80-83a68c02aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.408462 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89964-d4bf-45b1-aa80-83a68c02aab5 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.408679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89964-d4bf-45b1-aa80-83a68c02aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.408947 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89964-d4bf-45b1-aa80-83a68c02aab5 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.409603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad89964-d4bf-45b1-aa80-83a68c02aab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:31.409908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad89964-d4bf-45b1-aa80-83a68c02aab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.411267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad89964-d4bf-45b1-aa80-83a68c02aab5 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.423325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 407/829] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:31.428814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed71709-3dd0-4d4d-b2d1-87f35b7e9369 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.544549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed71709-3dd0-4d4d-b2d1-87f35b7e9369 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.584501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d76d27-13ef-4b28-b39c-63c24acefb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.585139 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d76d27-13ef-4b28-b39c-63c24acefb18 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.585416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d76d27-13ef-4b28-b39c-63c24acefb18 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.585720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d76d27-13ef-4b28-b39c-63c24acefb18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.592949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d76d27-13ef-4b28-b39c-63c24acefb18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.594426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d76d27-13ef-4b28-b39c-63c24acefb18 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.597221 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-52d76d27-13ef-4b28-b39c-63c24acefb18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:31.607508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:31.608542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:31.609454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:31.609454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:31.609454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:31.609454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:31.609454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:31.609454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:31.609454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:31.609454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:31.615478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 423/830] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:31.625830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad89964-d4bf-45b1-aa80-83a68c02aab5 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.634803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fa5ad-547f-4060-a7e5-4f17fbcaeb3f None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.635092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fa5ad-547f-4060-a7e5-4f17fbcaeb3f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.635439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fa5ad-547f-4060-a7e5-4f17fbcaeb3f None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.636959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 424/831] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:31.642345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b119-045e-4448-88de-7827ea017bd2 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.642633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b119-045e-4448-88de-7827ea017bd2 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.642904 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421b119-045e-4448-88de-7827ea017bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.668547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-1421b119-045e-4448-88de-7827ea017bd2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:31.670509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1421b119-045e-4448-88de-7827ea017bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:31.710447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:31.742046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad89964-d4bf-45b1-aa80-83a68c02aab5 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.753174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 425/832] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:31.781730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52933a17-c92f-4f42-9e6c-43a9a0a0f039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.782631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52933a17-c92f-4f42-9e6c-43a9a0a0f039 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.783083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52933a17-c92f-4f42-9e6c-43a9a0a0f039 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.783498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52933a17-c92f-4f42-9e6c-43a9a0a0f039 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.784333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52933a17-c92f-4f42-9e6c-43a9a0a0f039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:31.784781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52933a17-c92f-4f42-9e6c-43a9a0a0f039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.786371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52933a17-c92f-4f42-9e6c-43a9a0a0f039 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.800251 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 408/833] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:31.806526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b119-045e-4448-88de-7827ea017bd2 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:31.910373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421b119-045e-4448-88de-7827ea017bd2 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:31.939231 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27db3b-ec39-4d68-a673-bb753155e3c5 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.939570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27db3b-ec39-4d68-a673-bb753155e3c5 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.939778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27db3b-ec39-4d68-a673-bb753155e3c5 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.941857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 409/834] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:31.944554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:31.950867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11c2e5-46b8-476e-913c-63efb5eff8f7 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.951508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11c2e5-46b8-476e-913c-63efb5eff8f7 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.952094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11c2e5-46b8-476e-913c-63efb5eff8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.953565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a97c-5f8f-40ec-97f9-adeb7db339b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:31.954203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a97c-5f8f-40ec-97f9-adeb7db339b0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:31.955382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a97c-5f8f-40ec-97f9-adeb7db339b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:31.955382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a97c-5f8f-40ec-97f9-adeb7db339b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:31.955717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a97c-5f8f-40ec-97f9-adeb7db339b0 None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=90147848fe604ca9912d10a214a45227) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:31.955992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a97c-5f8f-40ec-97f9-adeb7db339b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:31.957441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a97c-5f8f-40ec-97f9-adeb7db339b0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:31.965136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 426/835] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:31 2022] GET /identity/v3/role_assignments?user.id=90147848fe604ca9912d10a214a45227&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:31.977381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-da11c2e5-46b8-476e-913c-63efb5eff8f7 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:31.979294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-da11c2e5-46b8-476e-913c-63efb5eff8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:32.037324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a97c-5f8f-40ec-97f9-adeb7db339b0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.069747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 410/836] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:32.167096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a97c-5f8f-40ec-97f9-adeb7db339b0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.206627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d96a0-99f6-4487-b692-6d1ff1939202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.207651 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d96a0-99f6-4487-b692-6d1ff1939202 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.208149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d96a0-99f6-4487-b692-6d1ff1939202 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.208631 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d96a0-99f6-4487-b692-6d1ff1939202 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.211723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642168a-cdd9-4adc-8ed9-0817ead1785c None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.211974 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642168a-cdd9-4adc-8ed9-0817ead1785c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.212208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642168a-cdd9-4adc-8ed9-0817ead1785c None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.214073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 411/837] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:32.219137 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b197fd-5024-4f3b-af49-74561fb7438e None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.219432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b197fd-5024-4f3b-af49-74561fb7438e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.219707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b197fd-5024-4f3b-af49-74561fb7438e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.222115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d96a0-99f6-4487-b692-6d1ff1939202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-a49d96a0-99f6-4487-b692-6d1ff1939202 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:32.227796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:32.229290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:16:32.230187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:32.231293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 427/838] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:32.237730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d96a0-99f6-4487-b692-6d1ff1939202 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.240120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-62b197fd-5024-4f3b-af49-74561fb7438e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:32.241314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-62b197fd-5024-4f3b-af49-74561fb7438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:32.304904 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.314005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.324252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 412/839] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:32.348418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b197fd-5024-4f3b-af49-74561fb7438e None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.359183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d96a0-99f6-4487-b692-6d1ff1939202 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.404878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3f563-0192-47d1-a77e-5833f5ed9b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.405858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f563-0192-47d1-a77e-5833f5ed9b0c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.406322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f563-0192-47d1-a77e-5833f5ed9b0c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.406792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3f563-0192-47d1-a77e-5833f5ed9b0c None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.408221 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3f563-0192-47d1-a77e-5833f5ed9b0c None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:32.408979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3f563-0192-47d1-a77e-5833f5ed9b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.411242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3f563-0192-47d1-a77e-5833f5ed9b0c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.424973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 428/840] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:32.430587 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3f563-0192-47d1-a77e-5833f5ed9b0c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.467711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b197fd-5024-4f3b-af49-74561fb7438e None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.511353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4429a35-5710-4253-a040-84caac7829db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.512579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429a35-5710-4253-a040-84caac7829db None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.513543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429a35-5710-4253-a040-84caac7829db None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.514292 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4429a35-5710-4253-a040-84caac7829db None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.515097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4429a35-5710-4253-a040-84caac7829db None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.516910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4429a35-5710-4253-a040-84caac7829db None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-c4429a35-5710-4253-a040-84caac7829db None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:32.532930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:32.534380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:32.535237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 413/841] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:32.544523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4429a35-5710-4253-a040-84caac7829db None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.560563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3f563-0192-47d1-a77e-5833f5ed9b0c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.584861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.605189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1b5cf-f577-4eac-834f-16e68c662942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.605847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1b5cf-f577-4eac-834f-16e68c662942 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.606128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1b5cf-f577-4eac-834f-16e68c662942 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.606399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1b5cf-f577-4eac-834f-16e68c662942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.609620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.616744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1b5cf-f577-4eac-834f-16e68c662942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.619289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1b5cf-f577-4eac-834f-16e68c662942 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-a4c1b5cf-f577-4eac-834f-16e68c662942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:32.635178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:32.636398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:32.637296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:32.637296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:32.637296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:32.641096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 429/842] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:32.641998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1b5cf-f577-4eac-834f-16e68c662942 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.660959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4429a35-5710-4253-a040-84caac7829db None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.698336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52f2cd-5a90-4582-bd84-47875630e5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.698873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52f2cd-5a90-4582-bd84-47875630e5fb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.699156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52f2cd-5a90-4582-bd84-47875630e5fb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.699432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52f2cd-5a90-4582-bd84-47875630e5fb None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.700065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52f2cd-5a90-4582-bd84-47875630e5fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:32.700371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52f2cd-5a90-4582-bd84-47875630e5fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.701775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52f2cd-5a90-4582-bd84-47875630e5fb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.710910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 414/843] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:32.710910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52f2cd-5a90-4582-bd84-47875630e5fb None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.747124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1b5cf-f577-4eac-834f-16e68c662942 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.780926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61588821-f49e-484b-92e8-e4ee6cc0d6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.781545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61588821-f49e-484b-92e8-e4ee6cc0d6be None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.781880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61588821-f49e-484b-92e8-e4ee6cc0d6be None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.782118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61588821-f49e-484b-92e8-e4ee6cc0d6be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.793065 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61588821-f49e-484b-92e8-e4ee6cc0d6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-61588821-f49e-484b-92e8-e4ee6cc0d6be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:32.798566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:32.799544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:32.800409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 430/844] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:32.801626 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61588821-f49e-484b-92e8-e4ee6cc0d6be None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.817520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52f2cd-5a90-4582-bd84-47875630e5fb None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.833636 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.843205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:32.855028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6f6ae-fde9-469f-ab80-8c3af28c3d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.855639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6f6ae-fde9-469f-ab80-8c3af28c3d57 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.855923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6f6ae-fde9-469f-ab80-8c3af28c3d57 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.856200 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6f6ae-fde9-469f-ab80-8c3af28c3d57 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.856946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6f6ae-fde9-469f-ab80-8c3af28c3d57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:32.857253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6f6ae-fde9-469f-ab80-8c3af28c3d57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.858656 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6f6ae-fde9-469f-ab80-8c3af28c3d57 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.871286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 415/845] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:32.872185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6f6ae-fde9-469f-ab80-8c3af28c3d57 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.921188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61588821-f49e-484b-92e8-e4ee6cc0d6be None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:32.960009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9524-c7d7-4a37-b6d1-790d3411729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:32.960541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9524-c7d7-4a37-b6d1-790d3411729a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:32.960823 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9524-c7d7-4a37-b6d1-790d3411729a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:32.961099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9524-c7d7-4a37-b6d1-790d3411729a None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:32.961768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9524-c7d7-4a37-b6d1-790d3411729a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:32.962074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9524-c7d7-4a37-b6d1-790d3411729a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:32.963639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9524-c7d7-4a37-b6d1-790d3411729a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:32.973624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 431/846] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:32.973624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9524-c7d7-4a37-b6d1-790d3411729a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:32.995355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6f6ae-fde9-469f-ab80-8c3af28c3d57 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.035362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554dc65-45a5-4e9f-9773-0325600502c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.036172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554dc65-45a5-4e9f-9773-0325600502c2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.036513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554dc65-45a5-4e9f-9773-0325600502c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.036856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554dc65-45a5-4e9f-9773-0325600502c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.037653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554dc65-45a5-4e9f-9773-0325600502c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:33.038035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554dc65-45a5-4e9f-9773-0325600502c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.039776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554dc65-45a5-4e9f-9773-0325600502c2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.051212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 416/847] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:33.058464 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554dc65-45a5-4e9f-9773-0325600502c2 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.091453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.101381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9524-c7d7-4a37-b6d1-790d3411729a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.113906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.144181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d033e8-8117-4b5c-884c-25b9cdcc5390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.144814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d033e8-8117-4b5c-884c-25b9cdcc5390 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.145088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d033e8-8117-4b5c-884c-25b9cdcc5390 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.145356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d033e8-8117-4b5c-884c-25b9cdcc5390 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.157335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d033e8-8117-4b5c-884c-25b9cdcc5390 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.158863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d033e8-8117-4b5c-884c-25b9cdcc5390 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-a8d033e8-8117-4b5c-884c-25b9cdcc5390 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:33.173873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:33.174922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:33.175903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:33.175903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:33.175903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:33.175903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:33.175903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:33.175903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:33.175903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:33.175903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:33.175903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:33.175903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:33.175903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 432/848] 10.222.0.74 () {56 vars in 1117 bytes} [Wed Aug 31 00:16:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:33.180922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d033e8-8117-4b5c-884c-25b9cdcc5390 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.191721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554dc65-45a5-4e9f-9773-0325600502c2 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.234478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de852c1-97d5-4df9-9342-90fc297ed8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.235372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de852c1-97d5-4df9-9342-90fc297ed8e6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.235718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de852c1-97d5-4df9-9342-90fc297ed8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.236282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de852c1-97d5-4df9-9342-90fc297ed8e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.249357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de852c1-97d5-4df9-9342-90fc297ed8e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.250848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de852c1-97d5-4df9-9342-90fc297ed8e6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-4de852c1-97d5-4df9-9342-90fc297ed8e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:33.268508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:33.269511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:33.270449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:33.270449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:33.270449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:33.270825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 417/849] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:33.277057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de852c1-97d5-4df9-9342-90fc297ed8e6 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.297359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d033e8-8117-4b5c-884c-25b9cdcc5390 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.336053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514e4aa-ec73-4b7c-ad53-e21f1bdbf069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.337065 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e4aa-ec73-4b7c-ad53-e21f1bdbf069 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.338482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e4aa-ec73-4b7c-ad53-e21f1bdbf069 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.339306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e4aa-ec73-4b7c-ad53-e21f1bdbf069 None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.340923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514e4aa-ec73-4b7c-ad53-e21f1bdbf069 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:33.341794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514e4aa-ec73-4b7c-ad53-e21f1bdbf069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.343632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514e4aa-ec73-4b7c-ad53-e21f1bdbf069 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.368003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 433/850] 10.222.0.74 () {56 vars in 1149 bytes} [Wed Aug 31 00:16:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:33.370150 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514e4aa-ec73-4b7c-ad53-e21f1bdbf069 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.381684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.383194 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.388881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de852c1-97d5-4df9-9342-90fc297ed8e6 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.425923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b3ca9-3c57-402f-a55b-480ffa79d259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.426562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b3ca9-3c57-402f-a55b-480ffa79d259 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.426844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b3ca9-3c57-402f-a55b-480ffa79d259 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.427120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b3ca9-3c57-402f-a55b-480ffa79d259 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.427771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b3ca9-3c57-402f-a55b-480ffa79d259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:33.428192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b3ca9-3c57-402f-a55b-480ffa79d259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.429595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b3ca9-3c57-402f-a55b-480ffa79d259 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.445306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 418/851] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:33.447826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b3ca9-3c57-402f-a55b-480ffa79d259 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.482367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514e4aa-ec73-4b7c-ad53-e21f1bdbf069 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.520255 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f17e9-65bc-4e40-94a4-131d151a1d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.521056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f17e9-65bc-4e40-94a4-131d151a1d96 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.521428 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f17e9-65bc-4e40-94a4-131d151a1d96 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.521826 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f17e9-65bc-4e40-94a4-131d151a1d96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.562297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b3ca9-3c57-402f-a55b-480ffa79d259 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.593898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f17e9-65bc-4e40-94a4-131d151a1d96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.595494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f17e9-65bc-4e40-94a4-131d151a1d96 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.600557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa780869-503e-4795-a0ab-d79c02bc93ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.601201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa780869-503e-4795-a0ab-d79c02bc93ab None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.601486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa780869-503e-4795-a0ab-d79c02bc93ab None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.601808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa780869-503e-4795-a0ab-d79c02bc93ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.608043 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.611712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa780869-503e-4795-a0ab-d79c02bc93ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.613393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa780869-503e-4795-a0ab-d79c02bc93ab None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-fa780869-503e-4795-a0ab-d79c02bc93ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:33.626332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:33.636564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 419/852] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:16:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:33.637520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa780869-503e-4795-a0ab-d79c02bc93ab None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.656353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.707128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 434/853] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:16:33.708145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f17e9-65bc-4e40-94a4-131d151a1d96 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.748683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa780869-503e-4795-a0ab-d79c02bc93ab None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.788969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a159d6-7d42-466d-b777-21027e1875c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.790068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a159d6-7d42-466d-b777-21027e1875c2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.790582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a159d6-7d42-466d-b777-21027e1875c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.791054 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a159d6-7d42-466d-b777-21027e1875c2 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.792023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a159d6-7d42-466d-b777-21027e1875c2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:33.792651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a159d6-7d42-466d-b777-21027e1875c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.794409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a159d6-7d42-466d-b777-21027e1875c2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.812609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f17e9-65bc-4e40-94a4-131d151a1d96 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.818905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 420/854] 10.222.0.74 () {56 vars in 1135 bytes} [Wed Aug 31 00:16:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:33.820056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a159d6-7d42-466d-b777-21027e1875c2 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.825553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.850113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacadbd-e21a-4e15-b759-c63edecadd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.850791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacadbd-e21a-4e15-b759-c63edecadd2f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.851138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacadbd-e21a-4e15-b759-c63edecadd2f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.851343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacadbd-e21a-4e15-b759-c63edecadd2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.861972 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacadbd-e21a-4e15-b759-c63edecadd2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:33.863539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacadbd-e21a-4e15-b759-c63edecadd2f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-0aacadbd-e21a-4e15-b759-c63edecadd2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:33.879482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:33.880490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:33.881408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:33.881408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:33.881408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:33.885739 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 435/855] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:33.887572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacadbd-e21a-4e15-b759-c63edecadd2f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:33.917146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:33.944352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a159d6-7d42-466d-b777-21027e1875c2 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:33.981308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580b501-f39b-470b-800c-0287bd55e46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:33.982302 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b501-f39b-470b-800c-0287bd55e46b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:33.982784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b501-f39b-470b-800c-0287bd55e46b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:33.983256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580b501-f39b-470b-800c-0287bd55e46b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:33.998238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacadbd-e21a-4e15-b759-c63edecadd2f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.035925 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da46087-ed7e-4e16-b338-7fdd687a6a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.036536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da46087-ed7e-4e16-b338-7fdd687a6a3f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.036848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da46087-ed7e-4e16-b338-7fdd687a6a3f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.037318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da46087-ed7e-4e16-b338-7fdd687a6a3f None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.037895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da46087-ed7e-4e16-b338-7fdd687a6a3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:34.038199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da46087-ed7e-4e16-b338-7fdd687a6a3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.039628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da46087-ed7e-4e16-b338-7fdd687a6a3f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.054369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 436/856] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:34.058355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580b501-f39b-470b-800c-0287bd55e46b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.059894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580b501-f39b-470b-800c-0287bd55e46b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.060373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b800c5-7ddb-4a4c-90af-f1d8709a5457 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.060662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b800c5-7ddb-4a4c-90af-f1d8709a5457 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.060938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b800c5-7ddb-4a4c-90af-f1d8709a5457 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.064264 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 437/857] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:34.064264 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b800c5-7ddb-4a4c-90af-f1d8709a5457 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.088954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.142796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.169564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 421/858] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:16:34.171388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dbbde-9e40-4652-bcff-df036de7b4ce None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.171799 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dbbde-9e40-4652-bcff-df036de7b4ce None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.172223 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dbbde-9e40-4652-bcff-df036de7b4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.177343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b800c5-7ddb-4a4c-90af-f1d8709a5457 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.192134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-d52dbbde-9e40-4652-bcff-df036de7b4ce None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:34.193318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d52dbbde-9e40-4652-bcff-df036de7b4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:34.216400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8198-ba7b-4ab1-8e11-721c70de12fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.217040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8198-ba7b-4ab1-8e11-721c70de12fc None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.217480 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8198-ba7b-4ab1-8e11-721c70de12fc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.217802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8198-ba7b-4ab1-8e11-721c70de12fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.224930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8198-ba7b-4ab1-8e11-721c70de12fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.226408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d8198-ba7b-4ab1-8e11-721c70de12fc None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-4d2d8198-ba7b-4ab1-8e11-721c70de12fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:34.237958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:34.238910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:34.239839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:34.239839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:34.239839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:34.239839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:34.239839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:34.239839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:34.239839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:34.239839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:34.239839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 438/859] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:34.239839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8198-ba7b-4ab1-8e11-721c70de12fc None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.270265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 422/860] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:34.271293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dbbde-9e40-4652-bcff-df036de7b4ce None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.331821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.352096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8198-ba7b-4ab1-8e11-721c70de12fc None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.393877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfca3fb-eb46-4e28-96de-d2089e71de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.394519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfca3fb-eb46-4e28-96de-d2089e71de69 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.394796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfca3fb-eb46-4e28-96de-d2089e71de69 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.395069 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfca3fb-eb46-4e28-96de-d2089e71de69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.402402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dbbde-9e40-4652-bcff-df036de7b4ce None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.405997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.410590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfca3fb-eb46-4e28-96de-d2089e71de69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.412706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfca3fb-eb46-4e28-96de-d2089e71de69 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-9bfca3fb-eb46-4e28-96de-d2089e71de69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:34.433699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:34.434783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:34.435673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:34.435673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:34.435673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:34.438837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 439/861] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:34.445602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfca3fb-eb46-4e28-96de-d2089e71de69 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.446484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a64016-d4e2-4336-9822-d86366bb8f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.447862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64016-d4e2-4336-9822-d86366bb8f12 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.448302 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64016-d4e2-4336-9822-d86366bb8f12 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.448582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64016-d4e2-4336-9822-d86366bb8f12 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.449288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a64016-d4e2-4336-9822-d86366bb8f12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:34.449614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a64016-d4e2-4336-9822-d86366bb8f12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.451078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a64016-d4e2-4336-9822-d86366bb8f12 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.465932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 423/862] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:34.477653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a64016-d4e2-4336-9822-d86366bb8f12 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.562238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfca3fb-eb46-4e28-96de-d2089e71de69 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.601285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a276f-272b-44b3-a6a1-45314565d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.601941 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a276f-272b-44b3-a6a1-45314565d848 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.602178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a276f-272b-44b3-a6a1-45314565d848 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.602384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a276f-272b-44b3-a6a1-45314565d848 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.602794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a64016-d4e2-4336-9822-d86366bb8f12 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.603197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a276f-272b-44b3-a6a1-45314565d848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:34.603353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a276f-272b-44b3-a6a1-45314565d848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.604708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a276f-272b-44b3-a6a1-45314565d848 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.606573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.622891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 440/863] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:34.622891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a276f-272b-44b3-a6a1-45314565d848 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.643790 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13879617-d9aa-40eb-88d6-169862cf3ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.644441 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13879617-d9aa-40eb-88d6-169862cf3ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.644715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13879617-d9aa-40eb-88d6-169862cf3ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.644897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13879617-d9aa-40eb-88d6-169862cf3ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.645636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13879617-d9aa-40eb-88d6-169862cf3ae2 None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=b15b4c00f7214835b42e2775c4023032) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:34.645946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13879617-d9aa-40eb-88d6-169862cf3ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.647373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13879617-d9aa-40eb-88d6-169862cf3ae2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.654435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 424/864] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:34 2022] GET /identity/v3/role_assignments?user.id=b15b4c00f7214835b42e2775c4023032&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:34.658541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13879617-d9aa-40eb-88d6-169862cf3ae2 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.708340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.745388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a276f-272b-44b3-a6a1-45314565d848 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.789671 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c3a70-4c45-4f52-9fd0-99b1c9978f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.791027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c3a70-4c45-4f52-9fd0-99b1c9978f22 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.791314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c3a70-4c45-4f52-9fd0-99b1c9978f22 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.791593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c3a70-4c45-4f52-9fd0-99b1c9978f22 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.792563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c3a70-4c45-4f52-9fd0-99b1c9978f22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.794459 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c3a70-4c45-4f52-9fd0-99b1c9978f22 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.807686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13879617-d9aa-40eb-88d6-169862cf3ae2 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-144c3a70-4c45-4f52-9fd0-99b1c9978f22 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:34.810259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:34.811246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:34.812320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 441/865] 10.222.0.74 () {56 vars in 1132 bytes} [Wed Aug 31 00:16:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:34.818035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c3a70-4c45-4f52-9fd0-99b1c9978f22 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.868353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764deba-cf95-476f-b3ba-5769e61e5258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:34.869599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764deba-cf95-476f-b3ba-5769e61e5258 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:34.869928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764deba-cf95-476f-b3ba-5769e61e5258 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:34.870206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764deba-cf95-476f-b3ba-5769e61e5258 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:34.878006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764deba-cf95-476f-b3ba-5769e61e5258 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:34.879008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764deba-cf95-476f-b3ba-5769e61e5258 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:34.900029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-7764deba-cf95-476f-b3ba-5769e61e5258 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:34.902691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:34.903640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:34.906759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:34.906759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:34.906759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:34.906759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:34.906759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:34.906759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:34.906759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:34.906759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:34.906759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 425/866] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:34.912909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764deba-cf95-476f-b3ba-5769e61e5258 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:34.961974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c3a70-4c45-4f52-9fd0-99b1c9978f22 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.004633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9ab84-305a-4937-86ca-cb797f312c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.005246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ab84-305a-4937-86ca-cb797f312c14 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.005529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ab84-305a-4937-86ca-cb797f312c14 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.005840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ab84-305a-4937-86ca-cb797f312c14 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.006624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9ab84-305a-4937-86ca-cb797f312c14 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:35.006957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9ab84-305a-4937-86ca-cb797f312c14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.008350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9ab84-305a-4937-86ca-cb797f312c14 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.014222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 442/867] 10.222.0.74 () {56 vars in 1126 bytes} [Wed Aug 31 00:16:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:35.016035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f810-e343-4fad-ad6d-504a14238694 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.016325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f810-e343-4fad-ad6d-504a14238694 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.016606 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f810-e343-4fad-ad6d-504a14238694 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.022276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 443/868] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:35.024593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452f810-e343-4fad-ad6d-504a14238694 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.046427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:35.058825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764deba-cf95-476f-b3ba-5769e61e5258 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.096849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0be0-d856-470c-b718-68eef0d1b144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.097475 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0be0-d856-470c-b718-68eef0d1b144 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.097763 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0be0-d856-470c-b718-68eef0d1b144 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.098037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0be0-d856-470c-b718-68eef0d1b144 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.098727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0be0-d856-470c-b718-68eef0d1b144 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:35.099030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0be0-d856-470c-b718-68eef0d1b144 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.100455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0be0-d856-470c-b718-68eef0d1b144 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.112382 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 426/869] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:35.118310 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8829d7e-893c-4eb1-8b92-cd664264ebb0 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.119285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8829d7e-893c-4eb1-8b92-cd664264ebb0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.119517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8829d7e-893c-4eb1-8b92-cd664264ebb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.139227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-c8829d7e-893c-4eb1-8b92-cd664264ebb0 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:35.140409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c8829d7e-893c-4eb1-8b92-cd664264ebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:35.141296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452f810-e343-4fad-ad6d-504a14238694 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.166445 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:35.180920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64453342-ae37-4cf8-973c-1c486979138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.182236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453342-ae37-4cf8-973c-1c486979138f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.182516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453342-ae37-4cf8-973c-1c486979138f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.182788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64453342-ae37-4cf8-973c-1c486979138f None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.183425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64453342-ae37-4cf8-973c-1c486979138f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:35.183729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64453342-ae37-4cf8-973c-1c486979138f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.185144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64453342-ae37-4cf8-973c-1c486979138f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.190149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 444/870] 10.222.0.74 () {56 vars in 1126 bytes} [Wed Aug 31 00:16:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:35.190912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64453342-ae37-4cf8-973c-1c486979138f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.244274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 427/871] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:35.324550 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64453342-ae37-4cf8-973c-1c486979138f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.390105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18472e3-32df-4a0c-9e70-a2b01ce34d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.390609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18472e3-32df-4a0c-9e70-a2b01ce34d59 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.390891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18472e3-32df-4a0c-9e70-a2b01ce34d59 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.391168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18472e3-32df-4a0c-9e70-a2b01ce34d59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.391915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18472e3-32df-4a0c-9e70-a2b01ce34d59 None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=045ff88aba374cc889389ba07e884462) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:35.392226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18472e3-32df-4a0c-9e70-a2b01ce34d59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.393711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18472e3-32df-4a0c-9e70-a2b01ce34d59 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.400898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 445/872] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:35 2022] GET /identity/v3/role_assignments?user.id=045ff88aba374cc889389ba07e884462&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:35.567821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8829d7e-893c-4eb1-8b92-cd664264ebb0 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:35.665837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:35.695430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8829d7e-893c-4eb1-8b92-cd664264ebb0 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:35.732864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b572409-34a0-45c8-8db3-e116b7911949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:35.733486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572409-34a0-45c8-8db3-e116b7911949 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:35.733791 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572409-34a0-45c8-8db3-e116b7911949 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:35.734070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b572409-34a0-45c8-8db3-e116b7911949 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:35.734727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b572409-34a0-45c8-8db3-e116b7911949 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:35.736101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b572409-34a0-45c8-8db3-e116b7911949 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:35.810222 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 428/873] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:16:35 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:36.870045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b50ff-0531-4d2a-b1a8-2a0658bffe30 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.870567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b50ff-0531-4d2a-b1a8-2a0658bffe30 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.870567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b50ff-0531-4d2a-b1a8-2a0658bffe30 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:36.872167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 446/874] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:16:36.877339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac5bc9-6328-4828-b92d-45bcaba22fee None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:36.877853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac5bc9-6328-4828-b92d-45bcaba22fee None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:36.877987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac5bc9-6328-4828-b92d-45bcaba22fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:36.903276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-47ac5bc9-6328-4828-b92d-45bcaba22fee None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:36.904810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-47ac5bc9-6328-4828-b92d-45bcaba22fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:36.987506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 429/875] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:37.159119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4290cf-54aa-493c-bac3-6f75e4ec46d6 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.159413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4290cf-54aa-493c-bac3-6f75e4ec46d6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.159651 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4290cf-54aa-493c-bac3-6f75e4ec46d6 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.161110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 447/876] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:37.167081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24241129-e128-4760-8b61-df3ca75d4a2a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.167374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24241129-e128-4760-8b61-df3ca75d4a2a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.167651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24241129-e128-4760-8b61-df3ca75d4a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.186119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-24241129-e128-4760-8b61-df3ca75d4a2a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:37.187297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-24241129-e128-4760-8b61-df3ca75d4a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:37.248713 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:37.261377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 430/877] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:37.266014 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4290cf-54aa-493c-bac3-6f75e4ec46d6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.324289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:37.379151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4290cf-54aa-493c-bac3-6f75e4ec46d6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:37.416072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b0bd1-1c11-484a-9479-3ee89df69f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:37.417056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b0bd1-1c11-484a-9479-3ee89df69f08 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.417535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b0bd1-1c11-484a-9479-3ee89df69f08 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.418036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b0bd1-1c11-484a-9479-3ee89df69f08 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.429025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b0bd1-1c11-484a-9479-3ee89df69f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-034b0bd1-1c11-484a-9479-3ee89df69f08 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:37.434716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:37.435687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:16:37.436532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:37.439204 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 448/878] 10.222.0.74 () {56 vars in 1120 bytes} [Wed Aug 31 00:16:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:37.445630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24241129-e128-4760-8b61-df3ca75d4a2a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.476871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d7d22-577a-4a2b-af43-f17996108aaa None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.477194 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d7d22-577a-4a2b-af43-f17996108aaa None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.477429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d7d22-577a-4a2b-af43-f17996108aaa None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.479145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 449/879] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:37.484324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bff7e-ff43-47b7-9d01-f7a2c3de2c59 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.484619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bff7e-ff43-47b7-9d01-f7a2c3de2c59 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.484882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bff7e-ff43-47b7-9d01-f7a2c3de2c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.505542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-506bff7e-ff43-47b7-9d01-f7a2c3de2c59 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:37.506798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-506bff7e-ff43-47b7-9d01-f7a2c3de2c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:37.567855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24241129-e128-4760-8b61-df3ca75d4a2a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:37.595084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 450/880] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:37.595920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bff7e-ff43-47b7-9d01-f7a2c3de2c59 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.623841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ce859-54df-475f-a3b9-65d238e2e44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:37.625111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce859-54df-475f-a3b9-65d238e2e44f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.625893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce859-54df-475f-a3b9-65d238e2e44f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.626805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ce859-54df-475f-a3b9-65d238e2e44f None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.627971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ce859-54df-475f-a3b9-65d238e2e44f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:37.628721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ce859-54df-475f-a3b9-65d238e2e44f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:37.631068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ce859-54df-475f-a3b9-65d238e2e44f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:37.645567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:37.650529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 431/881] 10.222.0.74 () {56 vars in 1115 bytes} [Wed Aug 31 00:16:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:37.658207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ce859-54df-475f-a3b9-65d238e2e44f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.721551 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bff7e-ff43-47b7-9d01-f7a2c3de2c59 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:37.727999 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:37.769062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4deed-bd53-4bc7-b9ea-7c3e1e8bccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:37.769062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4deed-bd53-4bc7-b9ea-7c3e1e8bccfe None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.769062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4deed-bd53-4bc7-b9ea-7c3e1e8bccfe None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.769062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4deed-bd53-4bc7-b9ea-7c3e1e8bccfe None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.769696 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4deed-bd53-4bc7-b9ea-7c3e1e8bccfe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:37.770403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4deed-bd53-4bc7-b9ea-7c3e1e8bccfe None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:37.778739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ce859-54df-475f-a3b9-65d238e2e44f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:37.814283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87746be3-ff11-433c-b038-fc0c81ec3c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:37.814920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746be3-ff11-433c-b038-fc0c81ec3c09 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:37.815197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746be3-ff11-433c-b038-fc0c81ec3c09 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:37.815562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87746be3-ff11-433c-b038-fc0c81ec3c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:37.827881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87746be3-ff11-433c-b038-fc0c81ec3c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:37.829321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87746be3-ff11-433c-b038-fc0c81ec3c09 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-87746be3-ff11-433c-b038-fc0c81ec3c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:37.844648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:37.846030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:37.847376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:37.847376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:37.847376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:37.849907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 432/882] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:37.851420 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87746be3-ff11-433c-b038-fc0c81ec3c09 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.869778 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 451/883] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:16:37 2022] POST /identity/v3/services => generated 269 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:37.875853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4deed-bd53-4bc7-b9ea-7c3e1e8bccfe None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:37.987887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87746be3-ff11-433c-b038-fc0c81ec3c09 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:37.998838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:38.003634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:38.014116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4deed-bd53-4bc7-b9ea-7c3e1e8bccfe None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:38.027895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c5a14-6f99-422e-af5a-219210319446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:38.028511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c5a14-6f99-422e-af5a-219210319446 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.029443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c5a14-6f99-422e-af5a-219210319446 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.029443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c5a14-6f99-422e-af5a-219210319446 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.029759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c5a14-6f99-422e-af5a-219210319446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:38.030012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c5a14-6f99-422e-af5a-219210319446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:38.031369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c5a14-6f99-422e-af5a-219210319446 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:38.047163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 433/884] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:38.048263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438be52e-7178-44f1-b7a8-03a22ad2e0c7 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.050846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438be52e-7178-44f1-b7a8-03a22ad2e0c7 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.050846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438be52e-7178-44f1-b7a8-03a22ad2e0c7 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.050846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 434/885] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:38.052847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438be52e-7178-44f1-b7a8-03a22ad2e0c7 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:38.060337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58bb2d-055a-400d-b5bc-70f9743a9538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:38.060985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58bb2d-055a-400d-b5bc-70f9743a9538 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.061267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58bb2d-055a-400d-b5bc-70f9743a9538 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.061539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58bb2d-055a-400d-b5bc-70f9743a9538 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.062215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58bb2d-055a-400d-b5bc-70f9743a9538 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:38.063600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58bb2d-055a-400d-b5bc-70f9743a9538 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-5f58bb2d-055a-400d-b5bc-70f9743a9538 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:38.074446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:38.075563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:38.076449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 452/886] 10.222.0.74 () {56 vars in 1126 bytes} [Wed Aug 31 00:16:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:38.077375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05878e9-981a-491a-9570-633f42bb60a9 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.077375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05878e9-981a-491a-9570-633f42bb60a9 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.077375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05878e9-981a-491a-9570-633f42bb60a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.103652 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-f05878e9-981a-491a-9570-633f42bb60a9 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:38.106391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f05878e9-981a-491a-9570-633f42bb60a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:38.171030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438be52e-7178-44f1-b7a8-03a22ad2e0c7 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:38.180680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 453/887] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:38.182918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05878e9-981a-491a-9570-633f42bb60a9 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:38.215740 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869aa50-0c4a-48f8-bb7f-1ada39bf2d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:38.216762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869aa50-0c4a-48f8-bb7f-1ada39bf2d88 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.217140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869aa50-0c4a-48f8-bb7f-1ada39bf2d88 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.217491 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869aa50-0c4a-48f8-bb7f-1ada39bf2d88 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.226920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869aa50-0c4a-48f8-bb7f-1ada39bf2d88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:38.230073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869aa50-0c4a-48f8-bb7f-1ada39bf2d88 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-8869aa50-0c4a-48f8-bb7f-1ada39bf2d88 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:38.246243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:38.247688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:38.248652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:38.248652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:38.248652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:38.248652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:38.248652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:38.248652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:38.248652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:38.248652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:38.248652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:38.248652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:38.253757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 435/888] 10.222.0.74 () {56 vars in 1117 bytes} [Wed Aug 31 00:16:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:38.258676 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869aa50-0c4a-48f8-bb7f-1ada39bf2d88 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:38.296873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:38.330732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:38.344047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05878e9-981a-491a-9570-633f42bb60a9 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:38.390912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03d673-32ed-4651-b29f-6d214bc28f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:38.391535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d673-32ed-4651-b29f-6d214bc28f16 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.391818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d673-32ed-4651-b29f-6d214bc28f16 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.392095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03d673-32ed-4651-b29f-6d214bc28f16 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.393013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03d673-32ed-4651-b29f-6d214bc28f16 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:38.393324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03d673-32ed-4651-b29f-6d214bc28f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:38.394747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03d673-32ed-4651-b29f-6d214bc28f16 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:38.395290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869aa50-0c4a-48f8-bb7f-1ada39bf2d88 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:38.401612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 454/889] 10.222.0.74 () {56 vars in 1122 bytes} [Wed Aug 31 00:16:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:38.409455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03d673-32ed-4651-b29f-6d214bc28f16 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:38.447403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa27e1-bb81-496c-9822-af3a94da2c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:38.448098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa27e1-bb81-496c-9822-af3a94da2c26 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.448410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa27e1-bb81-496c-9822-af3a94da2c26 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.448688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa27e1-bb81-496c-9822-af3a94da2c26 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.449569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa27e1-bb81-496c-9822-af3a94da2c26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:38.449924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa27e1-bb81-496c-9822-af3a94da2c26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:38.452203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa27e1-bb81-496c-9822-af3a94da2c26 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:38.474202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 436/890] 10.222.0.74 () {56 vars in 1149 bytes} [Wed Aug 31 00:16:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:38.478558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa27e1-bb81-496c-9822-af3a94da2c26 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:38.526119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03d673-32ed-4651-b29f-6d214bc28f16 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:38.562788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dcd67-d13e-4d60-a7bd-358f9d17c025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:38.563388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dcd67-d13e-4d60-a7bd-358f9d17c025 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.563867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dcd67-d13e-4d60-a7bd-358f9d17c025 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.563985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dcd67-d13e-4d60-a7bd-358f9d17c025 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.564551 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dcd67-d13e-4d60-a7bd-358f9d17c025 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:38.564850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dcd67-d13e-4d60-a7bd-358f9d17c025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:38.566364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dcd67-d13e-4d60-a7bd-358f9d17c025 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:38.570904 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 455/891] 10.222.0.74 () {56 vars in 1122 bytes} [Wed Aug 31 00:16:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:38.574522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:38.580524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dcd67-d13e-4d60-a7bd-358f9d17c025 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:38.593314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa27e1-bb81-496c-9822-af3a94da2c26 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:38.607991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:38.646859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da4278-b9c1-4343-81bc-6b5bc502b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:38.658335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da4278-b9c1-4343-81bc-6b5bc502b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.658797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da4278-b9c1-4343-81bc-6b5bc502b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.659162 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da4278-b9c1-4343-81bc-6b5bc502b0c5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.660012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da4278-b9c1-4343-81bc-6b5bc502b0c5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:38.661516 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da4278-b9c1-4343-81bc-6b5bc502b0c5 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-13da4278-b9c1-4343-81bc-6b5bc502b0c5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:38.674435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:38.682734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:38.683843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 437/892] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:16:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:38.687563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da4278-b9c1-4343-81bc-6b5bc502b0c5 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:38.735760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dcd67-d13e-4d60-a7bd-358f9d17c025 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:38.783802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87157c0c-8837-4ca1-9579-85d4cf7d5520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:38.784833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157c0c-8837-4ca1-9579-85d4cf7d5520 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.785322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157c0c-8837-4ca1-9579-85d4cf7d5520 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.785865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157c0c-8837-4ca1-9579-85d4cf7d5520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.816745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da4278-b9c1-4343-81bc-6b5bc502b0c5 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:38.853742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6048be-3162-4eca-9ceb-c89ca2dade99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:38.854477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6048be-3162-4eca-9ceb-c89ca2dade99 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:38.854875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6048be-3162-4eca-9ceb-c89ca2dade99 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:38.855292 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6048be-3162-4eca-9ceb-c89ca2dade99 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:38.855998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6048be-3162-4eca-9ceb-c89ca2dade99 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:38.856403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6048be-3162-4eca-9ceb-c89ca2dade99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:38.857898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6048be-3162-4eca-9ceb-c89ca2dade99 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:38.867843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 438/893] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:16:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:38.870561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6048be-3162-4eca-9ceb-c89ca2dade99 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:38.891872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:38.902721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87157c0c-8837-4ca1-9579-85d4cf7d5520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:38.904348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87157c0c-8837-4ca1-9579-85d4cf7d5520 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:38.924240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:39.019328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 456/894] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:38 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:16:39.020612 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6048be-3162-4eca-9ceb-c89ca2dade99 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:39.024865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87157c0c-8837-4ca1-9579-85d4cf7d5520 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:39.062590 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2d282-446d-44da-940d-6886b1f9b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:39.063227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2d282-446d-44da-940d-6886b1f9b5eb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.063584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2d282-446d-44da-940d-6886b1f9b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.063933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2d282-446d-44da-940d-6886b1f9b5eb None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.064632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2d282-446d-44da-940d-6886b1f9b5eb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:39.065008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2d282-446d-44da-940d-6886b1f9b5eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:39.066479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2d282-446d-44da-940d-6886b1f9b5eb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:39.076760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 439/895] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:16:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:39.078952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2d282-446d-44da-940d-6886b1f9b5eb None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:39.151369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87157c0c-8837-4ca1-9579-85d4cf7d5520 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:39.170617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:39.188805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e50615-bec6-4017-a568-2b72bac1cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:39.189596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e50615-bec6-4017-a568-2b72bac1cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.189986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e50615-bec6-4017-a568-2b72bac1cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.190394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e50615-bec6-4017-a568-2b72bac1cfe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.191681 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:39.202048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e50615-bec6-4017-a568-2b72bac1cfe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:39.203640 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e50615-bec6-4017-a568-2b72bac1cfe9 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:39.218743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2d282-446d-44da-940d-6886b1f9b5eb None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-36e50615-bec6-4017-a568-2b72bac1cfe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:39.219370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:39.220522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:39.221741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:39.221741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:39.221741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:39.228521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 457/896] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:39.229720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e50615-bec6-4017-a568-2b72bac1cfe9 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:39.262102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcdfff-9c40-4060-a533-345c64f790da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:39.262885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcdfff-9c40-4060-a533-345c64f790da None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.263259 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcdfff-9c40-4060-a533-345c64f790da None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.263640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcdfff-9c40-4060-a533-345c64f790da None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.264448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcdfff-9c40-4060-a533-345c64f790da None admin] RBAC: Adding query filter params (interface=public, service_id=5f5bfe9f02c6401dab091b93ee039e91, region_id=RegionOne) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:39.264908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcdfff-9c40-4060-a533-345c64f790da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:39.266451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fcdfff-9c40-4060-a533-345c64f790da None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:39.273058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 440/897] 10.222.0.74 () {56 vars in 1251 bytes} [Wed Aug 31 00:16:39 2022] GET /identity/v3/endpoints?service_id=5f5bfe9f02c6401dab091b93ee039e91&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:39.279592 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcdfff-9c40-4060-a533-345c64f790da None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:39.353175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e50615-bec6-4017-a568-2b72bac1cfe9 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:39.397943 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f439285-7760-40ef-ad98-87b3ddeb0d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:39.398809 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f439285-7760-40ef-ad98-87b3ddeb0d09 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.399273 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f439285-7760-40ef-ad98-87b3ddeb0d09 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.401017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f439285-7760-40ef-ad98-87b3ddeb0d09 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.402765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f439285-7760-40ef-ad98-87b3ddeb0d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:39.403697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f439285-7760-40ef-ad98-87b3ddeb0d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:39.406263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f439285-7760-40ef-ad98-87b3ddeb0d09 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:39.414571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcdfff-9c40-4060-a533-345c64f790da None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:39.425932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 458/898] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:39.430665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f439285-7760-40ef-ad98-87b3ddeb0d09 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:39.464506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:39.467383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5bdf6-6669-4c03-a838-4061b3884b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:39.468231 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5bdf6-6669-4c03-a838-4061b3884b98 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.468704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5bdf6-6669-4c03-a838-4061b3884b98 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.469305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5bdf6-6669-4c03-a838-4061b3884b98 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.471024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5bdf6-6669-4c03-a838-4061b3884b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:39.472665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5bdf6-6669-4c03-a838-4061b3884b98 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:39.482018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 441/899] 10.222.0.74 () {56 vars in 1087 bytes} [Wed Aug 31 00:16:39 2022] GET /identity/v3/services => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:39.555851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f439285-7760-40ef-ad98-87b3ddeb0d09 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:39.599341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d8ded-7e43-48f0-8b8f-6f13b1dd3c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:39.599986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d8ded-7e43-48f0-8b8f-6f13b1dd3c39 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.600263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d8ded-7e43-48f0-8b8f-6f13b1dd3c39 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.600533 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d8ded-7e43-48f0-8b8f-6f13b1dd3c39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.609381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d8ded-7e43-48f0-8b8f-6f13b1dd3c39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:39.610799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d8ded-7e43-48f0-8b8f-6f13b1dd3c39 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-f43d8ded-7e43-48f0-8b8f-6f13b1dd3c39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:39.624508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:39.625516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:39.626861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:39.626861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:39.626861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:39.626861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:39.626861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:39.626861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:39.626861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:39.626861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:39.626861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 459/900] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:39.631827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5bdf6-6669-4c03-a838-4061b3884b98 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:39.643247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:39.751608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5bdf6-6669-4c03-a838-4061b3884b98 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:39.787614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba1f69-18e5-4774-9c6e-5bf69098fc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:39.788227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba1f69-18e5-4774-9c6e-5bf69098fc36 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.788504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba1f69-18e5-4774-9c6e-5bf69098fc36 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.788777 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba1f69-18e5-4774-9c6e-5bf69098fc36 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.789467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba1f69-18e5-4774-9c6e-5bf69098fc36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:39.789801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba1f69-18e5-4774-9c6e-5bf69098fc36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:39.791257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba1f69-18e5-4774-9c6e-5bf69098fc36 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:39.804274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 442/901] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:39.810192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d8ded-7e43-48f0-8b8f-6f13b1dd3c39 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:39.901220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f2b0d-1ff7-4138-86c4-6ea601663e20 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.901546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f2b0d-1ff7-4138-86c4-6ea601663e20 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.901789 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f2b0d-1ff7-4138-86c4-6ea601663e20 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.903242 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 443/902] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:39.908917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b82f5-7314-4796-8ae0-48c86c4c8167 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.909488 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b82f5-7314-4796-8ae0-48c86c4c8167 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.910077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b82f5-7314-4796-8ae0-48c86c4c8167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.914625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:39.925434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d8ded-7e43-48f0-8b8f-6f13b1dd3c39 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:39.932108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0a8b82f5-7314-4796-8ae0-48c86c4c8167 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:39.933990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0a8b82f5-7314-4796-8ae0-48c86c4c8167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:39.964534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976678ee-19f1-4fc7-a3ec-ae177fc3934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:39.965138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976678ee-19f1-4fc7-a3ec-ae177fc3934c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:39.965418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976678ee-19f1-4fc7-a3ec-ae177fc3934c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:39.965724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976678ee-19f1-4fc7-a3ec-ae177fc3934c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:39.966442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976678ee-19f1-4fc7-a3ec-ae177fc3934c None admin] RBAC: Adding query filter params (role.id=00a939dc02584f029bd94cbe9018cc30, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=b15b4c00f7214835b42e2775c4023032) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:39.966749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976678ee-19f1-4fc7-a3ec-ae177fc3934c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:39.968172 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976678ee-19f1-4fc7-a3ec-ae177fc3934c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:39.974252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 460/903] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:39 2022] GET /identity/v3/role_assignments?user.id=b15b4c00f7214835b42e2775c4023032&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=00a939dc02584f029bd94cbe9018cc30 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:40.014506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:40.023588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 444/904] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:40.303209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976678ee-19f1-4fc7-a3ec-ae177fc3934c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:40.409309 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976678ee-19f1-4fc7-a3ec-ae177fc3934c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:40.454002 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414edff-67bf-4af0-91ea-bcc6ad7e9512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:40.454636 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414edff-67bf-4af0-91ea-bcc6ad7e9512 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:40.454972 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414edff-67bf-4af0-91ea-bcc6ad7e9512 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:40.455251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414edff-67bf-4af0-91ea-bcc6ad7e9512 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:40.455921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414edff-67bf-4af0-91ea-bcc6ad7e9512 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:40.457296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414edff-67bf-4af0-91ea-bcc6ad7e9512 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-7414edff-67bf-4af0-91ea-bcc6ad7e9512 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:40.466664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:40.467667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:40.469135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 461/905] 10.222.0.74 () {56 vars in 1132 bytes} [Wed Aug 31 00:16:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:40.474055 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b82f5-7314-4796-8ae0-48c86c4c8167 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:40.562571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd202b-c640-4be1-abe7-6fafbfb2a337 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:40.562886 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd202b-c640-4be1-abe7-6fafbfb2a337 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:40.563059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd202b-c640-4be1-abe7-6fafbfb2a337 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:40.564631 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 462/906] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:16:40.569540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362d88-d899-4347-a8c0-9866e13c70f2 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:40.569854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362d88-d899-4347-a8c0-9866e13c70f2 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:40.570139 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97362d88-d899-4347-a8c0-9866e13c70f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:40.583782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b82f5-7314-4796-8ae0-48c86c4c8167 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:40.590130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-97362d88-d899-4347-a8c0-9866e13c70f2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:40.591570 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-97362d88-d899-4347-a8c0-9866e13c70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:40.608410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:40.626733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516e40d-b7e5-4ba0-bef6-d0fbe9563770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:40.628305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516e40d-b7e5-4ba0-bef6-d0fbe9563770 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:40.632153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516e40d-b7e5-4ba0-bef6-d0fbe9563770 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:40.632153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516e40d-b7e5-4ba0-bef6-d0fbe9563770 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:40.632153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516e40d-b7e5-4ba0-bef6-d0fbe9563770 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:40.632153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516e40d-b7e5-4ba0-bef6-d0fbe9563770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:40.632153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516e40d-b7e5-4ba0-bef6-d0fbe9563770 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:40.638227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 445/907] 10.222.0.74 () {56 vars in 1126 bytes} [Wed Aug 31 00:16:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:40.643780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516e40d-b7e5-4ba0-bef6-d0fbe9563770 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:40.680649 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 463/908] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:40.718203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:40.763820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516e40d-b7e5-4ba0-bef6-d0fbe9563770 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:40.800355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0727ad-c69f-47fe-b6f7-0d0a2e27c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:40.801381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0727ad-c69f-47fe-b6f7-0d0a2e27c40a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:40.801889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0727ad-c69f-47fe-b6f7-0d0a2e27c40a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:40.802417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0727ad-c69f-47fe-b6f7-0d0a2e27c40a None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:40.803304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0727ad-c69f-47fe-b6f7-0d0a2e27c40a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:40.803811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0727ad-c69f-47fe-b6f7-0d0a2e27c40a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:40.805464 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0727ad-c69f-47fe-b6f7-0d0a2e27c40a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:40.811312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 446/909] 10.222.0.74 () {56 vars in 1126 bytes} [Wed Aug 31 00:16:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:40.819296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97362d88-d899-4347-a8c0-9866e13c70f2 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:40.945764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97362d88-d899-4347-a8c0-9866e13c70f2 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:40.981114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0727ad-c69f-47fe-b6f7-0d0a2e27c40a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:40.987411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea241-6e64-4db6-9c65-b7b90ee63304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:40.988040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea241-6e64-4db6-9c65-b7b90ee63304 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:40.988325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea241-6e64-4db6-9c65-b7b90ee63304 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:40.988604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ea241-6e64-4db6-9c65-b7b90ee63304 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:40.989326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea241-6e64-4db6-9c65-b7b90ee63304 None admin] RBAC: Adding query filter params (interface=public, service_id=b9a3af714a094e908d79744d28a5a423, region_id=RegionOne) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:40.989663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea241-6e64-4db6-9c65-b7b90ee63304 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:40.991049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ea241-6e64-4db6-9c65-b7b90ee63304 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:41.004362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 464/910] 10.222.0.74 () {56 vars in 1251 bytes} [Wed Aug 31 00:16:40 2022] GET /identity/v3/endpoints?service_id=b9a3af714a094e908d79744d28a5a423&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:41.005550 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea241-6e64-4db6-9c65-b7b90ee63304 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:41.022752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:41.115948 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ea241-6e64-4db6-9c65-b7b90ee63304 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:41.120659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0727ad-c69f-47fe-b6f7-0d0a2e27c40a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:41.151029 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:41.153874 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1bffb-f8f7-43b6-a452-c1bc9c0c2fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:41.154760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1bffb-f8f7-43b6-a452-c1bc9c0c2fc4 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:41.155234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1bffb-f8f7-43b6-a452-c1bc9c0c2fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:41.155762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1bffb-f8f7-43b6-a452-c1bc9c0c2fc4 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:41.156555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1bffb-f8f7-43b6-a452-c1bc9c0c2fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:41.158232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1bffb-f8f7-43b6-a452-c1bc9c0c2fc4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:41.163567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54b077-29d3-414f-9228-cf1cfe05ec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:41.164182 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54b077-29d3-414f-9228-cf1cfe05ec4a None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:41.164468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54b077-29d3-414f-9228-cf1cfe05ec4a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:41.164753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54b077-29d3-414f-9228-cf1cfe05ec4a None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:41.166040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54b077-29d3-414f-9228-cf1cfe05ec4a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:41.170462 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54b077-29d3-414f-9228-cf1cfe05ec4a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:41.171055 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 465/911] 10.222.0.74 () {56 vars in 1087 bytes} [Wed Aug 31 00:16:41 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:41.251739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 447/912] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:16:40 2022] POST /identity/v3/services => generated 241 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:41.599685 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30c714-2baa-4482-a0f0-2cdbad079d30 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:41.600035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30c714-2baa-4482-a0f0-2cdbad079d30 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:41.600241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30c714-2baa-4482-a0f0-2cdbad079d30 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:41.601877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 466/913] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:41.608298 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d090-c31c-49f7-a5d6-d0ccdbf218ef None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:41.608586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d090-c31c-49f7-a5d6-d0ccdbf218ef None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:41.608865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d090-c31c-49f7-a5d6-d0ccdbf218ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:41.628685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-1b82d090-c31c-49f7-a5d6-d0ccdbf218ef None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:41.629915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1b82d090-c31c-49f7-a5d6-d0ccdbf218ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:41.718922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 448/914] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:41.906139 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b9c34-3bf8-457b-b33b-a7d10d46d63a None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:41.906570 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b9c34-3bf8-457b-b33b-a7d10d46d63a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:41.906865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b9c34-3bf8-457b-b33b-a7d10d46d63a None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:41.908457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 467/915] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:16:41.913693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa0eb-a6f6-46ce-a62c-2ad886bdda5c None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:41.913983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa0eb-a6f6-46ce-a62c-2ad886bdda5c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:41.914263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa0eb-a6f6-46ce-a62c-2ad886bdda5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:41.933683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0d0aa0eb-a6f6-46ce-a62c-2ad886bdda5c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:41.934875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0d0aa0eb-a6f6-46ce-a62c-2ad886bdda5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:42.009918 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 449/916] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:42.023884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b9c34-3bf8-457b-b33b-a7d10d46d63a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.118024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:42.151712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b9c34-3bf8-457b-b33b-a7d10d46d63a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.209771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95011c6b-c967-4a44-be46-7aa32099ab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.210422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95011c6b-c967-4a44-be46-7aa32099ab2d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.211070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95011c6b-c967-4a44-be46-7aa32099ab2d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.211351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95011c6b-c967-4a44-be46-7aa32099ab2d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.212230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95011c6b-c967-4a44-be46-7aa32099ab2d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.214342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95011c6b-c967-4a44-be46-7aa32099ab2d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-95011c6b-c967-4a44-be46-7aa32099ab2d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:42.231163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:42.232835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:42.234542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 468/917] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:16:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:42.245699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aa0eb-a6f6-46ce-a62c-2ad886bdda5c None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.291227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:42.338098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95011c6b-c967-4a44-be46-7aa32099ab2d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.359592 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aa0eb-a6f6-46ce-a62c-2ad886bdda5c None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.400033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701e867-438d-4f9d-91f9-50d4206a8d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.401044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701e867-438d-4f9d-91f9-50d4206a8d35 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.401469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701e867-438d-4f9d-91f9-50d4206a8d35 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.401960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701e867-438d-4f9d-91f9-50d4206a8d35 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.402799 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701e867-438d-4f9d-91f9-50d4206a8d35 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:42.403257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701e867-438d-4f9d-91f9-50d4206a8d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.404634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701e867-438d-4f9d-91f9-50d4206a8d35 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.410202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 450/918] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:16:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:42.416053 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701e867-438d-4f9d-91f9-50d4206a8d35 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.475885 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95011c6b-c967-4a44-be46-7aa32099ab2d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.527071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798804e5-2457-4a40-933e-bf1e5c5e86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.528350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798804e5-2457-4a40-933e-bf1e5c5e86aa None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.529221 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798804e5-2457-4a40-933e-bf1e5c5e86aa None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.529985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798804e5-2457-4a40-933e-bf1e5c5e86aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.531642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701e867-438d-4f9d-91f9-50d4206a8d35 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.534736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:42.541795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:42.546522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798804e5-2457-4a40-933e-bf1e5c5e86aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-798804e5-2457-4a40-933e-bf1e5c5e86aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:42.552811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:42.553774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:16:42.554745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:42.555413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 469/919] 10.222.0.74 () {56 vars in 1120 bytes} [Wed Aug 31 00:16:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:42.561394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798804e5-2457-4a40-933e-bf1e5c5e86aa None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.577353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45e8e6-04b3-4ae8-85de-5dc29a00ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.577994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45e8e6-04b3-4ae8-85de-5dc29a00ed51 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.578267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45e8e6-04b3-4ae8-85de-5dc29a00ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.578532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45e8e6-04b3-4ae8-85de-5dc29a00ed51 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.579157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45e8e6-04b3-4ae8-85de-5dc29a00ed51 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:42.580714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45e8e6-04b3-4ae8-85de-5dc29a00ed51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.582125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45e8e6-04b3-4ae8-85de-5dc29a00ed51 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.591872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 451/920] 10.222.0.74 () {56 vars in 1114 bytes} [Wed Aug 31 00:16:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:42.592985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45e8e6-04b3-4ae8-85de-5dc29a00ed51 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.707222 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45e8e6-04b3-4ae8-85de-5dc29a00ed51 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.708411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798804e5-2457-4a40-933e-bf1e5c5e86aa None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.744978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c326a9d-3e10-40f7-8133-8642d73aecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.746000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c326a9d-3e10-40f7-8133-8642d73aecd4 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.746466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c326a9d-3e10-40f7-8133-8642d73aecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.746801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c326a9d-3e10-40f7-8133-8642d73aecd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.747540 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c326a9d-3e10-40f7-8133-8642d73aecd4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.748960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c326a9d-3e10-40f7-8133-8642d73aecd4 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.750281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d0804-5a32-4ece-aa01-2907d3af6e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.751079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0804-5a32-4ece-aa01-2907d3af6e6d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.751548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0804-5a32-4ece-aa01-2907d3af6e6d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.751993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d0804-5a32-4ece-aa01-2907d3af6e6d None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.752965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d0804-5a32-4ece-aa01-2907d3af6e6d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:42.753467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d0804-5a32-4ece-aa01-2907d3af6e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.755044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d0804-5a32-4ece-aa01-2907d3af6e6d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.764995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 470/921] 10.222.0.74 () {56 vars in 1115 bytes} [Wed Aug 31 00:16:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:42.770244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d0804-5a32-4ece-aa01-2907d3af6e6d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:42.835644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:42.848732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 452/922] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:42.889386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d0804-5a32-4ece-aa01-2907d3af6e6d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:42.943598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afeb47-5cef-419c-a446-6f052d05522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:42.944238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afeb47-5cef-419c-a446-6f052d05522b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:42.944516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afeb47-5cef-419c-a446-6f052d05522b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:42.944786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afeb47-5cef-419c-a446-6f052d05522b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:42.958215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afeb47-5cef-419c-a446-6f052d05522b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:42.959598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afeb47-5cef-419c-a446-6f052d05522b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-d7afeb47-5cef-419c-a446-6f052d05522b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:42.975996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:42.977029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:42.978381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:42.978381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:42.978381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:42.978381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 471/923] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:42.984908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c326a9d-3e10-40f7-8133-8642d73aecd4 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.016626 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:43.095031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c326a9d-3e10-40f7-8133-8642d73aecd4 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.131648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473ab3e-d6c6-451b-874d-ddf13fda132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.132260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ab3e-d6c6-451b-874d-ddf13fda132a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.132541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ab3e-d6c6-451b-874d-ddf13fda132a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.132816 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473ab3e-d6c6-451b-874d-ddf13fda132a None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.133458 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473ab3e-d6c6-451b-874d-ddf13fda132a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:43.134400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473ab3e-d6c6-451b-874d-ddf13fda132a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.135965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473ab3e-d6c6-451b-874d-ddf13fda132a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.148028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 453/924] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:43.154682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afeb47-5cef-419c-a446-6f052d05522b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.254680 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bd241-4509-4508-b403-6c4b0613a025 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.255198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bd241-4509-4508-b403-6c4b0613a025 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.255311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bd241-4509-4508-b403-6c4b0613a025 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.256710 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 454/925] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:43.262181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba321c-ad65-4e1d-b4b6-b1c3ab6c43ba None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.262467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba321c-ad65-4e1d-b4b6-b1c3ab6c43ba None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.262745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba321c-ad65-4e1d-b4b6-b1c3ab6c43ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.274075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afeb47-5cef-419c-a446-6f052d05522b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.283819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-b3ba321c-ad65-4e1d-b4b6-b1c3ab6c43ba None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:43.285381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b3ba321c-ad65-4e1d-b4b6-b1c3ab6c43ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:43.286530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:43.318645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a465f5-ab6e-455e-80b6-f54d0f794dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.319311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a465f5-ab6e-455e-80b6-f54d0f794dcc None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.319599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a465f5-ab6e-455e-80b6-f54d0f794dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.319882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a465f5-ab6e-455e-80b6-f54d0f794dcc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.328512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a465f5-ab6e-455e-80b6-f54d0f794dcc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.329999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a465f5-ab6e-455e-80b6-f54d0f794dcc None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-20a465f5-ab6e-455e-80b6-f54d0f794dcc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:43.341774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:43.342979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:43.344173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:43.344173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:43.344173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:43.344173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:43.344173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:43.344173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:43.344173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:43.344173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:43.344173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:43.344173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:43.344173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 472/926] 10.222.0.74 () {56 vars in 1117 bytes} [Wed Aug 31 00:16:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:43.345227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03f3b0-2bc3-4959-aa04-cb4745eca3f6 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.345515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03f3b0-2bc3-4959-aa04-cb4745eca3f6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.345830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03f3b0-2bc3-4959-aa04-cb4745eca3f6 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.347061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 473/927] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:43.348548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03f3b0-2bc3-4959-aa04-cb4745eca3f6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.373471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 455/928] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:43.375725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51996c4e-f136-4e02-b6aa-ef23e1ff3702 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.376167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51996c4e-f136-4e02-b6aa-ef23e1ff3702 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.376586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51996c4e-f136-4e02-b6aa-ef23e1ff3702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.400853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-51996c4e-f136-4e02-b6aa-ef23e1ff3702 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:43.402961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-51996c4e-f136-4e02-b6aa-ef23e1ff3702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:43.416503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:43.466408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03f3b0-2bc3-4959-aa04-cb4745eca3f6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.500784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 456/929] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:43.512302 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98089ff2-1b9e-4f50-a2bb-a47900dd030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.512951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98089ff2-1b9e-4f50-a2bb-a47900dd030f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.513392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98089ff2-1b9e-4f50-a2bb-a47900dd030f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.513770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98089ff2-1b9e-4f50-a2bb-a47900dd030f None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.514631 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98089ff2-1b9e-4f50-a2bb-a47900dd030f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:43.515008 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98089ff2-1b9e-4f50-a2bb-a47900dd030f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.516622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98089ff2-1b9e-4f50-a2bb-a47900dd030f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.536340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 474/930] 10.222.0.74 () {56 vars in 1149 bytes} [Wed Aug 31 00:16:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:43.542468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51996c4e-f136-4e02-b6aa-ef23e1ff3702 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.649075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51996c4e-f136-4e02-b6aa-ef23e1ff3702 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.682441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98089ff2-1b9e-4f50-a2bb-a47900dd030f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.686309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1bd22-18df-4dc0-b728-7b7188be20b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.686962 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1bd22-18df-4dc0-b728-7b7188be20b2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.687246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1bd22-18df-4dc0-b728-7b7188be20b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.687569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1bd22-18df-4dc0-b728-7b7188be20b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.699203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1bd22-18df-4dc0-b728-7b7188be20b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.700774 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1bd22-18df-4dc0-b728-7b7188be20b2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.703715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:43.713882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-16e1bd22-18df-4dc0-b728-7b7188be20b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:43.721145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:43.722227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:43.723190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:43.723190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:43.723190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:43.723190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 457/931] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:43.728594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1bd22-18df-4dc0-b728-7b7188be20b2 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.813784 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98089ff2-1b9e-4f50-a2bb-a47900dd030f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.852364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b9eed-a009-4c7e-9d65-f79f82426c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.853218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b9eed-a009-4c7e-9d65-f79f82426c25 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.853694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b9eed-a009-4c7e-9d65-f79f82426c25 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.853976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b9eed-a009-4c7e-9d65-f79f82426c25 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.854565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b9eed-a009-4c7e-9d65-f79f82426c25 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.854986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1bd22-18df-4dc0-b728-7b7188be20b2 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:43.855967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b9eed-a009-4c7e-9d65-f79f82426c25 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-1e6b9eed-a009-4c7e-9d65-f79f82426c25 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:43.865410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:43.866553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:43.867557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 475/932] 10.222.0.74 () {56 vars in 1132 bytes} [Wed Aug 31 00:16:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:43.869097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b9eed-a009-4c7e-9d65-f79f82426c25 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.906275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4314a-3f1c-4574-beb2-9c6494bf8be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:43.906882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4314a-3f1c-4574-beb2-9c6494bf8be6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:43.907162 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4314a-3f1c-4574-beb2-9c6494bf8be6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:43.907431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4314a-3f1c-4574-beb2-9c6494bf8be6 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:43.908067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4314a-3f1c-4574-beb2-9c6494bf8be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:43.908367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4314a-3f1c-4574-beb2-9c6494bf8be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:43.909876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4314a-3f1c-4574-beb2-9c6494bf8be6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:43.922655 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 458/933] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:43.927275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4314a-3f1c-4574-beb2-9c6494bf8be6 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:43.976205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:43.985001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:43.986109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b9eed-a009-4c7e-9d65-f79f82426c25 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.020821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3f12-fc0e-4d29-b485-23523bb675c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.021449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3f12-fc0e-4d29-b485-23523bb675c7 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.021762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3f12-fc0e-4d29-b485-23523bb675c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.022056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3f12-fc0e-4d29-b485-23523bb675c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.022615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3f12-fc0e-4d29-b485-23523bb675c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.023981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3f12-fc0e-4d29-b485-23523bb675c7 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.030597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4314a-3f1c-4574-beb2-9c6494bf8be6 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-e4ef3f12-fc0e-4d29-b485-23523bb675c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:44.034475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:44.035604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:44.036486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:44.041119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 476/934] 10.222.0.74 () {56 vars in 1126 bytes} [Wed Aug 31 00:16:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:44.042012 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3f12-fc0e-4d29-b485-23523bb675c7 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.067088 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64c0e-0249-4fb5-87d0-ab20657cb5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.067622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64c0e-0249-4fb5-87d0-ab20657cb5cf None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.067911 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64c0e-0249-4fb5-87d0-ab20657cb5cf None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.068202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64c0e-0249-4fb5-87d0-ab20657cb5cf None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.068817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64c0e-0249-4fb5-87d0-ab20657cb5cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:44.069127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64c0e-0249-4fb5-87d0-ab20657cb5cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.070539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64c0e-0249-4fb5-87d0-ab20657cb5cf None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.083246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 459/935] 10.222.0.74 () {56 vars in 1126 bytes} [Wed Aug 31 00:16:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:44.084180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64c0e-0249-4fb5-87d0-ab20657cb5cf None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.157569 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3f12-fc0e-4d29-b485-23523bb675c7 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.195504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88478769-0211-4510-88fc-438e8ab9f8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.196962 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478769-0211-4510-88fc-438e8ab9f8a2 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.197393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478769-0211-4510-88fc-438e8ab9f8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.197846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88478769-0211-4510-88fc-438e8ab9f8a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.198678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64c0e-0249-4fb5-87d0-ab20657cb5cf None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.204886 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88478769-0211-4510-88fc-438e8ab9f8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.206649 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88478769-0211-4510-88fc-438e8ab9f8a2 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.217898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-88478769-0211-4510-88fc-438e8ab9f8a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:44.219729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:44.220798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:44.221927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:44.221927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:44.221927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:44.221927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:44.221927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:44.221927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:44.221927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:44.221927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:44.223535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 477/936] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:44.224460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88478769-0211-4510-88fc-438e8ab9f8a2 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.238422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d3f9d-38e1-4804-b847-c4d96ab091b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.239029 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d3f9d-38e1-4804-b847-c4d96ab091b4 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.239367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d3f9d-38e1-4804-b847-c4d96ab091b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.239649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d3f9d-38e1-4804-b847-c4d96ab091b4 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.240277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d3f9d-38e1-4804-b847-c4d96ab091b4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:44.240577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d3f9d-38e1-4804-b847-c4d96ab091b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.241960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d3f9d-38e1-4804-b847-c4d96ab091b4 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.246321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:44.251854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 460/937] 10.222.0.74 () {56 vars in 1122 bytes} [Wed Aug 31 00:16:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:44.251854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d3f9d-38e1-4804-b847-c4d96ab091b4 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.335774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88478769-0211-4510-88fc-438e8ab9f8a2 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.372584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c88e3f-a42e-4b64-8117-cd64769b6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.373201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c88e3f-a42e-4b64-8117-cd64769b6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.373372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d3f9d-38e1-4804-b847-c4d96ab091b4 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.373828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c88e3f-a42e-4b64-8117-cd64769b6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.373828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c88e3f-a42e-4b64-8117-cd64769b6aa0 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.374399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c88e3f-a42e-4b64-8117-cd64769b6aa0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:44.374706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c88e3f-a42e-4b64-8117-cd64769b6aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.376511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c88e3f-a42e-4b64-8117-cd64769b6aa0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.381236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 478/938] 10.222.0.74 () {56 vars in 1126 bytes} [Wed Aug 31 00:16:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:44.381915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c88e3f-a42e-4b64-8117-cd64769b6aa0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.416487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaf406-2219-4577-95c2-5882df87326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.417091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaf406-2219-4577-95c2-5882df87326b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.417378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaf406-2219-4577-95c2-5882df87326b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.417685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaf406-2219-4577-95c2-5882df87326b None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.418386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaf406-2219-4577-95c2-5882df87326b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:44.418695 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaf406-2219-4577-95c2-5882df87326b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.420388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaf406-2219-4577-95c2-5882df87326b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.433316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 461/939] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:44.434170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaf406-2219-4577-95c2-5882df87326b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.480020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:44.487306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:44.500747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c88e3f-a42e-4b64-8117-cd64769b6aa0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.539288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964f57c-24f1-48b8-96c0-be4802ec3efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.540032 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964f57c-24f1-48b8-96c0-be4802ec3efa None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.540456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964f57c-24f1-48b8-96c0-be4802ec3efa None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.540742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964f57c-24f1-48b8-96c0-be4802ec3efa None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.541377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964f57c-24f1-48b8-96c0-be4802ec3efa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:44.541714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964f57c-24f1-48b8-96c0-be4802ec3efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.543088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964f57c-24f1-48b8-96c0-be4802ec3efa None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.547570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaf406-2219-4577-95c2-5882df87326b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.553024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 479/940] 10.222.0.74 () {56 vars in 1122 bytes} [Wed Aug 31 00:16:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:44.553024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964f57c-24f1-48b8-96c0-be4802ec3efa None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.591562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5e638-3b93-474b-a9d5-a0d383c51ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.592095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e638-3b93-474b-a9d5-a0d383c51ee4 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.592382 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e638-3b93-474b-a9d5-a0d383c51ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.592654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e638-3b93-474b-a9d5-a0d383c51ee4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.593330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5e638-3b93-474b-a9d5-a0d383c51ee4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.594755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5e638-3b93-474b-a9d5-a0d383c51ee4 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.655058 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964f57c-24f1-48b8-96c0-be4802ec3efa None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.689924 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114f76c-293a-4020-be1b-7667f7e8f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.690621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114f76c-293a-4020-be1b-7667f7e8f12b None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.690860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114f76c-293a-4020-be1b-7667f7e8f12b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.691137 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114f76c-293a-4020-be1b-7667f7e8f12b None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/b15b4c00f7214835b42e2775c4023032/roles/00a939dc02584f029bd94cbe9018cc30` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.693317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114f76c-293a-4020-be1b-7667f7e8f12b None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=b15b4c00f7214835b42e2775c4023032, role_id=00a939dc02584f029bd94cbe9018cc30)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.694924 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114f76c-293a-4020-be1b-7667f7e8f12b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.721603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 462/941] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:44.721603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5e638-3b93-474b-a9d5-a0d383c51ee4 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.770340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 480/942] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:16:44 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/b15b4c00f7214835b42e2775c4023032/roles/00a939dc02584f029bd94cbe9018cc30 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:16:44.840714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:44.851517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5e638-3b93-474b-a9d5-a0d383c51ee4 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:44.895852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decf50b-7e01-4a4a-8b48-956e44aa61e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:44.896481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decf50b-7e01-4a4a-8b48-956e44aa61e4 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.896763 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decf50b-7e01-4a4a-8b48-956e44aa61e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.897042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decf50b-7e01-4a4a-8b48-956e44aa61e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.898281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decf50b-7e01-4a4a-8b48-956e44aa61e4 None admin] RBAC: Adding query filter params (interface=public, service_id=a74be1ee94ae4f9b8ca46d1918a7c94b, region_id=RegionOne) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:44.898281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decf50b-7e01-4a4a-8b48-956e44aa61e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:44.900873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decf50b-7e01-4a4a-8b48-956e44aa61e4 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:44.906985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 463/943] 10.222.0.74 () {56 vars in 1251 bytes} [Wed Aug 31 00:16:44 2022] GET /identity/v3/endpoints?service_id=a74be1ee94ae4f9b8ca46d1918a7c94b&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:44.912738 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114f76c-293a-4020-be1b-7667f7e8f12b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:44.919306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:44.965569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2398b-d0b0-4a57-9c24-45039e586fc1 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.965785 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2398b-d0b0-4a57-9c24-45039e586fc1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.965968 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2398b-d0b0-4a57-9c24-45039e586fc1 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.967434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 464/944] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:16:44.973728 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e504c-6016-4eca-ac56-42b9acee1fa9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:44.974020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e504c-6016-4eca-ac56-42b9acee1fa9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:44.974301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e504c-6016-4eca-ac56-42b9acee1fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:44.994060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-562e504c-6016-4eca-ac56-42b9acee1fa9 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:44.995365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-562e504c-6016-4eca-ac56-42b9acee1fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:45.042781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114f76c-293a-4020-be1b-7667f7e8f12b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.080397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3936316-5835-43d3-bb63-2f40cbe24b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.081012 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3936316-5835-43d3-bb63-2f40cbe24b32 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.081291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3936316-5835-43d3-bb63-2f40cbe24b32 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.081566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3936316-5835-43d3-bb63-2f40cbe24b32 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.082208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3936316-5835-43d3-bb63-2f40cbe24b32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.083682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3936316-5835-43d3-bb63-2f40cbe24b32 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.086677 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 465/945] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:45.093037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 481/946] 10.222.0.74 () {56 vars in 1087 bytes} [Wed Aug 31 00:16:44 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:16:45.367426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e504c-6016-4eca-ac56-42b9acee1fa9 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:45.467993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:45.478695 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e504c-6016-4eca-ac56-42b9acee1fa9 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.515601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3927f-1cde-49c4-93ab-d2a3167e702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.516213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3927f-1cde-49c4-93ab-d2a3167e702e None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.516489 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3927f-1cde-49c4-93ab-d2a3167e702e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.516761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b3927f-1cde-49c4-93ab-d2a3167e702e None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.517404 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3927f-1cde-49c4-93ab-d2a3167e702e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.518922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b3927f-1cde-49c4-93ab-d2a3167e702e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.521586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: WARNING keystone.server.flask.common [None req-58b3927f-1cde-49c4-93ab-d2a3167e702e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 00:16:45.577277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.sql.core [None req-58b3927f-1cde-49c4-93ab-d2a3167e702e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:16:45.577277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:16:45.577277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [parameters: {'id': '51c6a79bb5b24ed38e4eac345b3e64bd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:16:45.577277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88177) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-58b3927f-1cde-49c4-93ab-d2a3167e702e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 51c6a79bb5b24ed38e4eac345b3e64bd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 51c6a79bb5b24ed38e4eac345b3e64bd. Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:16:45.595267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application result.read() Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 00:16:45.597120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application yield resource Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise self.value Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application session.commit() Aug 31 00:16:45.598287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:16:45.599206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:16:45.600135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application result.read() Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:16:45.600950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [parameters: {'id': '51c6a79bb5b24ed38e4eac345b3e64bd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:45.602331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:45.603890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:45.604843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:45.604843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 00:16:45.604843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 00:16:45.604843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:45.604843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:45.604843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 00:16:45.604843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 00:16:45.604843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 51c6a79bb5b24ed38e4eac345b3e64bd. Aug 31 00:16:45.604843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:45.604843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 466/947] 10.222.0.74 () {60 vars in 1140 bytes} [Wed Aug 31 00:16:45 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:45.614111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3936316-5835-43d3-bb63-2f40cbe24b32 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:45.676549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:45.712405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3936316-5835-43d3-bb63-2f40cbe24b32 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.749429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c277e-10b2-4386-b796-ec3fcee44174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.750101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c277e-10b2-4386-b796-ec3fcee44174 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.750522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c277e-10b2-4386-b796-ec3fcee44174 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.750796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c277e-10b2-4386-b796-ec3fcee44174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.757690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c277e-10b2-4386-b796-ec3fcee44174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.759980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c277e-10b2-4386-b796-ec3fcee44174 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-1f6c277e-10b2-4386-b796-ec3fcee44174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:45.771915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:45.774033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:45.775913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:45.775913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:45.775913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:45.775913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:45.775913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:45.775913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:45.775913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:45.775913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:45.775913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 482/948] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:45.779925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3927f-1cde-49c4-93ab-d2a3167e702e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:45.895993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b3927f-1cde-49c4-93ab-d2a3167e702e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:45.935652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52faa6-d101-4b14-8e67-25b0cb2134f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:45.936201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52faa6-d101-4b14-8e67-25b0cb2134f0 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:45.936484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52faa6-d101-4b14-8e67-25b0cb2134f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:45.936757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52faa6-d101-4b14-8e67-25b0cb2134f0 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:45.937450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52faa6-d101-4b14-8e67-25b0cb2134f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:45.937794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52faa6-d101-4b14-8e67-25b0cb2134f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:45.939595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52faa6-d101-4b14-8e67-25b0cb2134f0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:45.966220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 467/949] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:46.837663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb296f-abfb-4dc9-be86-6d6a4ebe8436 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:46.838394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb296f-abfb-4dc9-be86-6d6a4ebe8436 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:46.838800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb296f-abfb-4dc9-be86-6d6a4ebe8436 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:46.840513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 483/950] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:46.846090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b37b5-efaa-48dd-ad04-0c3a8d6c00df None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:46.846559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b37b5-efaa-48dd-ad04-0c3a8d6c00df None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:46.846739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b37b5-efaa-48dd-ad04-0c3a8d6c00df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:46.860234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:46.866217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ba1b37b5-efaa-48dd-ad04-0c3a8d6c00df None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:46.868482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ba1b37b5-efaa-48dd-ad04-0c3a8d6c00df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:46.925089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66a225-7a86-4b12-87ad-36c7f3a7db21 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:46.925770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66a225-7a86-4b12-87ad-36c7f3a7db21 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:46.926259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66a225-7a86-4b12-87ad-36c7f3a7db21 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:46.929007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 484/951] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:46.935045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f41548-111e-48b2-b366-b99233f216e6 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:46.935597 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f41548-111e-48b2-b366-b99233f216e6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:46.936052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f41548-111e-48b2-b366-b99233f216e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:46.942930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 468/952] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:46.956646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-54f41548-111e-48b2-b366-b99233f216e6 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:46.958194 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-54f41548-111e-48b2-b366-b99233f216e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:47.034576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 485/953] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:47.075124 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9f2a7-b97c-4383-b78e-e247fd8b18e2 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:47.075412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9f2a7-b97c-4383-b78e-e247fd8b18e2 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:47.075688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9f2a7-b97c-4383-b78e-e247fd8b18e2 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:47.077293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 469/954] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:47.082408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504395b-a271-4237-b99d-c6416f3aa9b2 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:47.082696 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504395b-a271-4237-b99d-c6416f3aa9b2 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:47.082973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504395b-a271-4237-b99d-c6416f3aa9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:47.101910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-3504395b-a271-4237-b99d-c6416f3aa9b2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:47.103587 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-3504395b-a271-4237-b99d-c6416f3aa9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:47.160020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:47.175000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 486/955] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:47.227835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9f2a7-b97c-4383-b78e-e247fd8b18e2 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:47.330321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9f2a7-b97c-4383-b78e-e247fd8b18e2 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:47.334933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504395b-a271-4237-b99d-c6416f3aa9b2 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:47.367064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fc7d8-6e8c-4ca1-be53-140890e66339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:47.367622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fc7d8-6e8c-4ca1-be53-140890e66339 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:47.367922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fc7d8-6e8c-4ca1-be53-140890e66339 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:47.368750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fc7d8-6e8c-4ca1-be53-140890e66339 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:47.369707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fc7d8-6e8c-4ca1-be53-140890e66339 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:47.371232 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fc7d8-6e8c-4ca1-be53-140890e66339 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:47.374577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-1c7fc7d8-6e8c-4ca1-be53-140890e66339 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:47.383112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:47.388000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:47.388889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 470/956] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:47.390895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fc7d8-6e8c-4ca1-be53-140890e66339 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:47.468936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504395b-a271-4237-b99d-c6416f3aa9b2 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:47.512687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933bda1-fff3-42bd-8dea-763235410fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:47.513742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933bda1-fff3-42bd-8dea-763235410fae None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:47.513742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933bda1-fff3-42bd-8dea-763235410fae None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:47.513956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933bda1-fff3-42bd-8dea-763235410fae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:47.522903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fc7d8-6e8c-4ca1-be53-140890e66339 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:47.524661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933bda1-fff3-42bd-8dea-763235410fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-5933bda1-fff3-42bd-8dea-763235410fae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:47.529444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:47.530604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:47.531510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 487/957] 10.222.0.74 () {56 vars in 1120 bytes} [Wed Aug 31 00:16:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:47.532245 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933bda1-fff3-42bd-8dea-763235410fae None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:47.567540 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fef9c-4b91-402d-a91d-477f1b9cbfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:47.568435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fef9c-4b91-402d-a91d-477f1b9cbfc6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:47.568979 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fef9c-4b91-402d-a91d-477f1b9cbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:47.569406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fef9c-4b91-402d-a91d-477f1b9cbfc6 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:47.570264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fef9c-4b91-402d-a91d-477f1b9cbfc6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:47.570720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fef9c-4b91-402d-a91d-477f1b9cbfc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:47.573152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fef9c-4b91-402d-a91d-477f1b9cbfc6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:47.578973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 471/958] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:47.580071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fef9c-4b91-402d-a91d-477f1b9cbfc6 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:47.588766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:47.645560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933bda1-fff3-42bd-8dea-763235410fae None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:47.653773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:47.684720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d062a-6bd0-4165-985d-a5f3ead5f213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:47.685453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d062a-6bd0-4165-985d-a5f3ead5f213 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:47.685829 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d062a-6bd0-4165-985d-a5f3ead5f213 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:47.686286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d062a-6bd0-4165-985d-a5f3ead5f213 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:47.686686 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d062a-6bd0-4165-985d-a5f3ead5f213 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:47.688048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d062a-6bd0-4165-985d-a5f3ead5f213 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:47.695107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fef9c-4b91-402d-a91d-477f1b9cbfc6 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-ee9d062a-6bd0-4165-985d-a5f3ead5f213 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:47.698096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:47.699163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:47.700053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 488/959] 10.222.0.74 () {56 vars in 1126 bytes} [Wed Aug 31 00:16:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:47.700887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d062a-6bd0-4165-985d-a5f3ead5f213 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:47.737999 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ce140-3cbd-4567-a557-8d3417d0aa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:47.738615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ce140-3cbd-4567-a557-8d3417d0aa77 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:47.738904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ce140-3cbd-4567-a557-8d3417d0aa77 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:47.739181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ce140-3cbd-4567-a557-8d3417d0aa77 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:47.739852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ce140-3cbd-4567-a557-8d3417d0aa77 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:47.740170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ce140-3cbd-4567-a557-8d3417d0aa77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:47.741544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ce140-3cbd-4567-a557-8d3417d0aa77 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:47.750879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 472/960] 10.222.0.74 () {56 vars in 1115 bytes} [Wed Aug 31 00:16:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:47.751538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ce140-3cbd-4567-a557-8d3417d0aa77 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:47.814316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d062a-6bd0-4165-985d-a5f3ead5f213 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:47.829664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:47.853894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d7c26-9a93-46a1-b85e-2a35bea4469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:47.854679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d7c26-9a93-46a1-b85e-2a35bea4469d None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:47.854879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d7c26-9a93-46a1-b85e-2a35bea4469d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:47.855156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d7c26-9a93-46a1-b85e-2a35bea4469d None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:47.855805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d7c26-9a93-46a1-b85e-2a35bea4469d None admin] RBAC: Adding query filter params (type=compute) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:47.856116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d7c26-9a93-46a1-b85e-2a35bea4469d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:47.857550 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d7c26-9a93-46a1-b85e-2a35bea4469d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:47.859398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ce140-3cbd-4567-a557-8d3417d0aa77 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:47.865617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 489/961] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:47.865617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d7c26-9a93-46a1-b85e-2a35bea4469d None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:47.912013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:47.923742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee864d-8b46-427a-aec0-eb8a94922d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:47.924896 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee864d-8b46-427a-aec0-eb8a94922d58 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:47.925370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee864d-8b46-427a-aec0-eb8a94922d58 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:47.926009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee864d-8b46-427a-aec0-eb8a94922d58 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:47.927000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee864d-8b46-427a-aec0-eb8a94922d58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:47.927542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee864d-8b46-427a-aec0-eb8a94922d58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:47.929266 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee864d-8b46-427a-aec0-eb8a94922d58 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:47.935981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 473/962] 10.222.0.74 () {56 vars in 1122 bytes} [Wed Aug 31 00:16:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:47.943076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee864d-8b46-427a-aec0-eb8a94922d58 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.006061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d7c26-9a93-46a1-b85e-2a35bea4469d None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.047546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd079a-8560-4c41-9554-4e3afeaa2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.048176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd079a-8560-4c41-9554-4e3afeaa2fcc None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.048455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd079a-8560-4c41-9554-4e3afeaa2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.048729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd079a-8560-4c41-9554-4e3afeaa2fcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.060269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd079a-8560-4c41-9554-4e3afeaa2fcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:48.061791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd079a-8560-4c41-9554-4e3afeaa2fcc None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:48.069641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee864d-8b46-427a-aec0-eb8a94922d58 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-44bd079a-8560-4c41-9554-4e3afeaa2fcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:48.076336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:48.077345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:48.078632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:48.078632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:48.078632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:48.078632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 490/963] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:48.078950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29c408-8393-4c5a-a5a9-0f5c391e7d3f None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.079036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29c408-8393-4c5a-a5a9-0f5c391e7d3f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.079322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29c408-8393-4c5a-a5a9-0f5c391e7d3f None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.080665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 491/964] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:48.085226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29c408-8393-4c5a-a5a9-0f5c391e7d3f None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.112027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970aa6d-6d3a-414c-9143-e1043f4cfb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.112645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970aa6d-6d3a-414c-9143-e1043f4cfb57 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.113046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970aa6d-6d3a-414c-9143-e1043f4cfb57 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.113324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970aa6d-6d3a-414c-9143-e1043f4cfb57 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.113995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970aa6d-6d3a-414c-9143-e1043f4cfb57 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:48.114302 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970aa6d-6d3a-414c-9143-e1043f4cfb57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:48.115674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970aa6d-6d3a-414c-9143-e1043f4cfb57 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:48.121259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:48.126319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 474/965] 10.222.0.74 () {56 vars in 1122 bytes} [Wed Aug 31 00:16:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:48.126319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23926-6286-4e10-819e-491dec65aaef None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.126319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23926-6286-4e10-819e-491dec65aaef None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.126319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23926-6286-4e10-819e-491dec65aaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.141934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a0a23926-6286-4e10-819e-491dec65aaef None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:48.143125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a0a23926-6286-4e10-819e-491dec65aaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:48.196693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:48.208241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29c408-8393-4c5a-a5a9-0f5c391e7d3f None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.215347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 475/966] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:48.226626 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a23926-6286-4e10-819e-491dec65aaef None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.252391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b786402-1421-47c1-becf-372cd20b0ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.253021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786402-1421-47c1-becf-372cd20b0ebd None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.253298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786402-1421-47c1-becf-372cd20b0ebd None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.253583 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b786402-1421-47c1-becf-372cd20b0ebd None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.254259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b786402-1421-47c1-becf-372cd20b0ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:48.254556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b786402-1421-47c1-becf-372cd20b0ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:48.256682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b786402-1421-47c1-becf-372cd20b0ebd None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:48.277292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 492/967] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:48.278317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b786402-1421-47c1-becf-372cd20b0ebd None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.349982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a23926-6286-4e10-819e-491dec65aaef None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.386530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:48.386737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f3e5a-a839-49cf-af1b-b0722118987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.387465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f3e5a-a839-49cf-af1b-b0722118987f None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.388086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f3e5a-a839-49cf-af1b-b0722118987f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.388086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f3e5a-a839-49cf-af1b-b0722118987f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.388886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f3e5a-a839-49cf-af1b-b0722118987f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:48.390362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f3e5a-a839-49cf-af1b-b0722118987f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:48.401563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b786402-1421-47c1-becf-372cd20b0ebd None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.441332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffea0c9-f4fb-4eaa-9236-85f217815f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.442032 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffea0c9-f4fb-4eaa-9236-85f217815f40 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.442317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffea0c9-f4fb-4eaa-9236-85f217815f40 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.442807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffea0c9-f4fb-4eaa-9236-85f217815f40 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.451737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffea0c9-f4fb-4eaa-9236-85f217815f40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:48.452747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffea0c9-f4fb-4eaa-9236-85f217815f40 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-dffea0c9-f4fb-4eaa-9236-85f217815f40 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:48.466668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:48.467707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:48.468681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:48.468681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:48.468681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:48.468681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:48.468681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:48.468681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:48.468681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:48.468681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:48.468681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 00:16:48.468681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:48.468681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 493/968] 10.222.0.74 () {56 vars in 1117 bytes} [Wed Aug 31 00:16:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:48.475866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffea0c9-f4fb-4eaa-9236-85f217815f40 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.483243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 476/969] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:48.559706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f3e5a-a839-49cf-af1b-b0722118987f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.635581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffea0c9-f4fb-4eaa-9236-85f217815f40 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.662275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:48.705758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5ad0-07fa-429e-a0f2-b9e96e1e0f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.705758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5ad0-07fa-429e-a0f2-b9e96e1e0f73 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.705758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5ad0-07fa-429e-a0f2-b9e96e1e0f73 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.705758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c5ad0-07fa-429e-a0f2-b9e96e1e0f73 None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.706168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5ad0-07fa-429e-a0f2-b9e96e1e0f73 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:48.706168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5ad0-07fa-429e-a0f2-b9e96e1e0f73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:48.706519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c5ad0-07fa-429e-a0f2-b9e96e1e0f73 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:48.707909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f3e5a-a839-49cf-af1b-b0722118987f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.732128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 494/970] 10.222.0.74 () {56 vars in 1149 bytes} [Wed Aug 31 00:16:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:48.738878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5ad0-07fa-429e-a0f2-b9e96e1e0f73 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.741913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:48.753913 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ba817-4bd5-4fee-ba86-a3e933f594dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.754541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ba817-4bd5-4fee-ba86-a3e933f594dd None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.754823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ba817-4bd5-4fee-ba86-a3e933f594dd None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.755114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ba817-4bd5-4fee-ba86-a3e933f594dd None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.755759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ba817-4bd5-4fee-ba86-a3e933f594dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:48.757220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ba817-4bd5-4fee-ba86-a3e933f594dd None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:48.798089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.sql.core [None req-cd1ba817-4bd5-4fee-ba86-a3e933f594dd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:16:48.798089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:16:48.798089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [parameters: {'user_id': '83589ee3911b4a4cb54f8d5274a83f24', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:16:48.798089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88177) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-cd1ba817-4bd5-4fee-ba86-a3e933f594dd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application result.read() Aug 31 00:16:48.810620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:16:48.811578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application yield resource Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application next(self.gen) Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise self.value Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application session.commit() Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 00:16:48.812741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self.session.flush() Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application compat.raise_( Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 00:16:48.813706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 00:16:48.815047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application conn.query(q) Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application result.read() Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 00:16:48.815940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [parameters: {'user_id': '83589ee3911b4a4cb54f8d5274a83f24', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:48.816801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 00:16:48.819725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 00:16:48.826206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 00:16:48.826206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 00:16:48.826206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 00:16:48.826206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 00:16:48.826206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 00:16:48.826206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:48.826206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 477/971] 10.222.0.74 () {60 vars in 1131 bytes} [Wed Aug 31 00:16:48 2022] POST /identity/v3/users => generated 160 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:48.830911 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ba817-4bd5-4fee-ba86-a3e933f594dd None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:48.880743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c5ad0-07fa-429e-a0f2-b9e96e1e0f73 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.933983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25f7d1-9953-41a1-87a6-17b984395f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:48.934658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25f7d1-9953-41a1-87a6-17b984395f77 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:48.934944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25f7d1-9953-41a1-87a6-17b984395f77 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:48.935223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25f7d1-9953-41a1-87a6-17b984395f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:48.960437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ba817-4bd5-4fee-ba86-a3e933f594dd None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:48.964036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:49.000492 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c441-d9bc-48aa-92dd-eef09f350d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.001528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c441-d9bc-48aa-92dd-eef09f350d01 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.002084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c441-d9bc-48aa-92dd-eef09f350d01 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.002784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777c441-d9bc-48aa-92dd-eef09f350d01 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.013343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777c441-d9bc-48aa-92dd-eef09f350d01 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.016898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777c441-d9bc-48aa-92dd-eef09f350d01 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.031161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25f7d1-9953-41a1-87a6-17b984395f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-1777c441-d9bc-48aa-92dd-eef09f350d01 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:16:49.031824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:49.032787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:49.033781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:49.033781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:49.033781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:16:49.033781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:16:49.033781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:16:49.033781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:16:49.033781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:16:49.033781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:16:49.033781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 00:16:49.033781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:49.034334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25f7d1-9953-41a1-87a6-17b984395f77 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.034668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:49.041619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 478/972] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:16:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:49.043335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c441-d9bc-48aa-92dd-eef09f350d01 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.162253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777c441-d9bc-48aa-92dd-eef09f350d01 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.172114 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 495/973] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:16:48 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:16:49.174068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25f7d1-9953-41a1-87a6-17b984395f77 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.204654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a9e64-e963-4c6e-b6e4-72a45a8e3da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.205419 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a9e64-e963-4c6e-b6e4-72a45a8e3da1 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.205841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a9e64-e963-4c6e-b6e4-72a45a8e3da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.206215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a9e64-e963-4c6e-b6e4-72a45a8e3da1 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.207017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a9e64-e963-4c6e-b6e4-72a45a8e3da1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:49.207470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a9e64-e963-4c6e-b6e4-72a45a8e3da1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.209072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a9e64-e963-4c6e-b6e4-72a45a8e3da1 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.257986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 479/974] 10.222.0.74 () {56 vars in 1101 bytes} [Wed Aug 31 00:16:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:49.310730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25f7d1-9953-41a1-87a6-17b984395f77 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.313511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:49.361263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53152f0-ea42-4aac-87ed-b5931fccb8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.362228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53152f0-ea42-4aac-87ed-b5931fccb8a3 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.362785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53152f0-ea42-4aac-87ed-b5931fccb8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.363534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53152f0-ea42-4aac-87ed-b5931fccb8a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.376773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53152f0-ea42-4aac-87ed-b5931fccb8a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.378669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53152f0-ea42-4aac-87ed-b5931fccb8a3 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-d53152f0-ea42-4aac-87ed-b5931fccb8a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:49.397372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:49.399424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:49.400581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:49.400581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:49.400581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:49.402246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 496/975] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:49.411587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a9e64-e963-4c6e-b6e4-72a45a8e3da1 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.438470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:49.534323 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a9e64-e963-4c6e-b6e4-72a45a8e3da1 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.571491 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c3f85-c239-484c-bc69-b0e73f45e3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.572379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c3f85-c239-484c-bc69-b0e73f45e3eb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.572755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c3f85-c239-484c-bc69-b0e73f45e3eb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.573125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c3f85-c239-484c-bc69-b0e73f45e3eb None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.574067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c3f85-c239-484c-bc69-b0e73f45e3eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:49.574477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c3f85-c239-484c-bc69-b0e73f45e3eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.575917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2c3f85-c239-484c-bc69-b0e73f45e3eb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.593226 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 480/976] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:49.594442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53152f0-ea42-4aac-87ed-b5931fccb8a3 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.702198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53152f0-ea42-4aac-87ed-b5931fccb8a3 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.736669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a66378-13a6-4cd0-9b1d-67fdc3a74359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.737291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a66378-13a6-4cd0-9b1d-67fdc3a74359 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.737565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a66378-13a6-4cd0-9b1d-67fdc3a74359 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.737861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a66378-13a6-4cd0-9b1d-67fdc3a74359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.745444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a66378-13a6-4cd0-9b1d-67fdc3a74359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.746909 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a66378-13a6-4cd0-9b1d-67fdc3a74359 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-96a66378-13a6-4cd0-9b1d-67fdc3a74359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:16:49.758247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:49.760127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:49.761505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:16:49.761505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:16:49.761505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:16:49.761505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:16:49.761505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:16:49.761505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:16:49.761505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:16:49.761505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:49.764256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 497/977] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:16:49.765774 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c3f85-c239-484c-bc69-b0e73f45e3eb None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.854001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:49.870988 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999bd0-05f7-4c6a-ac04-40d2e2b973b5 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.871293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999bd0-05f7-4c6a-ac04-40d2e2b973b5 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.871544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999bd0-05f7-4c6a-ac04-40d2e2b973b5 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.872927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 498/978] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:49.874737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c3f85-c239-484c-bc69-b0e73f45e3eb None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:49.878763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39613-0534-4fef-931d-6b2ae969c2b0 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.879047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39613-0534-4fef-931d-6b2ae969c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.879320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d39613-0534-4fef-931d-6b2ae969c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.898838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-91d39613-0534-4fef-931d-6b2ae969c2b0 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:49.900213 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-91d39613-0534-4fef-931d-6b2ae969c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:49.911320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:49.920991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137435f-2dba-402a-8632-ae52f508e16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:49.921719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137435f-2dba-402a-8632-ae52f508e16f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:49.921949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137435f-2dba-402a-8632-ae52f508e16f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:49.922223 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137435f-2dba-402a-8632-ae52f508e16f None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:49.922910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137435f-2dba-402a-8632-ae52f508e16f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:49.923213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137435f-2dba-402a-8632-ae52f508e16f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:49.924663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137435f-2dba-402a-8632-ae52f508e16f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:49.937833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 481/979] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:49.943558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137435f-2dba-402a-8632-ae52f508e16f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:49.981793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 499/980] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:50.051253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137435f-2dba-402a-8632-ae52f508e16f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:50.085499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e8664-1377-411f-bf55-1cc8ccfc34ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:50.086132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e8664-1377-411f-bf55-1cc8ccfc34ef None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.086416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e8664-1377-411f-bf55-1cc8ccfc34ef None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.087383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e8664-1377-411f-bf55-1cc8ccfc34ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.088238 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e8664-1377-411f-bf55-1cc8ccfc34ef None admin] RBAC: Adding query filter params (role.id=00a939dc02584f029bd94cbe9018cc30, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=b15b4c00f7214835b42e2775c4023032) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:50.088552 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e8664-1377-411f-bf55-1cc8ccfc34ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:50.090025 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e8664-1377-411f-bf55-1cc8ccfc34ef None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:50.101810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 482/981] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:16:49 2022] GET /identity/v3/role_assignments?user.id=b15b4c00f7214835b42e2775c4023032&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=00a939dc02584f029bd94cbe9018cc30 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:50.246096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d39613-0534-4fef-931d-6b2ae969c2b0 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:50.353741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d39613-0534-4fef-931d-6b2ae969c2b0 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:50.392045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122bf29-c000-4251-b1b6-42aa4b8bbadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:50.392719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122bf29-c000-4251-b1b6-42aa4b8bbadd None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.393001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122bf29-c000-4251-b1b6-42aa4b8bbadd None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.393275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122bf29-c000-4251-b1b6-42aa4b8bbadd None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.394006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122bf29-c000-4251-b1b6-42aa4b8bbadd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:50.395384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122bf29-c000-4251-b1b6-42aa4b8bbadd None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:50.469622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 500/982] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:16:50 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:50.807303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d04b0-1a9b-4aeb-8ea8-0c1f97e6e6cf None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.807631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d04b0-1a9b-4aeb-8ea8-0c1f97e6e6cf None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.807868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d04b0-1a9b-4aeb-8ea8-0c1f97e6e6cf None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.809397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 483/983] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:50.815218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466bf46-06da-4a99-bc04-f84aeed93052 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:50.815218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466bf46-06da-4a99-bc04-f84aeed93052 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:50.815218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466bf46-06da-4a99-bc04-f84aeed93052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:50.823275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:50.834919 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-9466bf46-06da-4a99-bc04-f84aeed93052 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:50.836112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-9466bf46-06da-4a99-bc04-f84aeed93052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:50.915329 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 501/984] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:51.186989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d04b0-1a9b-4aeb-8ea8-0c1f97e6e6cf None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:51.192225 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:51.301239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d04b0-1a9b-4aeb-8ea8-0c1f97e6e6cf None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:51.335581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f07b13-1bbe-45db-8a79-79a03aadca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:51.336212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f07b13-1bbe-45db-8a79-79a03aadca72 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:51.337167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f07b13-1bbe-45db-8a79-79a03aadca72 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:51.337644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f07b13-1bbe-45db-8a79-79a03aadca72 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:51.338344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f07b13-1bbe-45db-8a79-79a03aadca72 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:51.341039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f07b13-1bbe-45db-8a79-79a03aadca72 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-34f07b13-1bbe-45db-8a79-79a03aadca72 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:51.350057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:51.351097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:51.351944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:51.353383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 484/985] 10.222.0.74 () {56 vars in 1126 bytes} [Wed Aug 31 00:16:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:51.357019 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466bf46-06da-4a99-bc04-f84aeed93052 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:51.459999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466bf46-06da-4a99-bc04-f84aeed93052 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:51.495726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:51.502314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87590541-ff8f-4ca6-a7df-3bc51c0f5d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:51.502926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87590541-ff8f-4ca6-a7df-3bc51c0f5d57 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:51.503206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87590541-ff8f-4ca6-a7df-3bc51c0f5d57 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:51.503479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87590541-ff8f-4ca6-a7df-3bc51c0f5d57 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:51.504116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87590541-ff8f-4ca6-a7df-3bc51c0f5d57 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:51.504425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87590541-ff8f-4ca6-a7df-3bc51c0f5d57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:51.505814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87590541-ff8f-4ca6-a7df-3bc51c0f5d57 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:51.515622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 502/986] 10.222.0.74 () {56 vars in 1122 bytes} [Wed Aug 31 00:16:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:51.516598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f07b13-1bbe-45db-8a79-79a03aadca72 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:51.591582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:51.625113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f07b13-1bbe-45db-8a79-79a03aadca72 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:51.660563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be1a03-59a5-48ed-aedb-9ce4d8d119d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:51.661171 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be1a03-59a5-48ed-aedb-9ce4d8d119d2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:51.661450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be1a03-59a5-48ed-aedb-9ce4d8d119d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:51.661751 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be1a03-59a5-48ed-aedb-9ce4d8d119d2 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:51.662382 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be1a03-59a5-48ed-aedb-9ce4d8d119d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:51.662685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be1a03-59a5-48ed-aedb-9ce4d8d119d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:51.664040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be1a03-59a5-48ed-aedb-9ce4d8d119d2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:51.670275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 485/987] 10.222.0.74 () {56 vars in 1122 bytes} [Wed Aug 31 00:16:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:51.675898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87590541-ff8f-4ca6-a7df-3bc51c0f5d57 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:51.779299 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87590541-ff8f-4ca6-a7df-3bc51c0f5d57 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:51.812982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd3223-2c8a-4889-b0cd-2cb02841a6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:51.813594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd3223-2c8a-4889-b0cd-2cb02841a6c1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:51.813900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd3223-2c8a-4889-b0cd-2cb02841a6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:51.814174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd3223-2c8a-4889-b0cd-2cb02841a6c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:51.818571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd3223-2c8a-4889-b0cd-2cb02841a6c1 None admin] RBAC: Adding query filter params (interface=admin, service_id=a74be1ee94ae4f9b8ca46d1918a7c94b, region_id=RegionOne) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:51.818571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd3223-2c8a-4889-b0cd-2cb02841a6c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:51.818571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd3223-2c8a-4889-b0cd-2cb02841a6c1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:51.822579 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 503/988] 10.222.0.74 () {56 vars in 1249 bytes} [Wed Aug 31 00:16:51 2022] GET /identity/v3/endpoints?service_id=a74be1ee94ae4f9b8ca46d1918a7c94b&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:51.827943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be1a03-59a5-48ed-aedb-9ce4d8d119d2 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:51.941749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be1a03-59a5-48ed-aedb-9ce4d8d119d2 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:51.972943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:51.979531 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345544ac-19f6-45f9-a96f-136e893dd44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:51.980143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345544ac-19f6-45f9-a96f-136e893dd44e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:51.980421 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345544ac-19f6-45f9-a96f-136e893dd44e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:51.984673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345544ac-19f6-45f9-a96f-136e893dd44e None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:51.984673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345544ac-19f6-45f9-a96f-136e893dd44e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:51.984673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345544ac-19f6-45f9-a96f-136e893dd44e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:51.989263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 486/989] 10.222.0.74 () {56 vars in 1087 bytes} [Wed Aug 31 00:16:51 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:52.092454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff36e3c-706c-4275-8e98-34f377f6086a None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:52.092975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff36e3c-706c-4275-8e98-34f377f6086a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:52.092975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff36e3c-706c-4275-8e98-34f377f6086a None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:52.094491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 504/990] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:52.099935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0620-4cce-480f-b55f-6c5da96d2f65 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:52.100223 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0620-4cce-480f-b55f-6c5da96d2f65 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:52.100501 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c0620-4cce-480f-b55f-6c5da96d2f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:52.120931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-109c0620-4cce-480f-b55f-6c5da96d2f65 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:52.122526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-109c0620-4cce-480f-b55f-6c5da96d2f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:52.199083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 487/991] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:52.436276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa57758-ffe5-4be0-9e78-8d105581827e None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:52.436595 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa57758-ffe5-4be0-9e78-8d105581827e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:52.436793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa57758-ffe5-4be0-9e78-8d105581827e None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:52.438186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 505/992] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:52.443668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1c3b-e530-44ad-a197-ad3bc944dc6b None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:52.443967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1c3b-e530-44ad-a197-ad3bc944dc6b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:52.444243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1c3b-e530-44ad-a197-ad3bc944dc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:52.463724 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a6cb1c3b-e530-44ad-a197-ad3bc944dc6b None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:52.464930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a6cb1c3b-e530-44ad-a197-ad3bc944dc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:52.478047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa57758-ffe5-4be0-9e78-8d105581827e None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:52.545308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 488/993] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:52.551172 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:52.593382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa57758-ffe5-4be0-9e78-8d105581827e None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:52.627381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d3d72-effd-42d6-aaba-ec1c41e1e853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:52.628017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3d72-effd-42d6-aaba-ec1c41e1e853 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:52.628296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3d72-effd-42d6-aaba-ec1c41e1e853 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:52.628565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d3d72-effd-42d6-aaba-ec1c41e1e853 None admin] PATH_INFO: `/v3/services/image` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:52.629144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d3d72-effd-42d6-aaba-ec1c41e1e853 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:52.630531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d3d72-effd-42d6-aaba-ec1c41e1e853 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-747d3d72-effd-42d6-aaba-ec1c41e1e853 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:52.640567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:52.646466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:52.647358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 506/994] 10.222.0.74 () {56 vars in 1105 bytes} [Wed Aug 31 00:16:52 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:52.648229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb1c3b-e530-44ad-a197-ad3bc944dc6b None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:52.709205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:52.753409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb1c3b-e530-44ad-a197-ad3bc944dc6b None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:52.792707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eda443-f881-43c0-99d2-fab483801614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:52.793334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eda443-f881-43c0-99d2-fab483801614 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:52.793642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eda443-f881-43c0-99d2-fab483801614 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:52.793921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eda443-f881-43c0-99d2-fab483801614 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:52.794561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eda443-f881-43c0-99d2-fab483801614 None admin] RBAC: Adding query filter params (name=image) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:52.795131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eda443-f881-43c0-99d2-fab483801614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:52.796576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eda443-f881-43c0-99d2-fab483801614 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:52.806659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 489/995] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:52.808492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d3d72-effd-42d6-aaba-ec1c41e1e853 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:52.833771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eda443-f881-43c0-99d2-fab483801614 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:52.927509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d3d72-effd-42d6-aaba-ec1c41e1e853 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:52.951234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eda443-f881-43c0-99d2-fab483801614 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:52.952326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:52.969619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b0f79-6e2f-4716-b57f-89c47166198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:52.969619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0f79-6e2f-4716-b57f-89c47166198c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:52.969619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0f79-6e2f-4716-b57f-89c47166198c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:52.969619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0f79-6e2f-4716-b57f-89c47166198c None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:52.970117 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0f79-6e2f-4716-b57f-89c47166198c None admin] RBAC: Adding query filter params (type=image) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:52.970117 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0f79-6e2f-4716-b57f-89c47166198c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:52.970284 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0f79-6e2f-4716-b57f-89c47166198c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:52.974849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:52.975107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 507/996] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:52.996650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c6e32-06fa-498e-99b3-1b6f0557a91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:52.997312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6e32-06fa-498e-99b3-1b6f0557a91e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:52.997622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6e32-06fa-498e-99b3-1b6f0557a91e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:52.997900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c6e32-06fa-498e-99b3-1b6f0557a91e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:52.998665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c6e32-06fa-498e-99b3-1b6f0557a91e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:53.000128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c6e32-06fa-498e-99b3-1b6f0557a91e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-f75c6e32-06fa-498e-99b3-1b6f0557a91e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:53.010431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:53.011550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:16:53.012447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:53.014051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 490/997] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:53.017743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b0f79-6e2f-4716-b57f-89c47166198c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:53.140132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b0f79-6e2f-4716-b57f-89c47166198c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:53.185868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0b9b8-cb45-423c-9c99-6d55fd2cd3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:53.186476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b9b8-cb45-423c-9c99-6d55fd2cd3f4 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:53.186750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b9b8-cb45-423c-9c99-6d55fd2cd3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:53.187018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0b9b8-cb45-423c-9c99-6d55fd2cd3f4 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:53.187646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0b9b8-cb45-423c-9c99-6d55fd2cd3f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:53.187945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0b9b8-cb45-423c-9c99-6d55fd2cd3f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:53.189303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0b9b8-cb45-423c-9c99-6d55fd2cd3f4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:53.200660 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 508/998] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:53.202579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c6e32-06fa-498e-99b3-1b6f0557a91e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:53.308715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c6e32-06fa-498e-99b3-1b6f0557a91e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:53.343773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a78cd-98c2-4408-ac1b-65b2168fdcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:53.344384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a78cd-98c2-4408-ac1b-65b2168fdcd6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:53.344663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a78cd-98c2-4408-ac1b-65b2168fdcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:53.344934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a78cd-98c2-4408-ac1b-65b2168fdcd6 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:53.345558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a78cd-98c2-4408-ac1b-65b2168fdcd6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:53.345888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a78cd-98c2-4408-ac1b-65b2168fdcd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:53.347243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a78cd-98c2-4408-ac1b-65b2168fdcd6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:53.356807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 491/999] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:53.357864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0b9b8-cb45-423c-9c99-6d55fd2cd3f4 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:53.410265 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:53.460951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0b9b8-cb45-423c-9c99-6d55fd2cd3f4 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:53.502514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44925c-77b5-4f93-8800-b6888149e4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:53.502514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44925c-77b5-4f93-8800-b6888149e4ed None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:53.502831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44925c-77b5-4f93-8800-b6888149e4ed None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:53.503224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44925c-77b5-4f93-8800-b6888149e4ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:53.503693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44925c-77b5-4f93-8800-b6888149e4ed None admin] RBAC: Adding query filter params (interface=public, service_id=3f0468935a6546a38cd606be4ebab1e8, region_id=RegionOne) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:53.503999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44925c-77b5-4f93-8800-b6888149e4ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:53.505375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44925c-77b5-4f93-8800-b6888149e4ed None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:53.516698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 509/1000] 10.222.0.74 () {56 vars in 1251 bytes} [Wed Aug 31 00:16:53 2022] GET /identity/v3/endpoints?service_id=3f0468935a6546a38cd606be4ebab1e8&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:53.518507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a78cd-98c2-4408-ac1b-65b2168fdcd6 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:53.580553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:53.636328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a78cd-98c2-4408-ac1b-65b2168fdcd6 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:53.671783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f00115-39b1-4d30-a468-cca4fc9f9ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:53.672666 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f00115-39b1-4d30-a468-cca4fc9f9ab7 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:53.673099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f00115-39b1-4d30-a468-cca4fc9f9ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:53.673530 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f00115-39b1-4d30-a468-cca4fc9f9ab7 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:53.674330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f00115-39b1-4d30-a468-cca4fc9f9ab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:53.675917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f00115-39b1-4d30-a468-cca4fc9f9ab7 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:53.683418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 492/1001] 10.222.0.74 () {56 vars in 1087 bytes} [Wed Aug 31 00:16:53 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:53.937004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ac263-1544-4614-ba87-866efc17cb02 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:53.937350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ac263-1544-4614-ba87-866efc17cb02 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:53.937565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ac263-1544-4614-ba87-866efc17cb02 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:53.939066 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 510/1002] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:53.944353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444869f-506d-4eb6-979f-40578d306de7 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:53.944673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444869f-506d-4eb6-979f-40578d306de7 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:53.944920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444869f-506d-4eb6-979f-40578d306de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:53.963676 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2444869f-506d-4eb6-979f-40578d306de7 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:53.964875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2444869f-506d-4eb6-979f-40578d306de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:54.035566 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 493/1003] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:54.307153 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ac263-1544-4614-ba87-866efc17cb02 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:54.412149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ac263-1544-4614-ba87-866efc17cb02 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:54.426584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:54.448094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e611e5d-ff99-43eb-aad6-60f966bd4d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:54.448727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611e5d-ff99-43eb-aad6-60f966bd4d3f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:54.449003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611e5d-ff99-43eb-aad6-60f966bd4d3f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:54.449278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611e5d-ff99-43eb-aad6-60f966bd4d3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:54.449892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e611e5d-ff99-43eb-aad6-60f966bd4d3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:54.451308 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e611e5d-ff99-43eb-aad6-60f966bd4d3f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-6e611e5d-ff99-43eb-aad6-60f966bd4d3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:54.460181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:54.461183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 00:16:54.462454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:54.465656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 511/1004] 10.222.0.74 () {56 vars in 1126 bytes} [Wed Aug 31 00:16:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:54.467620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444869f-506d-4eb6-979f-40578d306de7 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:54.511472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:54.575315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444869f-506d-4eb6-979f-40578d306de7 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:54.609976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd729f-cfc7-4a1b-a87f-45cf43d76f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:54.610587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd729f-cfc7-4a1b-a87f-45cf43d76f3c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:54.610867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd729f-cfc7-4a1b-a87f-45cf43d76f3c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:54.611138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd729f-cfc7-4a1b-a87f-45cf43d76f3c None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:54.611765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd729f-cfc7-4a1b-a87f-45cf43d76f3c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:54.612068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd729f-cfc7-4a1b-a87f-45cf43d76f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:54.613485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd729f-cfc7-4a1b-a87f-45cf43d76f3c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:54.618989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 494/1005] 10.222.0.74 () {56 vars in 1122 bytes} [Wed Aug 31 00:16:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:54.624664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e611e5d-ff99-43eb-aad6-60f966bd4d3f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:54.729007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e611e5d-ff99-43eb-aad6-60f966bd4d3f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:54.766120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34513e71-4295-4ae7-97e2-850c0eeac764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:54.766723 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34513e71-4295-4ae7-97e2-850c0eeac764 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:54.766999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34513e71-4295-4ae7-97e2-850c0eeac764 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:54.767272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34513e71-4295-4ae7-97e2-850c0eeac764 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:54.767958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34513e71-4295-4ae7-97e2-850c0eeac764 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:54.768266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34513e71-4295-4ae7-97e2-850c0eeac764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:54.769650 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34513e71-4295-4ae7-97e2-850c0eeac764 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:54.779804 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 512/1006] 10.222.0.74 () {56 vars in 1122 bytes} [Wed Aug 31 00:16:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:54.780936 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd729f-cfc7-4a1b-a87f-45cf43d76f3c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:54.891478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd729f-cfc7-4a1b-a87f-45cf43d76f3c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:54.902990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:54.930519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c888a43-fab0-4bb4-9e0a-088a58c38a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:54.931122 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c888a43-fab0-4bb4-9e0a-088a58c38a8d None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:54.931403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c888a43-fab0-4bb4-9e0a-088a58c38a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:54.931675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c888a43-fab0-4bb4-9e0a-088a58c38a8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:54.932347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c888a43-fab0-4bb4-9e0a-088a58c38a8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:54.933749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c888a43-fab0-4bb4-9e0a-088a58c38a8d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:54.948878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214584b5-b41b-4cdd-ac4e-c1c9bb844628 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:54.949160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214584b5-b41b-4cdd-ac4e-c1c9bb844628 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:54.949432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214584b5-b41b-4cdd-ac4e-c1c9bb844628 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:54.950780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 513/1007] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:54.955509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129bdd1-6cf9-4507-8518-df13738984cd None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:54.955785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129bdd1-6cf9-4507-8518-df13738984cd None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:54.956057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129bdd1-6cf9-4507-8518-df13738984cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:54.974622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-5129bdd1-6cf9-4507-8518-df13738984cd None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:54.975893 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5129bdd1-6cf9-4507-8518-df13738984cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:55.001344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 495/1008] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:55.021971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:55.065689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 514/1009] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:55.334092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c888a43-fab0-4bb4-9e0a-088a58c38a8d None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:55.440373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c888a43-fab0-4bb4-9e0a-088a58c38a8d None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:55.478912 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddd892-0ac3-4b34-aeab-ac16b4f6d103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:55.479845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddd892-0ac3-4b34-aeab-ac16b4f6d103 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:55.479845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddd892-0ac3-4b34-aeab-ac16b4f6d103 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:55.480146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddd892-0ac3-4b34-aeab-ac16b4f6d103 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:55.480795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddd892-0ac3-4b34-aeab-ac16b4f6d103 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:55.482285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddd892-0ac3-4b34-aeab-ac16b4f6d103 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:55.595881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 496/1010] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:16:55 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:16:55.653713 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c52c-d373-4e07-b211-f9c4f1e92828 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:55.654311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c52c-d373-4e07-b211-f9c4f1e92828 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:55.654311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2c52c-d373-4e07-b211-f9c4f1e92828 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:55.655965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 515/1011] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:55.661465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710d780-b008-49d3-b554-a2cfb68a4d1d None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:55.661844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710d780-b008-49d3-b554-a2cfb68a4d1d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:55.662057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710d780-b008-49d3-b554-a2cfb68a4d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:55.684102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2710d780-b008-49d3-b554-a2cfb68a4d1d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:55.685358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2710d780-b008-49d3-b554-a2cfb68a4d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:55.708559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:55.769503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 497/1012] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:55 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:56.042231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c52c-d373-4e07-b211-f9c4f1e92828 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:56.154552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2c52c-d373-4e07-b211-f9c4f1e92828 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:56.190125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade8523-ae51-474b-b6e8-d980b72c5bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:56.190750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade8523-ae51-474b-b6e8-d980b72c5bf7 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.191026 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade8523-ae51-474b-b6e8-d980b72c5bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.191297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade8523-ae51-474b-b6e8-d980b72c5bf7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.191881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade8523-ae51-474b-b6e8-d980b72c5bf7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:56.193272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade8523-ae51-474b-b6e8-d980b72c5bf7 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-3ade8523-ae51-474b-b6e8-d980b72c5bf7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:56.202747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:56.203768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:56.204679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 516/1013] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:16:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:56.212681 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710d780-b008-49d3-b554-a2cfb68a4d1d None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:56.327040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710d780-b008-49d3-b554-a2cfb68a4d1d None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:56.365633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77312f5-2e1f-46a8-a521-3f892a0dd59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:56.366252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77312f5-2e1f-46a8-a521-3f892a0dd59f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.366541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77312f5-2e1f-46a8-a521-3f892a0dd59f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.366814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77312f5-2e1f-46a8-a521-3f892a0dd59f None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.367446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77312f5-2e1f-46a8-a521-3f892a0dd59f None admin] RBAC: Adding query filter params (name=compute) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:56.367784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77312f5-2e1f-46a8-a521-3f892a0dd59f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:56.369162 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77312f5-2e1f-46a8-a521-3f892a0dd59f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:56.377690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 498/1014] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:16:56.382656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade8523-ae51-474b-b6e8-d980b72c5bf7 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:56.421887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:56.509903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade8523-ae51-474b-b6e8-d980b72c5bf7 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:56.546552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56795b-c5b3-4eba-a3e8-a5387d69f522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:56.547166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56795b-c5b3-4eba-a3e8-a5387d69f522 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.547446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56795b-c5b3-4eba-a3e8-a5387d69f522 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.547719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56795b-c5b3-4eba-a3e8-a5387d69f522 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.548356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56795b-c5b3-4eba-a3e8-a5387d69f522 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:56.548658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56795b-c5b3-4eba-a3e8-a5387d69f522 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:56.550073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56795b-c5b3-4eba-a3e8-a5387d69f522 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:56.557801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 517/1015] 10.222.0.74 () {56 vars in 1112 bytes} [Wed Aug 31 00:16:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:56.561719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77312f5-2e1f-46a8-a521-3f892a0dd59f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:56.581860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:56.666512 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77312f5-2e1f-46a8-a521-3f892a0dd59f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:56.701395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6daa95-9179-4d3f-b118-f21066f0c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:56.701951 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6daa95-9179-4d3f-b118-f21066f0c9da None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.702234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6daa95-9179-4d3f-b118-f21066f0c9da None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.702502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6daa95-9179-4d3f-b118-f21066f0c9da None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.703161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6daa95-9179-4d3f-b118-f21066f0c9da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:56.704527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6daa95-9179-4d3f-b118-f21066f0c9da None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:56.773947 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 499/1016] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:16:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:56.972827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8b46b-4e72-4e5e-aeb8-814dfdb0a26e None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.973317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8b46b-4e72-4e5e-aeb8-814dfdb0a26e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.973317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8b46b-4e72-4e5e-aeb8-814dfdb0a26e None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:56.974791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 518/1017] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:56.980782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981395e-b9ba-4c75-aa14-8c6b27e4f71e None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:56.981075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981395e-b9ba-4c75-aa14-8c6b27e4f71e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:56.981355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981395e-b9ba-4c75-aa14-8c6b27e4f71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.000692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a981395e-b9ba-4c75-aa14-8c6b27e4f71e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:57.001979 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a981395e-b9ba-4c75-aa14-8c6b27e4f71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:57.076667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:57.085617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 500/1018] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:57.354253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8b46b-4e72-4e5e-aeb8-814dfdb0a26e None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:57.456387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:57.464407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8b46b-4e72-4e5e-aeb8-814dfdb0a26e None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:57.502977 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd137b-ad1b-4c19-81a8-790d46cd4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:57.503605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd137b-ad1b-4c19-81a8-790d46cd4d66 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:57.503884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd137b-ad1b-4c19-81a8-790d46cd4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:57.504156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd137b-ad1b-4c19-81a8-790d46cd4d66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.505284 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd137b-ad1b-4c19-81a8-790d46cd4d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:57.506745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd137b-ad1b-4c19-81a8-790d46cd4d66 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:57.509611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 519/1019] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:57.515399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981395e-b9ba-4c75-aa14-8c6b27e4f71e None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:57.556426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2858e75-772e-4fd2-a10a-a5928aee6ea8 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:57.556750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2858e75-772e-4fd2-a10a-a5928aee6ea8 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:57.556973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2858e75-772e-4fd2-a10a-a5928aee6ea8 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.558472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 520/1020] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:16:57.563028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1da0e-d54e-4b0f-b4cc-a85e12d107eb None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:57.563312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1da0e-d54e-4b0f-b4cc-a85e12d107eb None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:57.563584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1da0e-d54e-4b0f-b4cc-a85e12d107eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.582312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-dde1da0e-d54e-4b0f-b4cc-a85e12d107eb None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:57.583506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-dde1da0e-d54e-4b0f-b4cc-a85e12d107eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:57.637606 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981395e-b9ba-4c75-aa14-8c6b27e4f71e None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:57.662334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 521/1021] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:57.673074 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c6a89-e06b-4b7e-b2c6-58d3f5e5c589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:57.673712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c6a89-e06b-4b7e-b2c6-58d3f5e5c589 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:57.673994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c6a89-e06b-4b7e-b2c6-58d3f5e5c589 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:57.674268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c6a89-e06b-4b7e-b2c6-58d3f5e5c589 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:57.674935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c6a89-e06b-4b7e-b2c6-58d3f5e5c589 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:57.676364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c6a89-e06b-4b7e-b2c6-58d3f5e5c589 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:57.756644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 501/1022] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:16:57 2022] POST /identity/v3/projects => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:16:57.937157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1da0e-d54e-4b0f-b4cc-a85e12d107eb None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.042850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:58.049895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1da0e-d54e-4b0f-b4cc-a85e12d107eb None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.083973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12294c05-02a7-43da-b012-b0afa018df45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.084593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12294c05-02a7-43da-b012-b0afa018df45 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.084867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12294c05-02a7-43da-b012-b0afa018df45 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.085138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12294c05-02a7-43da-b012-b0afa018df45 None admin] PATH_INFO: `/v3/services/image` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.085735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12294c05-02a7-43da-b012-b0afa018df45 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.087733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12294c05-02a7-43da-b012-b0afa018df45 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-12294c05-02a7-43da-b012-b0afa018df45 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:58.096452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:58.097461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:16:58.098361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:16:58.101747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 522/1023] 10.222.0.74 () {56 vars in 1105 bytes} [Wed Aug 31 00:16:57 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:58.103589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c6a89-e06b-4b7e-b2c6-58d3f5e5c589 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.154491 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:58.206309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c6a89-e06b-4b7e-b2c6-58d3f5e5c589 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.240602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89c93e-156a-4f70-829f-86791c817a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.241330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89c93e-156a-4f70-829f-86791c817a6b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.241641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89c93e-156a-4f70-829f-86791c817a6b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.241917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89c93e-156a-4f70-829f-86791c817a6b None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.243160 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89c93e-156a-4f70-829f-86791c817a6b None admin] RBAC: Adding query filter params (name=image) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:58.243534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89c93e-156a-4f70-829f-86791c817a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.245229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89c93e-156a-4f70-829f-86791c817a6b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.256014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 502/1024] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:58.257003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12294c05-02a7-43da-b012-b0afa018df45 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.359286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12294c05-02a7-43da-b012-b0afa018df45 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.396921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881dd7a-5f69-4f19-991b-a23e8ba816c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.397530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881dd7a-5f69-4f19-991b-a23e8ba816c3 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.397842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881dd7a-5f69-4f19-991b-a23e8ba816c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.398115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881dd7a-5f69-4f19-991b-a23e8ba816c3 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.398786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881dd7a-5f69-4f19-991b-a23e8ba816c3 None admin] RBAC: Adding query filter params (type=image) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:58.399085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881dd7a-5f69-4f19-991b-a23e8ba816c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.400449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881dd7a-5f69-4f19-991b-a23e8ba816c3 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.410272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 523/1025] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:58.411493 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89c93e-156a-4f70-829f-86791c817a6b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.516440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89c93e-156a-4f70-829f-86791c817a6b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.531309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:58.551889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee61c7-899b-45c5-8be5-5292003c422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.552500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee61c7-899b-45c5-8be5-5292003c422e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.552785 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee61c7-899b-45c5-8be5-5292003c422e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.553056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee61c7-899b-45c5-8be5-5292003c422e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.553860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee61c7-899b-45c5-8be5-5292003c422e None admin] RBAC: Adding query filter params (interface=public, service_id=476ed728e3a6438195ade4239fed13d3, region_id=RegionOne) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:58.554173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee61c7-899b-45c5-8be5-5292003c422e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.555603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee61c7-899b-45c5-8be5-5292003c422e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.565118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 503/1026] 10.222.0.74 () {56 vars in 1251 bytes} [Wed Aug 31 00:16:58 2022] GET /identity/v3/endpoints?service_id=476ed728e3a6438195ade4239fed13d3&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:58.566706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881dd7a-5f69-4f19-991b-a23e8ba816c3 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:58.593134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:58.670752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881dd7a-5f69-4f19-991b-a23e8ba816c3 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:58.705202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d5531-4066-428e-a2d6-485b3e495b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:58.705831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d5531-4066-428e-a2d6-485b3e495b84 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.706113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d5531-4066-428e-a2d6-485b3e495b84 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.706385 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d5531-4066-428e-a2d6-485b3e495b84 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.707049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d5531-4066-428e-a2d6-485b3e495b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:58.708411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d5531-4066-428e-a2d6-485b3e495b84 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:58.721614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 524/1027] 10.222.0.74 () {56 vars in 1087 bytes} [Wed Aug 31 00:16:58 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:16:58.838280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd88ecf-9dd6-446d-8e36-9f7e017e11f1 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.838792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd88ecf-9dd6-446d-8e36-9f7e017e11f1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.838792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd88ecf-9dd6-446d-8e36-9f7e017e11f1 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.840308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 504/1028] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:16:58.846128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62af40-3317-43cc-bc1b-1a2ccbc128cc None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:58.853993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62af40-3317-43cc-bc1b-1a2ccbc128cc None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:58.853993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62af40-3317-43cc-bc1b-1a2ccbc128cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:58.866162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-cc62af40-3317-43cc-bc1b-1a2ccbc128cc None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:58.867937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cc62af40-3317-43cc-bc1b-1a2ccbc128cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:58.947135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 525/1029] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:16:59.217568 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd88ecf-9dd6-446d-8e36-9f7e017e11f1 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:59.327500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd88ecf-9dd6-446d-8e36-9f7e017e11f1 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:59.362029 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dced163-68ca-4e2b-8f9e-52204bbf5633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:59.362670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dced163-68ca-4e2b-8f9e-52204bbf5633 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:59.362952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dced163-68ca-4e2b-8f9e-52204bbf5633 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:59.363225 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dced163-68ca-4e2b-8f9e-52204bbf5633 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:59.374300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dced163-68ca-4e2b-8f9e-52204bbf5633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-5dced163-68ca-4e2b-8f9e-52204bbf5633 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:16:59.379155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:59.380086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:16:59.380967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:59.385257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 505/1030] 10.222.0.74 () {56 vars in 1120 bytes} [Wed Aug 31 00:16:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:59.386562 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62af40-3317-43cc-bc1b-1a2ccbc128cc None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:59.405244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:59.487977 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62af40-3317-43cc-bc1b-1a2ccbc128cc None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:59.524372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1644e-7fc5-4823-9d28-a169dc6fd09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:59.524974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1644e-7fc5-4823-9d28-a169dc6fd09a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:59.525248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1644e-7fc5-4823-9d28-a169dc6fd09a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:59.525540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1644e-7fc5-4823-9d28-a169dc6fd09a None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:59.526205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1644e-7fc5-4823-9d28-a169dc6fd09a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:59.526505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1644e-7fc5-4823-9d28-a169dc6fd09a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:59.527867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1644e-7fc5-4823-9d28-a169dc6fd09a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:59.540872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 526/1031] 10.222.0.74 () {56 vars in 1115 bytes} [Wed Aug 31 00:16:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:59.542470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dced163-68ca-4e2b-8f9e-52204bbf5633 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:59.584824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:59.663702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dced163-68ca-4e2b-8f9e-52204bbf5633 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:59.699770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f6d2e-60db-4eaa-a07b-72a4a9c3d361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:59.700398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f6d2e-60db-4eaa-a07b-72a4a9c3d361 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:59.700675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f6d2e-60db-4eaa-a07b-72a4a9c3d361 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:59.700945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f6d2e-60db-4eaa-a07b-72a4a9c3d361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:59.710998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f6d2e-60db-4eaa-a07b-72a4a9c3d361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:59.713345 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f6d2e-60db-4eaa-a07b-72a4a9c3d361 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-464f6d2e-60db-4eaa-a07b-72a4a9c3d361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:16:59.728986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:16:59.730249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:16:59.731503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:16:59.731503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:16:59.731503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:16:59.733921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 506/1032] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:16:59.735892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1644e-7fc5-4823-9d28-a169dc6fd09a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:59.749046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f81523-0afb-4267-8371-3a1c705df1f2 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:59.749340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f81523-0afb-4267-8371-3a1c705df1f2 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:59.749614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f81523-0afb-4267-8371-3a1c705df1f2 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:59.753760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 507/1033] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:16:59.756106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0545e-8bd4-4cbe-a566-837a47013ffb None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:59.756340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0545e-8bd4-4cbe-a566-837a47013ffb None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:59.756620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0545e-8bd4-4cbe-a566-837a47013ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:59.777216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2af0545e-8bd4-4cbe-a566-837a47013ffb None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:16:59.778449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2af0545e-8bd4-4cbe-a566-837a47013ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:16:59.825503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:16:59.849023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 508/1034] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:16:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:16:59.849538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1644e-7fc5-4823-9d28-a169dc6fd09a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:16:59.891248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c9454-a220-46cd-939c-7a901c84372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:16:59.894290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c9454-a220-46cd-939c-7a901c84372b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:16:59.894290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c9454-a220-46cd-939c-7a901c84372b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:16:59.894290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c9454-a220-46cd-939c-7a901c84372b None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:16:59.894290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c9454-a220-46cd-939c-7a901c84372b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:16:59.894290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c9454-a220-46cd-939c-7a901c84372b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:16:59.894802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c9454-a220-46cd-939c-7a901c84372b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:16:59.907528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 527/1035] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:16:59.912933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0545e-8bd4-4cbe-a566-837a47013ffb None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:16:59.936919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:00.014966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0545e-8bd4-4cbe-a566-837a47013ffb None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:00.048730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a135c0c-b7ae-462f-96bb-a7bee00cba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:00.049393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a135c0c-b7ae-462f-96bb-a7bee00cba20 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:00.049696 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a135c0c-b7ae-462f-96bb-a7bee00cba20 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:00.049970 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a135c0c-b7ae-462f-96bb-a7bee00cba20 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:00.057682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a135c0c-b7ae-462f-96bb-a7bee00cba20 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:00.059225 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a135c0c-b7ae-462f-96bb-a7bee00cba20 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-0a135c0c-b7ae-462f-96bb-a7bee00cba20 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:17:00.070831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:00.071876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:00.077601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:00.077601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:00.077601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:17:00.077601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:17:00.077601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:17:00.077601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:17:00.077601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:17:00.077601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:17:00.077601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:17:00.077601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:00.077601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 509/1036] 10.222.0.74 () {56 vars in 1093 bytes} [Wed Aug 31 00:16:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:00.078246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c9454-a220-46cd-939c-7a901c84372b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:00.121449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a135c0c-b7ae-462f-96bb-a7bee00cba20 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:00.182858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c9454-a220-46cd-939c-7a901c84372b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:00.207519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:00.218289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b439-ccf4-44d6-965e-35efd669ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:00.218961 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b439-ccf4-44d6-965e-35efd669ab54 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:00.226342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b439-ccf4-44d6-965e-35efd669ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:00.226342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3b439-ccf4-44d6-965e-35efd669ab54 None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:00.226342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3b439-ccf4-44d6-965e-35efd669ab54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:00.226342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3b439-ccf4-44d6-965e-35efd669ab54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:00.226342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3b439-ccf4-44d6-965e-35efd669ab54 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:00.227468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a135c0c-b7ae-462f-96bb-a7bee00cba20 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:00.230748 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:00.245776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 528/1037] 10.222.0.74 () {56 vars in 1133 bytes} [Wed Aug 31 00:17:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:00.248313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b439-ccf4-44d6-965e-35efd669ab54 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:00.265402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d6501-0db8-4cf3-9e6d-b506967b8f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:00.265985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6501-0db8-4cf3-9e6d-b506967b8f28 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:00.266316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6501-0db8-4cf3-9e6d-b506967b8f28 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:00.266637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6501-0db8-4cf3-9e6d-b506967b8f28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:00.267797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d6501-0db8-4cf3-9e6d-b506967b8f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:00.269280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d6501-0db8-4cf3-9e6d-b506967b8f28 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:00.270909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 510/1038] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:00.277133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d6501-0db8-4cf3-9e6d-b506967b8f28 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:00.364703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3b439-ccf4-44d6-965e-35efd669ab54 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:00.384089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d6501-0db8-4cf3-9e6d-b506967b8f28 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:00.401298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7d8a6-fcbf-439f-b464-d411fe04109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:00.401928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7d8a6-fcbf-439f-b464-d411fe04109c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:00.402208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7d8a6-fcbf-439f-b464-d411fe04109c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:00.402485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7d8a6-fcbf-439f-b464-d411fe04109c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:00.420400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71895016-a395-41dd-b014-45b16eca792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:00.421167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71895016-a395-41dd-b014-45b16eca792f None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:00.421450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71895016-a395-41dd-b014-45b16eca792f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:00.422034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71895016-a395-41dd-b014-45b16eca792f None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:00.422686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71895016-a395-41dd-b014-45b16eca792f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:00.425084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71895016-a395-41dd-b014-45b16eca792f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:00.466280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:00.473619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7d8a6-fcbf-439f-b464-d411fe04109c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:00.475147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7d8a6-fcbf-439f-b464-d411fe04109c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:00.533727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 511/1039] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:17:00 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:17:00.593635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 529/1040] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:00 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:17:00.596582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71895016-a395-41dd-b014-45b16eca792f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:00.600942 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:00.710520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71895016-a395-41dd-b014-45b16eca792f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:00.743719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d459-0462-4867-ad60-12c445deecd6 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:00.744059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d459-0462-4867-ad60-12c445deecd6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:00.744272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d459-0462-4867-ad60-12c445deecd6 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:00.745830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 530/1041] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:17:00.751014 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6d8d-8f34-4702-bcf4-78ced663ac31 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:00.751301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6d8d-8f34-4702-bcf4-78ced663ac31 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:00.751577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6d8d-8f34-4702-bcf4-78ced663ac31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:00.752492 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75321f-062d-4f2c-8093-24a9d9200b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:00.753225 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75321f-062d-4f2c-8093-24a9d9200b62 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:00.753503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75321f-062d-4f2c-8093-24a9d9200b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:00.753807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75321f-062d-4f2c-8093-24a9d9200b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:00.765850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75321f-062d-4f2c-8093-24a9d9200b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:00.767490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75321f-062d-4f2c-8093-24a9d9200b62 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:00.771828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-810f6d8d-8f34-4702-bcf4-78ced663ac31 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:00.773029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-810f6d8d-8f34-4702-bcf4-78ced663ac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-eb75321f-062d-4f2c-8093-24a9d9200b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:17:00.785621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:00.786621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:17:00.787555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:17:00.787555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:00.787555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:00.787555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 512/1042] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:00.792318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75321f-062d-4f2c-8093-24a9d9200b62 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:00.853061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 531/1043] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:17:00.853263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:00.904863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75321f-062d-4f2c-8093-24a9d9200b62 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:00.939819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf484ba-9f7b-45d0-9c75-19d36a2fdd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:00.940054 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf484ba-9f7b-45d0-9c75-19d36a2fdd0b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:00.940294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf484ba-9f7b-45d0-9c75-19d36a2fdd0b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:00.940566 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf484ba-9f7b-45d0-9c75-19d36a2fdd0b None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:00.941206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf484ba-9f7b-45d0-9c75-19d36a2fdd0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:00.941509 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf484ba-9f7b-45d0-9c75-19d36a2fdd0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:00.942892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf484ba-9f7b-45d0-9c75-19d36a2fdd0b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:00.955796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 513/1044] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:00.961873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6d8d-8f34-4702-bcf4-78ced663ac31 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:00.990127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:01.068722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6d8d-8f34-4702-bcf4-78ced663ac31 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:01.104523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa72b0-db7a-4b23-a1a1-4a67ad0a5367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:01.105145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa72b0-db7a-4b23-a1a1-4a67ad0a5367 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:01.105418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa72b0-db7a-4b23-a1a1-4a67ad0a5367 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:01.105711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa72b0-db7a-4b23-a1a1-4a67ad0a5367 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:01.112540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa72b0-db7a-4b23-a1a1-4a67ad0a5367 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:01.114023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa72b0-db7a-4b23-a1a1-4a67ad0a5367 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:01.125463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf484ba-9f7b-45d0-9c75-19d36a2fdd0b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-c6fa72b0-db7a-4b23-a1a1-4a67ad0a5367 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:17:01.125928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:01.126931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:01.132759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:17:01.132759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:17:01.132759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:17:01.132759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:17:01.132759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:17:01.132759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:17:01.132759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:17:01.132759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:01.132759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 532/1045] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:17:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:01.132759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa72b0-db7a-4b23-a1a1-4a67ad0a5367 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:01.233913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:01.234424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf484ba-9f7b-45d0-9c75-19d36a2fdd0b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:01.250144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa72b0-db7a-4b23-a1a1-4a67ad0a5367 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:01.252058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:01.270517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf3a5-a342-45f9-a347-db10c337d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:01.271221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf3a5-a342-45f9-a347-db10c337d909 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:01.271508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf3a5-a342-45f9-a347-db10c337d909 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:01.271832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf3a5-a342-45f9-a347-db10c337d909 None admin] PATH_INFO: `/v3/services/image` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:01.272418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf3a5-a342-45f9-a347-db10c337d909 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:01.274542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf3a5-a342-45f9-a347-db10c337d909 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-0d6bf3a5-a342-45f9-a347-db10c337d909 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:01.283468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:01.284730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:01.285632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 514/1046] 10.222.0.74 () {56 vars in 1105 bytes} [Wed Aug 31 00:17:01 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:17:01.292154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf3a5-a342-45f9-a347-db10c337d909 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:01.294321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c3999-1390-4cc2-b8d5-bf62fad0e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:01.295183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c3999-1390-4cc2-b8d5-bf62fad0e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:01.295459 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c3999-1390-4cc2-b8d5-bf62fad0e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:01.295726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c3999-1390-4cc2-b8d5-bf62fad0e9f4 None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:01.296692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c3999-1390-4cc2-b8d5-bf62fad0e9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:01.296692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c3999-1390-4cc2-b8d5-bf62fad0e9f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:01.298152 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c3999-1390-4cc2-b8d5-bf62fad0e9f4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:01.315122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 533/1047] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:01.316096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c3999-1390-4cc2-b8d5-bf62fad0e9f4 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:01.403015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf3a5-a342-45f9-a347-db10c337d909 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:01.429461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c3999-1390-4cc2-b8d5-bf62fad0e9f4 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:01.441862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441b356-a44e-4c2f-8d54-674298bc9b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:01.442486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441b356-a44e-4c2f-8d54-674298bc9b7e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:01.442767 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441b356-a44e-4c2f-8d54-674298bc9b7e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:01.443043 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441b356-a44e-4c2f-8d54-674298bc9b7e None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:01.443738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441b356-a44e-4c2f-8d54-674298bc9b7e None admin] RBAC: Adding query filter params (name=image) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:01.444048 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441b356-a44e-4c2f-8d54-674298bc9b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:01.445992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441b356-a44e-4c2f-8d54-674298bc9b7e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:01.452180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 515/1048] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:01.457549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441b356-a44e-4c2f-8d54-674298bc9b7e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:01.468168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07663fa1-f1d2-48b5-bc5d-2dbf910c4c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:01.468774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07663fa1-f1d2-48b5-bc5d-2dbf910c4c6b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:01.469053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07663fa1-f1d2-48b5-bc5d-2dbf910c4c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:01.469325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07663fa1-f1d2-48b5-bc5d-2dbf910c4c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:01.470075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07663fa1-f1d2-48b5-bc5d-2dbf910c4c6b None admin] RBAC: Adding query filter params (role.id=00a939dc02584f029bd94cbe9018cc30, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=90147848fe604ca9912d10a214a45227) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:01.470383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07663fa1-f1d2-48b5-bc5d-2dbf910c4c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:01.471881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07663fa1-f1d2-48b5-bc5d-2dbf910c4c6b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:01.477787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 534/1049] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:17:01 2022] GET /identity/v3/role_assignments?user.id=90147848fe604ca9912d10a214a45227&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=00a939dc02584f029bd94cbe9018cc30 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:01.513658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:01.575507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441b356-a44e-4c2f-8d54-674298bc9b7e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:01.611963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe804295-94d9-45b5-8d01-10cf24a911a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:01.612580 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe804295-94d9-45b5-8d01-10cf24a911a8 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:01.612860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe804295-94d9-45b5-8d01-10cf24a911a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:01.613128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe804295-94d9-45b5-8d01-10cf24a911a8 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:01.613828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe804295-94d9-45b5-8d01-10cf24a911a8 None admin] RBAC: Adding query filter params (type=image) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:01.614131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe804295-94d9-45b5-8d01-10cf24a911a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:01.615506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe804295-94d9-45b5-8d01-10cf24a911a8 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:01.623669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 516/1050] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:01.629617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07663fa1-f1d2-48b5-bc5d-2dbf910c4c6b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:01.643729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:01.764388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07663fa1-f1d2-48b5-bc5d-2dbf910c4c6b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:01.799558 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5647a3e-ce73-49d5-b331-3322122e3835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:01.800532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647a3e-ce73-49d5-b331-3322122e3835 None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:01.801010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647a3e-ce73-49d5-b331-3322122e3835 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:01.801480 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5647a3e-ce73-49d5-b331-3322122e3835 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:01.802385 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5647a3e-ce73-49d5-b331-3322122e3835 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:01.804011 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5647a3e-ce73-49d5-b331-3322122e3835 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:01.949608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 535/1051] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:17:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:17:02.536796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa259-48eb-4b2a-bea0-c3549d66b8ea None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:02.537350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa259-48eb-4b2a-bea0-c3549d66b8ea None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:02.537350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa259-48eb-4b2a-bea0-c3549d66b8ea None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:02.538758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 517/1052] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:02.544916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f5ee-7ac5-4d18-adf4-bc803ac5de35 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:02.545345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f5ee-7ac5-4d18-adf4-bc803ac5de35 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:02.545523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f5ee-7ac5-4d18-adf4-bc803ac5de35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:02.565515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-bfb9f5ee-7ac5-4d18-adf4-bc803ac5de35 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:02.566755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bfb9f5ee-7ac5-4d18-adf4-bc803ac5de35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:02.629866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:02.644171 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 536/1053] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:02.914832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa259-48eb-4b2a-bea0-c3549d66b8ea None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.028905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa259-48eb-4b2a-bea0-c3549d66b8ea None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.038755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:03.067542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6c5db-4f95-4351-abf6-c06004f51693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.068184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6c5db-4f95-4351-abf6-c06004f51693 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.068467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6c5db-4f95-4351-abf6-c06004f51693 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.068741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6c5db-4f95-4351-abf6-c06004f51693 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.079628 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6c5db-4f95-4351-abf6-c06004f51693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-b1d6c5db-4f95-4351-abf6-c06004f51693 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:17:03.084438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:03.085349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:03.086307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:03.089892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 518/1054] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:03.091755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9f5ee-7ac5-4d18-adf4-bc803ac5de35 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.194838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9f5ee-7ac5-4d18-adf4-bc803ac5de35 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.228929 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb75858-0187-4485-966d-4cabb71d3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.229535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb75858-0187-4485-966d-4cabb71d3c34 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.229845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb75858-0187-4485-966d-4cabb71d3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.230117 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb75858-0187-4485-966d-4cabb71d3c34 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.230778 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb75858-0187-4485-966d-4cabb71d3c34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:03.231079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb75858-0187-4485-966d-4cabb71d3c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:03.232438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb75858-0187-4485-966d-4cabb71d3c34 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:03.240821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 537/1055] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:03.247075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6c5db-4f95-4351-abf6-c06004f51693 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.351596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6c5db-4f95-4351-abf6-c06004f51693 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.385679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2ac7-dcb6-4e65-b6cf-a9bad808ba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.386316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2ac7-dcb6-4e65-b6cf-a9bad808ba2e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.386599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2ac7-dcb6-4e65-b6cf-a9bad808ba2e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.386872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f2ac7-dcb6-4e65-b6cf-a9bad808ba2e None admin] PATH_INFO: `/v3/users/2457f222b0234b6bbf8cce835553c2a2` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.389887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7d80b-0dce-46dc-8e22-a3e8b2b4e27c None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.390173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7d80b-0dce-46dc-8e22-a3e8b2b4e27c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.390476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7d80b-0dce-46dc-8e22-a3e8b2b4e27c None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.391969 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 538/1056] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:03.400059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3439-6b9d-4a97-bef2-dc6fc6302d0e None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.400425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3439-6b9d-4a97-bef2-dc6fc6302d0e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.400816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3439-6b9d-4a97-bef2-dc6fc6302d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.403184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f2ac7-dcb6-4e65-b6cf-a9bad808ba2e None admin] RBAC: Authorizing `identity:get_user(user_id=2457f222b0234b6bbf8cce835553c2a2)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:03.404832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f2ac7-dcb6-4e65-b6cf-a9bad808ba2e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:03.407049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 519/1057] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:03 2022] GET /identity/v3/users/2457f222b0234b6bbf8cce835553c2a2 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:03.412564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2ac7-dcb6-4e65-b6cf-a9bad808ba2e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.420968 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-e73c3439-6b9d-4a97-bef2-dc6fc6302d0e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:03.422188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e73c3439-6b9d-4a97-bef2-dc6fc6302d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:03.442125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:03.478673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:03.509868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 539/1058] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:17:03.518888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f2ac7-dcb6-4e65-b6cf-a9bad808ba2e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.555534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd439273-fce5-4ac7-8da1-67133ee98b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.556197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd439273-fce5-4ac7-8da1-67133ee98b42 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.556465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd439273-fce5-4ac7-8da1-67133ee98b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.556742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd439273-fce5-4ac7-8da1-67133ee98b42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.624345 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd439273-fce5-4ac7-8da1-67133ee98b42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:03.625817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd439273-fce5-4ac7-8da1-67133ee98b42 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:03.652069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:03.730718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 520/1059] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:17:03.736172 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c3439-6b9d-4a97-bef2-dc6fc6302d0e None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.774511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd439273-fce5-4ac7-8da1-67133ee98b42 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.844891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c3439-6b9d-4a97-bef2-dc6fc6302d0e None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.882184 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928c848-60de-40bb-97b6-41102e61647e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.883672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928c848-60de-40bb-97b6-41102e61647e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.884310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928c848-60de-40bb-97b6-41102e61647e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.885194 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928c848-60de-40bb-97b6-41102e61647e None admin] PATH_INFO: `/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.886479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928c848-60de-40bb-97b6-41102e61647e None admin] RBAC: Authorizing `identity:get_project(project_id=551aa079fdec46b3be4ebc7fe79b71b4)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:03.887923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928c848-60de-40bb-97b6-41102e61647e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:03.894413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 540/1060] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:03 2022] GET /identity/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:03.894560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd439273-fce5-4ac7-8da1-67133ee98b42 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:03.896451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928c848-60de-40bb-97b6-41102e61647e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:03.934024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:03.942666 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be3c69-9b21-40c1-a1e0-db52ebdb7c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:03.943304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be3c69-9b21-40c1-a1e0-db52ebdb7c45 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.943588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be3c69-9b21-40c1-a1e0-db52ebdb7c45 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.943863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be3c69-9b21-40c1-a1e0-db52ebdb7c45 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.955172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be3c69-9b21-40c1-a1e0-db52ebdb7c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-f7be3c69-9b21-40c1-a1e0-db52ebdb7c45 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:17:03.959945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:03.961697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:17:03.962576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:03.963729 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 521/1061] 10.222.0.74 () {56 vars in 1120 bytes} [Wed Aug 31 00:17:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:03.964803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4ddb8-c3cf-4dc0-9143-bf44aa662590 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:03.965176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4ddb8-c3cf-4dc0-9143-bf44aa662590 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:03.965674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:03.965950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4ddb8-c3cf-4dc0-9143-bf44aa662590 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:03.967253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 522/1062] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:03.967957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4ddb8-c3cf-4dc0-9143-bf44aa662590 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.013632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928c848-60de-40bb-97b6-41102e61647e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.048340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60e35a-a2e2-49bd-91a1-aa9356b0f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.048938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60e35a-a2e2-49bd-91a1-aa9356b0f5cc None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.049207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60e35a-a2e2-49bd-91a1-aa9356b0f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.049474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60e35a-a2e2-49bd-91a1-aa9356b0f5cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.050219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60e35a-a2e2-49bd-91a1-aa9356b0f5cc None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=551aa079fdec46b3be4ebc7fe79b71b4, user.id=2457f222b0234b6bbf8cce835553c2a2) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:04.050535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60e35a-a2e2-49bd-91a1-aa9356b0f5cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.051952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60e35a-a2e2-49bd-91a1-aa9356b0f5cc None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.057375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 541/1063] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:17:03 2022] GET /identity/v3/role_assignments?user.id=2457f222b0234b6bbf8cce835553c2a2&scope.project.id=551aa079fdec46b3be4ebc7fe79b71b4&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:04.058552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330e312-8516-49e4-bcee-8d0c3f64d869 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.058830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330e312-8516-49e4-bcee-8d0c3f64d869 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.059100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330e312-8516-49e4-bcee-8d0c3f64d869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.078468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-e330e312-8516-49e4-bcee-8d0c3f64d869 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:04.079771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e330e312-8516-49e4-bcee-8d0c3f64d869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:04.082354 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4ddb8-c3cf-4dc0-9143-bf44aa662590 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.125233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3b9ce-52c3-4fca-a11e-f80de53209dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.125892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b9ce-52c3-4fca-a11e-f80de53209dd None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.126170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b9ce-52c3-4fca-a11e-f80de53209dd None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.126438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3b9ce-52c3-4fca-a11e-f80de53209dd None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.127608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3b9ce-52c3-4fca-a11e-f80de53209dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:04.127608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3b9ce-52c3-4fca-a11e-f80de53209dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.128935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3b9ce-52c3-4fca-a11e-f80de53209dd None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.141631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 523/1064] 10.222.0.74 () {56 vars in 1115 bytes} [Wed Aug 31 00:17:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:04.145978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3b9ce-52c3-4fca-a11e-f80de53209dd None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.159481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 542/1065] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:04.204217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:04.255877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3b9ce-52c3-4fca-a11e-f80de53209dd None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.290103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d206b-1adf-4c20-a52c-4ba21591ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.290655 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d206b-1adf-4c20-a52c-4ba21591ee18 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.290940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d206b-1adf-4c20-a52c-4ba21591ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.291213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d206b-1adf-4c20-a52c-4ba21591ee18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.302994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d206b-1adf-4c20-a52c-4ba21591ee18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.304441 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d206b-1adf-4c20-a52c-4ba21591ee18 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-364d206b-1adf-4c20-a52c-4ba21591ee18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:17:04.319265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:04.320846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:17:04.322259 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:17:04.322259 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:04.322259 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:04.322259 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 524/1066] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:17:04.327118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330e312-8516-49e4-bcee-8d0c3f64d869 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.376387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:04.429978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330e312-8516-49e4-bcee-8d0c3f64d869 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.441830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d206b-1adf-4c20-a52c-4ba21591ee18 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.468130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dd9c7-6cca-4e4e-8e0e-d452fb752d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.468744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dd9c7-6cca-4e4e-8e0e-d452fb752d3f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.469021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dd9c7-6cca-4e4e-8e0e-d452fb752d3f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.469289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dd9c7-6cca-4e4e-8e0e-d452fb752d3f None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.469962 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dd9c7-6cca-4e4e-8e0e-d452fb752d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:04.470261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dd9c7-6cca-4e4e-8e0e-d452fb752d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.471628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dd9c7-6cca-4e4e-8e0e-d452fb752d3f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.488022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 543/1067] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:04.490338 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dd9c7-6cca-4e4e-8e0e-d452fb752d3f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.554235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:04.557523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d206b-1adf-4c20-a52c-4ba21591ee18 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.596182 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aa83e-754d-4522-ab3d-544624dd4ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.597086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aa83e-754d-4522-ab3d-544624dd4ac4 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.597553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aa83e-754d-4522-ab3d-544624dd4ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.598041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aa83e-754d-4522-ab3d-544624dd4ac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.601512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dd9c7-6cca-4e4e-8e0e-d452fb752d3f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.609087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:04.639516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce90ee-7aa2-4ba9-8ca5-ced7ec82fe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.640688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce90ee-7aa2-4ba9-8ca5-ced7ec82fe7a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.640971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce90ee-7aa2-4ba9-8ca5-ced7ec82fe7a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.641275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce90ee-7aa2-4ba9-8ca5-ced7ec82fe7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.649918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce90ee-7aa2-4ba9-8ca5-ced7ec82fe7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.651387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce90ee-7aa2-4ba9-8ca5-ced7ec82fe7a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-74ce90ee-7aa2-4ba9-8ca5-ced7ec82fe7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:17:04.664573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:04.665627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:04.666613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:04.666613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:04.666613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:17:04.666613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:17:04.666613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:17:04.666613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:17:04.666613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:17:04.666613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:17:04.666613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:17:04.666613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:04.666613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 544/1068] 10.222.0.74 () {56 vars in 1093 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:17:04.671934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce90ee-7aa2-4ba9-8ca5-ced7ec82fe7a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.679530 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4aa83e-754d-4522-ab3d-544624dd4ac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.681904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4aa83e-754d-4522-ab3d-544624dd4ac4 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.780082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce90ee-7aa2-4ba9-8ca5-ced7ec82fe7a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.781068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:04.785633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 525/1069] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:17:04.802242 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aa83e-754d-4522-ab3d-544624dd4ac4 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.817870 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca313e7-9b2b-463b-9813-f3ca14539536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.818458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca313e7-9b2b-463b-9813-f3ca14539536 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.818738 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca313e7-9b2b-463b-9813-f3ca14539536 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.819014 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca313e7-9b2b-463b-9813-f3ca14539536 None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.819862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca313e7-9b2b-463b-9813-f3ca14539536 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:04.820041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca313e7-9b2b-463b-9813-f3ca14539536 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.821641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca313e7-9b2b-463b-9813-f3ca14539536 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.841217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 545/1070] 10.222.0.74 () {56 vars in 1133 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:04.846640 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca313e7-9b2b-463b-9813-f3ca14539536 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:04.874797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:04.907375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4aa83e-754d-4522-ab3d-544624dd4ac4 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.943380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6b83-8b3d-4c45-b206-79280b745cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:04.944018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6b83-8b3d-4c45-b206-79280b745cd9 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:04.944300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6b83-8b3d-4c45-b206-79280b745cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:04.944565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6b83-8b3d-4c45-b206-79280b745cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:04.955062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da6b83-8b3d-4c45-b206-79280b745cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:04.956519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da6b83-8b3d-4c45-b206-79280b745cd9 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:04.962711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca313e7-9b2b-463b-9813-f3ca14539536 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-10da6b83-8b3d-4c45-b206-79280b745cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:17:04.972379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:04.973377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:17:04.974741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:17:04.974741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:04.974741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:04.974741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 526/1071] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:17:04.981037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6b83-8b3d-4c45-b206-79280b745cd9 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:05.003939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dd98d-4da2-4b48-b390-282af41a4bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:05.004581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd98d-4da2-4b48-b390-282af41a4bcd None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.004862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd98d-4da2-4b48-b390-282af41a4bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.005134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dd98d-4da2-4b48-b390-282af41a4bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.020469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dd98d-4da2-4b48-b390-282af41a4bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:05.021954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dd98d-4da2-4b48-b390-282af41a4bcd None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-7d6dd98d-4da2-4b48-b390-282af41a4bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:17:05.038074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:05.039687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:17:05.040604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:17:05.040604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:05.040604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:05.040779 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:05.041905 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 546/1072] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:17:05.046223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dd98d-4da2-4b48-b390-282af41a4bcd None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:05.095572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6b83-8b3d-4c45-b206-79280b745cd9 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:05.131149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:05.136031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58a91d-fa69-46fb-ac9d-1c5e21545957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:05.136647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a91d-fa69-46fb-ac9d-1c5e21545957 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.136927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a91d-fa69-46fb-ac9d-1c5e21545957 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.137407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58a91d-fa69-46fb-ac9d-1c5e21545957 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.137865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58a91d-fa69-46fb-ac9d-1c5e21545957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:05.138170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58a91d-fa69-46fb-ac9d-1c5e21545957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:05.139532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58a91d-fa69-46fb-ac9d-1c5e21545957 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:05.156995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dd98d-4da2-4b48-b390-282af41a4bcd None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:05.161953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 527/1073] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:05.197141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133d99b-6f67-42d7-9b63-530dbc067b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:05.197793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133d99b-6f67-42d7-9b63-530dbc067b7a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.198077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133d99b-6f67-42d7-9b63-530dbc067b7a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.198410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133d99b-6f67-42d7-9b63-530dbc067b7a None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.199083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133d99b-6f67-42d7-9b63-530dbc067b7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:05.199389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133d99b-6f67-42d7-9b63-530dbc067b7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:05.200806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133d99b-6f67-42d7-9b63-530dbc067b7a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:05.214839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 547/1074] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:05.220645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58a91d-fa69-46fb-ac9d-1c5e21545957 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:05.334902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58a91d-fa69-46fb-ac9d-1c5e21545957 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:05.350409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:05.372286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4fa10-d3be-4d52-ae42-32ef30a309e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:05.372933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4fa10-d3be-4d52-ae42-32ef30a309e2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.373224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4fa10-d3be-4d52-ae42-32ef30a309e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.373496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4fa10-d3be-4d52-ae42-32ef30a309e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.381116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4fa10-d3be-4d52-ae42-32ef30a309e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:05.384449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4fa10-d3be-4d52-ae42-32ef30a309e2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-37c4fa10-d3be-4d52-ae42-32ef30a309e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:17:05.396085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:05.397015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:05.398073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:17:05.398073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:17:05.398073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:17:05.398073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:17:05.398073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:17:05.398073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:17:05.398073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:17:05.398073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:05.398073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 528/1075] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:17:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:05.403884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133d99b-6f67-42d7-9b63-530dbc067b7a None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:05.513905 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133d99b-6f67-42d7-9b63-530dbc067b7a None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:05.548425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3553e5-9a94-4914-af22-e9b8acbdcc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:05.549027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3553e5-9a94-4914-af22-e9b8acbdcc15 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.549304 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3553e5-9a94-4914-af22-e9b8acbdcc15 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.549599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3553e5-9a94-4914-af22-e9b8acbdcc15 None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.550350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3553e5-9a94-4914-af22-e9b8acbdcc15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:05.550657 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3553e5-9a94-4914-af22-e9b8acbdcc15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:05.552079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3553e5-9a94-4914-af22-e9b8acbdcc15 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:05.554620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:05.563899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 548/1076] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:17:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:05.571063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4fa10-d3be-4d52-ae42-32ef30a309e2 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:05.673797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4fa10-d3be-4d52-ae42-32ef30a309e2 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:05.718445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55fc04-0cee-40d4-91b8-ad9db18e7d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:05.719111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55fc04-0cee-40d4-91b8-ad9db18e7d8c None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.719392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55fc04-0cee-40d4-91b8-ad9db18e7d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.719667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55fc04-0cee-40d4-91b8-ad9db18e7d8c None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/90147848fe604ca9912d10a214a45227/roles/00a939dc02584f029bd94cbe9018cc30` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.721996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55fc04-0cee-40d4-91b8-ad9db18e7d8c None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=90147848fe604ca9912d10a214a45227, role_id=00a939dc02584f029bd94cbe9018cc30)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:05.723424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55fc04-0cee-40d4-91b8-ad9db18e7d8c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:05.794551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 529/1077] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:17:05 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/90147848fe604ca9912d10a214a45227/roles/00a939dc02584f029bd94cbe9018cc30 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:05.972375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444453f8-ff07-4034-8993-76397337c267 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.972877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444453f8-ff07-4034-8993-76397337c267 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.972877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444453f8-ff07-4034-8993-76397337c267 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:05.974201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 549/1078] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:05.980613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0a500-4051-4b10-99f0-86de91c45791 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:05.980924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0a500-4051-4b10-99f0-86de91c45791 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:05.981188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0a500-4051-4b10-99f0-86de91c45791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.000370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-b8d0a500-4051-4b10-99f0-86de91c45791 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:06.001670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b8d0a500-4051-4b10-99f0-86de91c45791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:06.027934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:06.071274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 530/1079] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:06.337587 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444453f8-ff07-4034-8993-76397337c267 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.438341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444453f8-ff07-4034-8993-76397337c267 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.472044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf9cef-9c19-4c68-8432-e1377bd5dfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.472663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf9cef-9c19-4c68-8432-e1377bd5dfc2 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.472944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf9cef-9c19-4c68-8432-e1377bd5dfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.473220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf9cef-9c19-4c68-8432-e1377bd5dfc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.483685 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf9cef-9c19-4c68-8432-e1377bd5dfc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-80cf9cef-9c19-4c68-8432-e1377bd5dfc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:17:06.488485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:06.489471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:06.490396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 550/1080] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:06.495667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0a500-4051-4b10-99f0-86de91c45791 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.596888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0a500-4051-4b10-99f0-86de91c45791 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.631018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29eba4-1417-4caa-90a0-1a11b15f70d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.631640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29eba4-1417-4caa-90a0-1a11b15f70d0 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.631928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29eba4-1417-4caa-90a0-1a11b15f70d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.632205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29eba4-1417-4caa-90a0-1a11b15f70d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.633102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29eba4-1417-4caa-90a0-1a11b15f70d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:06.633642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29eba4-1417-4caa-90a0-1a11b15f70d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:06.635025 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29eba4-1417-4caa-90a0-1a11b15f70d0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:06.643257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 531/1081] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:06.649655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf9cef-9c19-4c68-8432-e1377bd5dfc2 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.707271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:06.750854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf9cef-9c19-4c68-8432-e1377bd5dfc2 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:06.784932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6b3aa-a763-476c-ad2f-8bd9686463d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:06.785564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b3aa-a763-476c-ad2f-8bd9686463d1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:06.785852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b3aa-a763-476c-ad2f-8bd9686463d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:06.786121 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b3aa-a763-476c-ad2f-8bd9686463d1 None admin] PATH_INFO: `/v3/users/2457f222b0234b6bbf8cce835553c2a2` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:06.787233 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6b3aa-a763-476c-ad2f-8bd9686463d1 None admin] RBAC: Authorizing `identity:get_user(user_id=2457f222b0234b6bbf8cce835553c2a2)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:06.788757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6b3aa-a763-476c-ad2f-8bd9686463d1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:06.790406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 551/1082] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:06 2022] GET /identity/v3/users/2457f222b0234b6bbf8cce835553c2a2 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:06.796384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29eba4-1417-4caa-90a0-1a11b15f70d0 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:06.822923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:06.981520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29eba4-1417-4caa-90a0-1a11b15f70d0 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:07.015150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c95c7-2b14-4049-a5df-778472413613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:07.015776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c95c7-2b14-4049-a5df-778472413613 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:07.016061 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c95c7-2b14-4049-a5df-778472413613 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:07.016339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c95c7-2b14-4049-a5df-778472413613 None admin] PATH_INFO: `/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:07.017457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c95c7-2b14-4049-a5df-778472413613 None admin] RBAC: Authorizing `identity:get_project(project_id=551aa079fdec46b3be4ebc7fe79b71b4)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:07.018945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c95c7-2b14-4049-a5df-778472413613 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:07.020587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 532/1083] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:06 2022] GET /identity/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4 => generated 311 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:07.026637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6b3aa-a763-476c-ad2f-8bd9686463d1 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:07.125802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6b3aa-a763-476c-ad2f-8bd9686463d1 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:07.149472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:07.159827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88261b-3061-44be-8dac-6e244231ddc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:07.161017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88261b-3061-44be-8dac-6e244231ddc5 None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:07.161017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88261b-3061-44be-8dac-6e244231ddc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:07.161017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88261b-3061-44be-8dac-6e244231ddc5 None admin] PATH_INFO: `/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4/users/2457f222b0234b6bbf8cce835553c2a2/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:07.162930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88261b-3061-44be-8dac-6e244231ddc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=551aa079fdec46b3be4ebc7fe79b71b4, user_id=2457f222b0234b6bbf8cce835553c2a2, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:07.165241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88261b-3061-44be-8dac-6e244231ddc5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:07.237267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 552/1084] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:17:07 2022] PUT /identity/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4/users/2457f222b0234b6bbf8cce835553c2a2/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:07.715758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ab56-f9a6-495c-aaa2-f6d9fdaec8fb None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:07.716291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ab56-f9a6-495c-aaa2-f6d9fdaec8fb None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:07.716291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ab56-f9a6-495c-aaa2-f6d9fdaec8fb None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:07.717836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 533/1085] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:07.725117 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b33d5-70f6-4f82-96ab-83fb86550e5e None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:07.725409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b33d5-70f6-4f82-96ab-83fb86550e5e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:07.725714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b33d5-70f6-4f82-96ab-83fb86550e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:07.744325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-246b33d5-70f6-4f82-96ab-83fb86550e5e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:07.745597 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-246b33d5-70f6-4f82-96ab-83fb86550e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:07.811841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 553/1086] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:08.088839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ab56-f9a6-495c-aaa2-f6d9fdaec8fb None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:08.180286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:08.190641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ab56-f9a6-495c-aaa2-f6d9fdaec8fb None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:08.225388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdceb1f9-1940-41fe-8b97-2de42a711a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:08.226059 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceb1f9-1940-41fe-8b97-2de42a711a9f None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:08.226844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceb1f9-1940-41fe-8b97-2de42a711a9f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:08.227126 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdceb1f9-1940-41fe-8b97-2de42a711a9f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:08.237608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdceb1f9-1940-41fe-8b97-2de42a711a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-bdceb1f9-1940-41fe-8b97-2de42a711a9f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:17:08.243784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:08.245370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:08.246313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 534/1087] 10.222.0.74 () {56 vars in 1120 bytes} [Wed Aug 31 00:17:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:08.253272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b33d5-70f6-4f82-96ab-83fb86550e5e None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:08.366540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b33d5-70f6-4f82-96ab-83fb86550e5e None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:08.380140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:08.400634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821db783-2201-4de9-931d-c6cb161e81a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:08.401227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821db783-2201-4de9-931d-c6cb161e81a0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:08.401501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821db783-2201-4de9-931d-c6cb161e81a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:08.401801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821db783-2201-4de9-931d-c6cb161e81a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:08.402455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821db783-2201-4de9-931d-c6cb161e81a0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:08.402752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821db783-2201-4de9-931d-c6cb161e81a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:08.404110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821db783-2201-4de9-931d-c6cb161e81a0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:08.412369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 554/1088] 10.222.0.74 () {56 vars in 1115 bytes} [Wed Aug 31 00:17:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:08.417813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdceb1f9-1940-41fe-8b97-2de42a711a9f None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:08.517601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdceb1f9-1940-41fe-8b97-2de42a711a9f None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:08.552612 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d4f61-da4e-4082-a569-1466dc4f1dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:08.553235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4f61-da4e-4082-a569-1466dc4f1dad None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:08.553516 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4f61-da4e-4082-a569-1466dc4f1dad None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:08.553813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4f61-da4e-4082-a569-1466dc4f1dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:08.575247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d4f61-da4e-4082-a569-1466dc4f1dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:08.576720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d4f61-da4e-4082-a569-1466dc4f1dad None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-026d4f61-da4e-4082-a569-1466dc4f1dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:17:08.591985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:08.593079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:17:08.594159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:17:08.594159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:08.594159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:08.594159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 535/1089] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:17:08.598965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821db783-2201-4de9-931d-c6cb161e81a0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:08.716440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821db783-2201-4de9-931d-c6cb161e81a0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:08.749827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73459269-9ff8-4fe4-acfd-8966965638b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:08.750426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73459269-9ff8-4fe4-acfd-8966965638b6 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:08.750703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73459269-9ff8-4fe4-acfd-8966965638b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:08.750994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73459269-9ff8-4fe4-acfd-8966965638b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:08.751634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73459269-9ff8-4fe4-acfd-8966965638b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:08.751933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73459269-9ff8-4fe4-acfd-8966965638b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:08.753295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73459269-9ff8-4fe4-acfd-8966965638b6 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:08.765725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 555/1090] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:08.771274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d4f61-da4e-4082-a569-1466dc4f1dad None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:08.775159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:08.872148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d4f61-da4e-4082-a569-1466dc4f1dad None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:08.911762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995a5d1-a665-4409-9fa4-a7c13f4c144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:08.912398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a5d1-a665-4409-9fa4-a7c13f4c144c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:08.912680 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a5d1-a665-4409-9fa4-a7c13f4c144c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:08.912957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995a5d1-a665-4409-9fa4-a7c13f4c144c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:08.921272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995a5d1-a665-4409-9fa4-a7c13f4c144c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:08.922753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995a5d1-a665-4409-9fa4-a7c13f4c144c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-f995a5d1-a665-4409-9fa4-a7c13f4c144c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:17:08.934972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:08.936016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:08.937007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:08.937007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:08.937007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:17:08.937007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:17:08.937007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:17:08.937007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:17:08.937007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:17:08.937007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:17:08.937007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 00:17:08.937007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:08.937007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 536/1091] 10.222.0.74 () {56 vars in 1093 bytes} [Wed Aug 31 00:17:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:17:08.942070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73459269-9ff8-4fe4-acfd-8966965638b6 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:08.979230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:09.070261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73459269-9ff8-4fe4-acfd-8966965638b6 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.105722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417a665-c47d-453d-b882-fb4fb38525b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.106322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417a665-c47d-453d-b882-fb4fb38525b3 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.106601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417a665-c47d-453d-b882-fb4fb38525b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.106871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417a665-c47d-453d-b882-fb4fb38525b3 None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.107594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417a665-c47d-453d-b882-fb4fb38525b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:09.107898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417a665-c47d-453d-b882-fb4fb38525b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:09.109319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417a665-c47d-453d-b882-fb4fb38525b3 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:09.128562 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 556/1092] 10.222.0.74 () {56 vars in 1133 bytes} [Wed Aug 31 00:17:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:09.134497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995a5d1-a665-4409-9fa4-a7c13f4c144c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.158340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5b60c-25e5-4cc7-964a-ca35a2ffc741 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.158622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5b60c-25e5-4cc7-964a-ca35a2ffc741 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.158902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5b60c-25e5-4cc7-964a-ca35a2ffc741 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.160222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 557/1093] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:09.165663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61406-4b3c-46dd-b615-df6f0025bc1d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.165949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61406-4b3c-46dd-b615-df6f0025bc1d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.166228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd61406-4b3c-46dd-b615-df6f0025bc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.184866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-fdd61406-4b3c-46dd-b615-df6f0025bc1d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:09.186109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-fdd61406-4b3c-46dd-b615-df6f0025bc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:09.199135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:09.237522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995a5d1-a665-4409-9fa4-a7c13f4c144c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.252358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 558/1094] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:17:09.272091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318edbfd-d0ba-47fb-9d66-f8e4425a7f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.272704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318edbfd-d0ba-47fb-9d66-f8e4425a7f4e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.272987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318edbfd-d0ba-47fb-9d66-f8e4425a7f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.273891 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318edbfd-d0ba-47fb-9d66-f8e4425a7f4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.339705 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318edbfd-d0ba-47fb-9d66-f8e4425a7f4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:09.341159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318edbfd-d0ba-47fb-9d66-f8e4425a7f4e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:09.412943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:09.452916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 537/1095] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:17:09.458732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd61406-4b3c-46dd-b615-df6f0025bc1d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.482849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:09.528694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318edbfd-d0ba-47fb-9d66-f8e4425a7f4e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.556729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd61406-4b3c-46dd-b615-df6f0025bc1d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.590407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079074a2-897a-4097-913f-782ef534c1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.591029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079074a2-897a-4097-913f-782ef534c1c1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.591308 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079074a2-897a-4097-913f-782ef534c1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.591576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079074a2-897a-4097-913f-782ef534c1c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.601286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079074a2-897a-4097-913f-782ef534c1c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:09.602766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079074a2-897a-4097-913f-782ef534c1c1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-079074a2-897a-4097-913f-782ef534c1c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:17:09.619538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:09.621095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:17:09.622469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:17:09.622469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:17:09.622469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:09.622469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 559/1096] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:17:09.626288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079074a2-897a-4097-913f-782ef534c1c1 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.630389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318edbfd-d0ba-47fb-9d66-f8e4425a7f4e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.665560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c28459-b227-434b-b14b-e17ee0289aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.666236 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c28459-b227-434b-b14b-e17ee0289aa9 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.666519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c28459-b227-434b-b14b-e17ee0289aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.666791 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c28459-b227-434b-b14b-e17ee0289aa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.677385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c28459-b227-434b-b14b-e17ee0289aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-c1c28459-b227-434b-b14b-e17ee0289aa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:17:09.683199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:09.684205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:09.685811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 538/1097] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:17:09.690323 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c28459-b227-434b-b14b-e17ee0289aa9 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.704357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:09.718115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:09.728915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079074a2-897a-4097-913f-782ef534c1c1 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.771971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5895275-8f8f-45be-8ab6-2a504565dfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.772561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5895275-8f8f-45be-8ab6-2a504565dfbb None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.772839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5895275-8f8f-45be-8ab6-2a504565dfbb None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.773145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5895275-8f8f-45be-8ab6-2a504565dfbb None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.773835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5895275-8f8f-45be-8ab6-2a504565dfbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:09.774134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5895275-8f8f-45be-8ab6-2a504565dfbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:09.775517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5895275-8f8f-45be-8ab6-2a504565dfbb None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:09.787200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 560/1098] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:09.793250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5895275-8f8f-45be-8ab6-2a504565dfbb None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.809527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c28459-b227-434b-b14b-e17ee0289aa9 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.843592 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fc39d-ad0c-436c-bae5-76144e70b678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.844196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fc39d-ad0c-436c-bae5-76144e70b678 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.844479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fc39d-ad0c-436c-bae5-76144e70b678 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.844753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fc39d-ad0c-436c-bae5-76144e70b678 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.845414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fc39d-ad0c-436c-bae5-76144e70b678 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:09.845794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fc39d-ad0c-436c-bae5-76144e70b678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:09.847194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184fc39d-ad0c-436c-bae5-76144e70b678 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:09.855916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 539/1099] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:09.861834 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fc39d-ad0c-436c-bae5-76144e70b678 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.895403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5895275-8f8f-45be-8ab6-2a504565dfbb None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.931045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154fea2-527d-4563-bcad-edfa3863b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:09.931672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154fea2-527d-4563-bcad-edfa3863b93e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:09.931950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154fea2-527d-4563-bcad-edfa3863b93e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:09.932224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154fea2-527d-4563-bcad-edfa3863b93e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:09.934918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:09.939597 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154fea2-527d-4563-bcad-edfa3863b93e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:09.944453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154fea2-527d-4563-bcad-edfa3863b93e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:09.947917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-3154fea2-527d-4563-bcad-edfa3863b93e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:17:09.953404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:09.954357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:09.955268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:17:09.955268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:17:09.955268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:17:09.955268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:17:09.955268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:17:09.955268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:17:09.955268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:17:09.955268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:09.955268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 561/1100] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:17:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:17:09.960356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154fea2-527d-4563-bcad-edfa3863b93e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:09.963884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fc39d-ad0c-436c-bae5-76144e70b678 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:09.999444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d166d4-5418-49cc-8d3f-d052ed98355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:10.000135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d166d4-5418-49cc-8d3f-d052ed98355a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:10.000850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d166d4-5418-49cc-8d3f-d052ed98355a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:10.001135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d166d4-5418-49cc-8d3f-d052ed98355a None admin] PATH_INFO: `/v3/users/2457f222b0234b6bbf8cce835553c2a2` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:10.002312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d166d4-5418-49cc-8d3f-d052ed98355a None admin] RBAC: Authorizing `identity:get_user(user_id=2457f222b0234b6bbf8cce835553c2a2)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:10.003758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d166d4-5418-49cc-8d3f-d052ed98355a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:10.005354 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 540/1101] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:09 2022] GET /identity/v3/users/2457f222b0234b6bbf8cce835553c2a2 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:10.011990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d166d4-5418-49cc-8d3f-d052ed98355a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:10.076674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154fea2-527d-4563-bcad-edfa3863b93e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:10.120179 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cc596-f543-41bf-818b-fa9f3ccd2eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:10.120778 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cc596-f543-41bf-818b-fa9f3ccd2eb9 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:10.121054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cc596-f543-41bf-818b-fa9f3ccd2eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:10.121322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cc596-f543-41bf-818b-fa9f3ccd2eb9 None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:10.122136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cc596-f543-41bf-818b-fa9f3ccd2eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:10.122347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cc596-f543-41bf-818b-fa9f3ccd2eb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:10.123841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cc596-f543-41bf-818b-fa9f3ccd2eb9 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:10.135341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d166d4-5418-49cc-8d3f-d052ed98355a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:10.136334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 562/1102] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:17:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:10.142384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cc596-f543-41bf-818b-fa9f3ccd2eb9 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:10.168784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069b475-956c-4082-bfe1-a4dc923bfe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:10.169387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069b475-956c-4082-bfe1-a4dc923bfe63 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:10.169965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069b475-956c-4082-bfe1-a4dc923bfe63 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:10.170237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069b475-956c-4082-bfe1-a4dc923bfe63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:10.194237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:10.200765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:10.238935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069b475-956c-4082-bfe1-a4dc923bfe63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:10.240387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069b475-956c-4082-bfe1-a4dc923bfe63 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:10.245226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cc596-f543-41bf-818b-fa9f3ccd2eb9 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:10.281587 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78448e-0f6b-4a63-a9f6-3c4b9d5d5f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:10.282201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78448e-0f6b-4a63-a9f6-3c4b9d5d5f26 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:10.282484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78448e-0f6b-4a63-a9f6-3c4b9d5d5f26 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:10.282761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78448e-0f6b-4a63-a9f6-3c4b9d5d5f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:10.283491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78448e-0f6b-4a63-a9f6-3c4b9d5d5f26 None admin] RBAC: Adding query filter params (role.id=00a939dc02584f029bd94cbe9018cc30, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=90147848fe604ca9912d10a214a45227) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:10.283805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78448e-0f6b-4a63-a9f6-3c4b9d5d5f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:10.285234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78448e-0f6b-4a63-a9f6-3c4b9d5d5f26 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:10.291874 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 563/1103] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:17:10 2022] GET /identity/v3/role_assignments?user.id=90147848fe604ca9912d10a214a45227&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=00a939dc02584f029bd94cbe9018cc30 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:10.344496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 541/1104] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:17:10.350454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78448e-0f6b-4a63-a9f6-3c4b9d5d5f26 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:10.461622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78448e-0f6b-4a63-a9f6-3c4b9d5d5f26 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:10.482393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:10.496713 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1301125-e864-476c-a47c-a1ae33aca272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:10.497337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1301125-e864-476c-a47c-a1ae33aca272 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:10.497642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1301125-e864-476c-a47c-a1ae33aca272 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:10.497916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1301125-e864-476c-a47c-a1ae33aca272 None admin] PATH_INFO: `/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:10.499018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1301125-e864-476c-a47c-a1ae33aca272 None admin] RBAC: Authorizing `identity:get_project(project_id=551aa079fdec46b3be4ebc7fe79b71b4)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:10.500436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1301125-e864-476c-a47c-a1ae33aca272 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:10.502110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 564/1105] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:10 2022] GET /identity/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:10.508408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069b475-956c-4082-bfe1-a4dc923bfe63 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:10.568081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:10.617028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069b475-956c-4082-bfe1-a4dc923bfe63 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:10.652848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea8003-b604-4996-99f9-0e84c37db226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:10.653459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea8003-b604-4996-99f9-0e84c37db226 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:10.653769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea8003-b604-4996-99f9-0e84c37db226 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:10.654047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea8003-b604-4996-99f9-0e84c37db226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:10.654777 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea8003-b604-4996-99f9-0e84c37db226 None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=551aa079fdec46b3be4ebc7fe79b71b4, user.id=2457f222b0234b6bbf8cce835553c2a2) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:10.655085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea8003-b604-4996-99f9-0e84c37db226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:10.656529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea8003-b604-4996-99f9-0e84c37db226 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:10.663001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 542/1106] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:17:10 2022] GET /identity/v3/role_assignments?user.id=2457f222b0234b6bbf8cce835553c2a2&scope.project.id=551aa079fdec46b3be4ebc7fe79b71b4&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:12.653758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3ad7f-407f-42ca-9153-7538893839f6 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:12.654334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3ad7f-407f-42ca-9153-7538893839f6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:12.654334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3ad7f-407f-42ca-9153-7538893839f6 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:12.655635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 565/1107] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:12.660761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61519-b8d1-4540-8654-dd88194a3f08 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:12.661166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61519-b8d1-4540-8654-dd88194a3f08 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:12.661322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61519-b8d1-4540-8654-dd88194a3f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:12.681076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-b5a61519-b8d1-4540-8654-dd88194a3f08 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:12.682291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b5a61519-b8d1-4540-8654-dd88194a3f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:12.747765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 543/1108] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:13.012730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3ad7f-407f-42ca-9153-7538893839f6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:13.115083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3ad7f-407f-42ca-9153-7538893839f6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:13.150305 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c036a45-0c3b-49fa-af89-ea4928fe5217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:13.150952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c036a45-0c3b-49fa-af89-ea4928fe5217 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.151234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c036a45-0c3b-49fa-af89-ea4928fe5217 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.151509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c036a45-0c3b-49fa-af89-ea4928fe5217 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.152648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c036a45-0c3b-49fa-af89-ea4928fe5217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:13.154147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c036a45-0c3b-49fa-af89-ea4928fe5217 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:13.155751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 566/1109] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:13.161644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a61519-b8d1-4540-8654-dd88194a3f08 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:13.211029 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:13.261787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a61519-b8d1-4540-8654-dd88194a3f08 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:13.294166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5730b76-fec1-4a20-a3ce-52a94b6d558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:13.294963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5730b76-fec1-4a20-a3ce-52a94b6d558f None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:13.295244 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5730b76-fec1-4a20-a3ce-52a94b6d558f None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:13.295517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5730b76-fec1-4a20-a3ce-52a94b6d558f None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:13.296199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5730b76-fec1-4a20-a3ce-52a94b6d558f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:13.297653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5730b76-fec1-4a20-a3ce-52a94b6d558f None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:13.382434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 544/1110] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:17:13 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:15.332744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0a2c-d131-4b01-9866-a4f2794e7c8b None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:15.333277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0a2c-d131-4b01-9866-a4f2794e7c8b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:15.333277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0a2c-d131-4b01-9866-a4f2794e7c8b None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:15.334658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 567/1111] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:15.340418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15bc9e-0ecb-44dc-853e-5b073aa5d23d None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:15.340827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15bc9e-0ecb-44dc-853e-5b073aa5d23d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:15.340967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15bc9e-0ecb-44dc-853e-5b073aa5d23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:15.359482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ce15bc9e-0ecb-44dc-853e-5b073aa5d23d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:15.360659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ce15bc9e-0ecb-44dc-853e-5b073aa5d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:15.424639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 545/1112] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:15.696405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c0a2c-d131-4b01-9866-a4f2794e7c8b None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:15.753030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:15.807554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c0a2c-d131-4b01-9866-a4f2794e7c8b None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:15.841993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580cdf2-41f2-42da-bfc8-12e1c51c662c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:15.842608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580cdf2-41f2-42da-bfc8-12e1c51c662c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:15.842882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580cdf2-41f2-42da-bfc8-12e1c51c662c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:15.843154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580cdf2-41f2-42da-bfc8-12e1c51c662c None admin] PATH_INFO: `/v3/roles/20d736bdf9df414f9e9b2ae27c77c071` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:15.844524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580cdf2-41f2-42da-bfc8-12e1c51c662c None admin] RBAC: Authorizing `identity:get_role(role_id=20d736bdf9df414f9e9b2ae27c77c071)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:15.845915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580cdf2-41f2-42da-bfc8-12e1c51c662c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:15.847211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 568/1113] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:15 2022] GET /identity/v3/roles/20d736bdf9df414f9e9b2ae27c77c071 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:15.853145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15bc9e-0ecb-44dc-853e-5b073aa5d23d None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:15.886428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:15.952361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15bc9e-0ecb-44dc-853e-5b073aa5d23d None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:15.987178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3257f-9042-4e3a-9cf0-12d5735297c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:15.987811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3257f-9042-4e3a-9cf0-12d5735297c8 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:15.988093 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3257f-9042-4e3a-9cf0-12d5735297c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:15.988370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3257f-9042-4e3a-9cf0-12d5735297c8 None admin] PATH_INFO: `/v3/users/1066d6874a3c492e82c219c190774377` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:16.001321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3257f-9042-4e3a-9cf0-12d5735297c8 None admin] RBAC: Authorizing `identity:get_user(user_id=1066d6874a3c492e82c219c190774377)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:16.002878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3257f-9042-4e3a-9cf0-12d5735297c8 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:16.004498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 546/1114] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:15 2022] GET /identity/v3/users/1066d6874a3c492e82c219c190774377 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:16.011036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580cdf2-41f2-42da-bfc8-12e1c51c662c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:16.106846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580cdf2-41f2-42da-bfc8-12e1c51c662c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:16.129712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:16.140547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d83d4-c7af-4ae4-a5b5-ff7a77f0839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:16.141136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d83d4-c7af-4ae4-a5b5-ff7a77f0839c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:16.141413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d83d4-c7af-4ae4-a5b5-ff7a77f0839c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:16.141799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d83d4-c7af-4ae4-a5b5-ff7a77f0839c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:16.207059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d83d4-c7af-4ae4-a5b5-ff7a77f0839c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:16.208415 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d83d4-c7af-4ae4-a5b5-ff7a77f0839c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:16.305385 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 569/1115] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:17:16.311378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3257f-9042-4e3a-9cf0-12d5735297c8 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:16.400264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:16.408652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3257f-9042-4e3a-9cf0-12d5735297c8 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:16.442665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81366758-9676-40c5-89df-a3f79830b5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:16.443290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81366758-9676-40c5-89df-a3f79830b5a2 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:16.443574 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81366758-9676-40c5-89df-a3f79830b5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:16.443883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81366758-9676-40c5-89df-a3f79830b5a2 None admin] PATH_INFO: `/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:16.445981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81366758-9676-40c5-89df-a3f79830b5a2 None admin] RBAC: Authorizing `identity:get_project(project_id=551aa079fdec46b3be4ebc7fe79b71b4)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:16.447618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81366758-9676-40c5-89df-a3f79830b5a2 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:16.449594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 547/1116] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:16 2022] GET /identity/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:16.456304 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d83d4-c7af-4ae4-a5b5-ff7a77f0839c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:16.481863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:16.557286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d83d4-c7af-4ae4-a5b5-ff7a77f0839c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:16.591103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd26d8-8ee4-4ed3-9c09-580337a35d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:16.591731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd26d8-8ee4-4ed3-9c09-580337a35d38 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:16.592033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd26d8-8ee4-4ed3-9c09-580337a35d38 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:16.592309 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd26d8-8ee4-4ed3-9c09-580337a35d38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:16.593027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd26d8-8ee4-4ed3-9c09-580337a35d38 None admin] RBAC: Adding query filter params (role.id=20d736bdf9df414f9e9b2ae27c77c071, scope.project.id=551aa079fdec46b3be4ebc7fe79b71b4, user.id=1066d6874a3c492e82c219c190774377) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:16.593337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd26d8-8ee4-4ed3-9c09-580337a35d38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:16.594791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd26d8-8ee4-4ed3-9c09-580337a35d38 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:16.599980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 570/1117] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:17:16 2022] GET /identity/v3/role_assignments?user.id=1066d6874a3c492e82c219c190774377&scope.project.id=551aa079fdec46b3be4ebc7fe79b71b4&role.id=20d736bdf9df414f9e9b2ae27c77c071 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:18.493192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530f8a5-3886-4723-98dc-43fd2c6fe151 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:18.493757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530f8a5-3886-4723-98dc-43fd2c6fe151 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:18.493879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530f8a5-3886-4723-98dc-43fd2c6fe151 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:18.496627 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 548/1118] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:18.502184 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca235-b1c1-453e-a4c1-89bc93dab97f None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:18.502624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca235-b1c1-453e-a4c1-89bc93dab97f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:18.502780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaca235-b1c1-453e-a4c1-89bc93dab97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:18.520712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-aaaca235-b1c1-453e-a4c1-89bc93dab97f None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:18.521936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-aaaca235-b1c1-453e-a4c1-89bc93dab97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:18.587489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 571/1119] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:18.860381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530f8a5-3886-4723-98dc-43fd2c6fe151 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:18.962121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530f8a5-3886-4723-98dc-43fd2c6fe151 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:18.994142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218921b3-7a27-4cc5-b347-90d7a922270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:18.994766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218921b3-7a27-4cc5-b347-90d7a922270c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:18.995048 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218921b3-7a27-4cc5-b347-90d7a922270c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:18.995319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218921b3-7a27-4cc5-b347-90d7a922270c None admin] PATH_INFO: `/v3/roles/20d736bdf9df414f9e9b2ae27c77c071` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:18.996705 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218921b3-7a27-4cc5-b347-90d7a922270c None admin] RBAC: Authorizing `identity:get_role(role_id=20d736bdf9df414f9e9b2ae27c77c071)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:18.998103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218921b3-7a27-4cc5-b347-90d7a922270c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:18.999419 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 549/1120] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:18 2022] GET /identity/v3/roles/20d736bdf9df414f9e9b2ae27c77c071 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:19.005225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaca235-b1c1-453e-a4c1-89bc93dab97f None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:19.024174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:19.101205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaca235-b1c1-453e-a4c1-89bc93dab97f None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:19.134431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac643c5-d0ee-4ed0-a451-d447c55e6ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:19.134969 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac643c5-d0ee-4ed0-a451-d447c55e6ed1 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:19.135243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac643c5-d0ee-4ed0-a451-d447c55e6ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:19.135514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac643c5-d0ee-4ed0-a451-d447c55e6ed1 None admin] PATH_INFO: `/v3/users/1066d6874a3c492e82c219c190774377` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:19.136605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac643c5-d0ee-4ed0-a451-d447c55e6ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=1066d6874a3c492e82c219c190774377)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:19.138053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac643c5-d0ee-4ed0-a451-d447c55e6ed1 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:19.139599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 572/1121] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:19 2022] GET /identity/v3/users/1066d6874a3c492e82c219c190774377 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:19.145345 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218921b3-7a27-4cc5-b347-90d7a922270c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:19.173259 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:19.243713 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218921b3-7a27-4cc5-b347-90d7a922270c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:19.276572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f13cf-b4f7-4f9b-bee8-066c333289ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:19.277192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f13cf-b4f7-4f9b-bee8-066c333289ae None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:19.277474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f13cf-b4f7-4f9b-bee8-066c333289ae None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:19.277774 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f13cf-b4f7-4f9b-bee8-066c333289ae None admin] PATH_INFO: `/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:19.278884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f13cf-b4f7-4f9b-bee8-066c333289ae None admin] RBAC: Authorizing `identity:get_project(project_id=551aa079fdec46b3be4ebc7fe79b71b4)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:19.280318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f13cf-b4f7-4f9b-bee8-066c333289ae None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:19.281962 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 550/1122] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:19 2022] GET /identity/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:19.287838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac643c5-d0ee-4ed0-a451-d447c55e6ed1 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:19.370572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:19.385386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac643c5-d0ee-4ed0-a451-d447c55e6ed1 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:19.419380 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457d05c-6991-4792-b738-b1f0fd50674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:19.420287 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457d05c-6991-4792-b738-b1f0fd50674c None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:19.420572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457d05c-6991-4792-b738-b1f0fd50674c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:19.420850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457d05c-6991-4792-b738-b1f0fd50674c None admin] PATH_INFO: `/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4/users/1066d6874a3c492e82c219c190774377/roles/20d736bdf9df414f9e9b2ae27c77c071` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:19.423024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457d05c-6991-4792-b738-b1f0fd50674c None admin] RBAC: Authorizing `identity:create_grant(project_id=551aa079fdec46b3be4ebc7fe79b71b4, user_id=1066d6874a3c492e82c219c190774377, role_id=20d736bdf9df414f9e9b2ae27c77c071)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:19.424464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457d05c-6991-4792-b738-b1f0fd50674c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:19.501827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 573/1123] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:17:19 2022] PUT /identity/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4/users/1066d6874a3c492e82c219c190774377/roles/20d736bdf9df414f9e9b2ae27c77c071 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:21.381846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaa5fd-9f52-46ee-ae84-ecc5cb2595d3 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:21.382385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaa5fd-9f52-46ee-ae84-ecc5cb2595d3 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:21.382385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaa5fd-9f52-46ee-ae84-ecc5cb2595d3 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:21.383738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 551/1124] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:21.388908 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e313b-6cdb-45e1-a288-d99cc56e5c75 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:21.389314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e313b-6cdb-45e1-a288-d99cc56e5c75 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:21.389460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e313b-6cdb-45e1-a288-d99cc56e5c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:21.408325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-c09e313b-6cdb-45e1-a288-d99cc56e5c75 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:21.409520 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c09e313b-6cdb-45e1-a288-d99cc56e5c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:21.479128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 574/1125] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:21.748281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaa5fd-9f52-46ee-ae84-ecc5cb2595d3 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:21.846825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:21.853403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaa5fd-9f52-46ee-ae84-ecc5cb2595d3 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:21.885912 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21d62f-6f06-4195-b614-0a21f688ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:21.886539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21d62f-6f06-4195-b614-0a21f688ac07 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:21.886816 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21d62f-6f06-4195-b614-0a21f688ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:21.887085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21d62f-6f06-4195-b614-0a21f688ac07 None admin] PATH_INFO: `/v3/roles/20d736bdf9df414f9e9b2ae27c77c071` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:21.888454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21d62f-6f06-4195-b614-0a21f688ac07 None admin] RBAC: Authorizing `identity:get_role(role_id=20d736bdf9df414f9e9b2ae27c77c071)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:21.889858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21d62f-6f06-4195-b614-0a21f688ac07 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:21.892158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 552/1126] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:21 2022] GET /identity/v3/roles/20d736bdf9df414f9e9b2ae27c77c071 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:21.897309 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e313b-6cdb-45e1-a288-d99cc56e5c75 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:21.972163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:21.995708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e313b-6cdb-45e1-a288-d99cc56e5c75 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:22.028649 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b580a12-91dd-4dd4-94a8-1f4ec8fc4ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:22.029203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b580a12-91dd-4dd4-94a8-1f4ec8fc4ec5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:22.029539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b580a12-91dd-4dd4-94a8-1f4ec8fc4ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:22.029847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b580a12-91dd-4dd4-94a8-1f4ec8fc4ec5 None admin] PATH_INFO: `/v3/users/1066d6874a3c492e82c219c190774377` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:22.030973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b580a12-91dd-4dd4-94a8-1f4ec8fc4ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=1066d6874a3c492e82c219c190774377)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:22.032423 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b580a12-91dd-4dd4-94a8-1f4ec8fc4ec5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:22.034116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 575/1127] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:21 2022] GET /identity/v3/users/1066d6874a3c492e82c219c190774377 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:22.040737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21d62f-6f06-4195-b614-0a21f688ac07 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:22.138079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21d62f-6f06-4195-b614-0a21f688ac07 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:22.171672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2596f-3c7d-45e4-bbdd-ecac03433601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:22.172267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2596f-3c7d-45e4-bbdd-ecac03433601 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:22.172548 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2596f-3c7d-45e4-bbdd-ecac03433601 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:22.172820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2596f-3c7d-45e4-bbdd-ecac03433601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:22.201952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:22.238319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2596f-3c7d-45e4-bbdd-ecac03433601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:22.239768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2596f-3c7d-45e4-bbdd-ecac03433601 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:22.335835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 553/1128] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:17:22.341837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b580a12-91dd-4dd4-94a8-1f4ec8fc4ec5 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:22.439257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b580a12-91dd-4dd4-94a8-1f4ec8fc4ec5 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:22.472981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c1599-87e1-4ab6-a78c-3c71381161dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:22.473622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c1599-87e1-4ab6-a78c-3c71381161dd None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:22.473907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c1599-87e1-4ab6-a78c-3c71381161dd None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:22.474184 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c1599-87e1-4ab6-a78c-3c71381161dd None admin] PATH_INFO: `/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:22.475293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c1599-87e1-4ab6-a78c-3c71381161dd None admin] RBAC: Authorizing `identity:get_project(project_id=551aa079fdec46b3be4ebc7fe79b71b4)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:22.476806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c1599-87e1-4ab6-a78c-3c71381161dd None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:22.478445 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 576/1129] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:22 2022] GET /identity/v3/projects/551aa079fdec46b3be4ebc7fe79b71b4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:22.484611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2596f-3c7d-45e4-bbdd-ecac03433601 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:22.544632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:22.581135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2596f-3c7d-45e4-bbdd-ecac03433601 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:22.614371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda4def-072a-4f45-bf2f-4a70b1ea415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:22.614903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4def-072a-4f45-bf2f-4a70b1ea415b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:22.615181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4def-072a-4f45-bf2f-4a70b1ea415b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:22.615452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4def-072a-4f45-bf2f-4a70b1ea415b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:22.616157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda4def-072a-4f45-bf2f-4a70b1ea415b None admin] RBAC: Adding query filter params (role.id=20d736bdf9df414f9e9b2ae27c77c071, scope.project.id=551aa079fdec46b3be4ebc7fe79b71b4, user.id=1066d6874a3c492e82c219c190774377) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:22.616463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda4def-072a-4f45-bf2f-4a70b1ea415b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:22.618020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda4def-072a-4f45-bf2f-4a70b1ea415b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:22.623512 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 554/1130] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:17:22 2022] GET /identity/v3/role_assignments?user.id=1066d6874a3c492e82c219c190774377&scope.project.id=551aa079fdec46b3be4ebc7fe79b71b4&role.id=20d736bdf9df414f9e9b2ae27c77c071 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:24.547564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246adbb-c786-4eae-a35e-487399b0d89d None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:24.548149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246adbb-c786-4eae-a35e-487399b0d89d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:24.548149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246adbb-c786-4eae-a35e-487399b0d89d None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:24.549438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 577/1131] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:24.555164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b297a3-3dc4-46d3-b711-4ef51ad7891a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:24.555545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b297a3-3dc4-46d3-b711-4ef51ad7891a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:24.555701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b297a3-3dc4-46d3-b711-4ef51ad7891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:24.574291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-76b297a3-3dc4-46d3-b711-4ef51ad7891a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:24.575486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-76b297a3-3dc4-46d3-b711-4ef51ad7891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:24.641036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 555/1132] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:24.920889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246adbb-c786-4eae-a35e-487399b0d89d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:24.936340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:25.026702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246adbb-c786-4eae-a35e-487399b0d89d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:25.062875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40346ceb-de77-4fd6-ae47-9c427be30b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:25.063512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346ceb-de77-4fd6-ae47-9c427be30b74 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:25.063796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346ceb-de77-4fd6-ae47-9c427be30b74 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:25.064068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40346ceb-de77-4fd6-ae47-9c427be30b74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:25.065191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40346ceb-de77-4fd6-ae47-9c427be30b74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:25.066675 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40346ceb-de77-4fd6-ae47-9c427be30b74 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:25.068259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 578/1133] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:25.074487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b297a3-3dc4-46d3-b711-4ef51ad7891a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:25.137092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:25.185792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b297a3-3dc4-46d3-b711-4ef51ad7891a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:25.220769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167ab45-cd64-424d-8ba1-29b082d46f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:25.221370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167ab45-cd64-424d-8ba1-29b082d46f41 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:25.221804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167ab45-cd64-424d-8ba1-29b082d46f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:25.222082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167ab45-cd64-424d-8ba1-29b082d46f41 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:25.222743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167ab45-cd64-424d-8ba1-29b082d46f41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:25.224181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167ab45-cd64-424d-8ba1-29b082d46f41 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:25.321741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 556/1134] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:17:25 2022] POST /identity/v3/projects => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:27.271865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb98fb3-9627-494c-a8b6-5dd7f0223e94 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:27.272449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb98fb3-9627-494c-a8b6-5dd7f0223e94 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:27.272548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb98fb3-9627-494c-a8b6-5dd7f0223e94 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:27.274420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 579/1135] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:27.279769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bde4bc-c1dc-491a-b81f-60433518c895 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:27.280224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bde4bc-c1dc-491a-b81f-60433518c895 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:27.280334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bde4bc-c1dc-491a-b81f-60433518c895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:27.298615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-e9bde4bc-c1dc-491a-b81f-60433518c895 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:27.299794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e9bde4bc-c1dc-491a-b81f-60433518c895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:27.367574 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 557/1136] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:27.639389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb98fb3-9627-494c-a8b6-5dd7f0223e94 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:27.723576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:27.744407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb98fb3-9627-494c-a8b6-5dd7f0223e94 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:27.778669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d53234-83b0-4183-8b11-abf30338901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:27.779296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53234-83b0-4183-8b11-abf30338901a None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:27.779576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53234-83b0-4183-8b11-abf30338901a None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:27.779850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d53234-83b0-4183-8b11-abf30338901a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:27.780975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d53234-83b0-4183-8b11-abf30338901a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:27.782456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d53234-83b0-4183-8b11-abf30338901a None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:27.784021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 580/1137] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:17:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:27.790468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bde4bc-c1dc-491a-b81f-60433518c895 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:27.833200 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:27.902360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bde4bc-c1dc-491a-b81f-60433518c895 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:27.943729 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64aff1-875c-4bdc-8ab8-5f9f4d9f7118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:27.944424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64aff1-875c-4bdc-8ab8-5f9f4d9f7118 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:27.944707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64aff1-875c-4bdc-8ab8-5f9f4d9f7118 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:27.944981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64aff1-875c-4bdc-8ab8-5f9f4d9f7118 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:27.945665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64aff1-875c-4bdc-8ab8-5f9f4d9f7118 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:27.947111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64aff1-875c-4bdc-8ab8-5f9f4d9f7118 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:28.054333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 558/1138] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:17:27 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:30.032705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4cdb0-2e40-47d0-9249-dd8136ddf7c7 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:30.033457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4cdb0-2e40-47d0-9249-dd8136ddf7c7 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:30.033457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4cdb0-2e40-47d0-9249-dd8136ddf7c7 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:30.034610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 581/1139] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:30.039981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5838f-04ce-4d86-af35-80c4a16b5f59 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:30.040426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5838f-04ce-4d86-af35-80c4a16b5f59 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:30.040520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5838f-04ce-4d86-af35-80c4a16b5f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:30.059436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-65c5838f-04ce-4d86-af35-80c4a16b5f59 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:30.060636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-65c5838f-04ce-4d86-af35-80c4a16b5f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:30.127277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 559/1140] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:30.416456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4cdb0-2e40-47d0-9249-dd8136ddf7c7 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:30.517663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4cdb0-2e40-47d0-9249-dd8136ddf7c7 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:30.550847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa116f3a-f39b-4b8c-a082-04c0e8cfa7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:30.551453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116f3a-f39b-4b8c-a082-04c0e8cfa7a3 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:30.551732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116f3a-f39b-4b8c-a082-04c0e8cfa7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:30.552004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa116f3a-f39b-4b8c-a082-04c0e8cfa7a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:30.574170 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa116f3a-f39b-4b8c-a082-04c0e8cfa7a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-fa116f3a-f39b-4b8c-a082-04c0e8cfa7a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:17:30.588367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:30.589733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:30.590788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 582/1141] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:17:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:30.595673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5838f-04ce-4d86-af35-80c4a16b5f59 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:30.622819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:30.695989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5838f-04ce-4d86-af35-80c4a16b5f59 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:30.730308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058922b-08dd-41cc-b21c-0b022abd5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:30.730914 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058922b-08dd-41cc-b21c-0b022abd5f9b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:30.731196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058922b-08dd-41cc-b21c-0b022abd5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:30.731467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058922b-08dd-41cc-b21c-0b022abd5f9b None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:30.732123 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058922b-08dd-41cc-b21c-0b022abd5f9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:30.732426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058922b-08dd-41cc-b21c-0b022abd5f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:30.733815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058922b-08dd-41cc-b21c-0b022abd5f9b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:30.742424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 560/1142] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:17:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:30.748391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa116f3a-f39b-4b8c-a082-04c0e8cfa7a3 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:30.760520 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:30.850529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa116f3a-f39b-4b8c-a082-04c0e8cfa7a3 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:30.885824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ae28f-e08f-4589-8ec6-386286c1ac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:30.886456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae28f-e08f-4589-8ec6-386286c1ac0c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:30.886733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae28f-e08f-4589-8ec6-386286c1ac0c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:30.887010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae28f-e08f-4589-8ec6-386286c1ac0c None admin] PATH_INFO: `/v3/users/c0ac53726a5d42b190d72e045f5a01a3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:30.901506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ae28f-e08f-4589-8ec6-386286c1ac0c None admin] RBAC: Authorizing `identity:get_user(user_id=c0ac53726a5d42b190d72e045f5a01a3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:30.903046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ae28f-e08f-4589-8ec6-386286c1ac0c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:30.904690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 583/1143] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:30 2022] GET /identity/v3/users/c0ac53726a5d42b190d72e045f5a01a3 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:30.910790 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058922b-08dd-41cc-b21c-0b022abd5f9b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:31.009076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:31.020686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058922b-08dd-41cc-b21c-0b022abd5f9b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:31.055726 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1b198-db41-41d4-b37a-89d5ef5cca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:31.056392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1b198-db41-41d4-b37a-89d5ef5cca4a None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:31.056591 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1b198-db41-41d4-b37a-89d5ef5cca4a None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:31.056863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1b198-db41-41d4-b37a-89d5ef5cca4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:31.123309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1b198-db41-41d4-b37a-89d5ef5cca4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:31.124736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1b198-db41-41d4-b37a-89d5ef5cca4a None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:31.212650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:31.225457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 561/1144] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:17:31.231574 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ae28f-e08f-4589-8ec6-386286c1ac0c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:31.301246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:31.338759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ae28f-e08f-4589-8ec6-386286c1ac0c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:31.374215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1c3f4-b194-4470-a627-edd198345510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:31.375430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1c3f4-b194-4470-a627-edd198345510 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:31.375430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1c3f4-b194-4470-a627-edd198345510 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:31.375430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1c3f4-b194-4470-a627-edd198345510 None admin] PATH_INFO: `/v3/projects/c118f878b9a7431f80be270566f8291e` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:31.376770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1c3f4-b194-4470-a627-edd198345510 None admin] RBAC: Authorizing `identity:get_project(project_id=c118f878b9a7431f80be270566f8291e)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:31.378281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1c3f4-b194-4470-a627-edd198345510 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:31.379949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 584/1145] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:31 2022] GET /identity/v3/projects/c118f878b9a7431f80be270566f8291e => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:31.387101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1b198-db41-41d4-b37a-89d5ef5cca4a None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:31.489977 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1b198-db41-41d4-b37a-89d5ef5cca4a None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:31.525709 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dbfb7-162f-4923-b44b-bfd9c19ad218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:31.526313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dbfb7-162f-4923-b44b-bfd9c19ad218 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:31.526595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dbfb7-162f-4923-b44b-bfd9c19ad218 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:31.526865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dbfb7-162f-4923-b44b-bfd9c19ad218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:31.527586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dbfb7-162f-4923-b44b-bfd9c19ad218 None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=c118f878b9a7431f80be270566f8291e, user.id=c0ac53726a5d42b190d72e045f5a01a3) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:31.527894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dbfb7-162f-4923-b44b-bfd9c19ad218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:31.529329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dbfb7-162f-4923-b44b-bfd9c19ad218 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:31.535067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 562/1146] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:17:31 2022] GET /identity/v3/role_assignments?user.id=c0ac53726a5d42b190d72e045f5a01a3&scope.project.id=c118f878b9a7431f80be270566f8291e&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:33.451533 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87f82-e9dc-4309-96a1-f5cb8a8b419a None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:33.452075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87f82-e9dc-4309-96a1-f5cb8a8b419a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:33.452075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87f82-e9dc-4309-96a1-f5cb8a8b419a None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:33.453624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 585/1147] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:33.459122 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f976d-61cf-4b0b-80c6-1858a91e9b4a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:33.460039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f976d-61cf-4b0b-80c6-1858a91e9b4a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:33.460187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f976d-61cf-4b0b-80c6-1858a91e9b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:33.479541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-399f976d-61cf-4b0b-80c6-1858a91e9b4a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:33.480750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-399f976d-61cf-4b0b-80c6-1858a91e9b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:33.527765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:33.547965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 563/1148] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:33.816656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f87f82-e9dc-4309-96a1-f5cb8a8b419a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:33.923047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f87f82-e9dc-4309-96a1-f5cb8a8b419a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:33.958497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd7586-6702-4cbf-a981-d497a7d97f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:33.959123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd7586-6702-4cbf-a981-d497a7d97f43 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:33.959404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd7586-6702-4cbf-a981-d497a7d97f43 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:33.960342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd7586-6702-4cbf-a981-d497a7d97f43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:33.962326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:33.971237 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd7586-6702-4cbf-a981-d497a7d97f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-93dd7586-6702-4cbf-a981-d497a7d97f43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:17:33.976113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:33.980615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:33.982160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 586/1149] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:17:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:33.984905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f976d-61cf-4b0b-80c6-1858a91e9b4a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.083495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f976d-61cf-4b0b-80c6-1858a91e9b4a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.117561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065a173-8b84-4101-a09d-8f16df8bd719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.118198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065a173-8b84-4101-a09d-8f16df8bd719 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.118474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065a173-8b84-4101-a09d-8f16df8bd719 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.118746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065a173-8b84-4101-a09d-8f16df8bd719 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.119409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065a173-8b84-4101-a09d-8f16df8bd719 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:34.119708 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065a173-8b84-4101-a09d-8f16df8bd719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.121075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065a173-8b84-4101-a09d-8f16df8bd719 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.129069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 564/1150] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:17:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:34.135770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd7586-6702-4cbf-a981-d497a7d97f43 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.239340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd7586-6702-4cbf-a981-d497a7d97f43 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.276804 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e3323-3ae6-4008-984f-a74183c69df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.277448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3323-3ae6-4008-984f-a74183c69df4 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.277764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3323-3ae6-4008-984f-a74183c69df4 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.278052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e3323-3ae6-4008-984f-a74183c69df4 None admin] PATH_INFO: `/v3/users/c0ac53726a5d42b190d72e045f5a01a3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.279212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e3323-3ae6-4008-984f-a74183c69df4 None admin] RBAC: Authorizing `identity:get_user(user_id=c0ac53726a5d42b190d72e045f5a01a3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.281047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e3323-3ae6-4008-984f-a74183c69df4 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.282762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 587/1151] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:34 2022] GET /identity/v3/users/c0ac53726a5d42b190d72e045f5a01a3 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:34.289131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065a173-8b84-4101-a09d-8f16df8bd719 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.335889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:34.390057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065a173-8b84-4101-a09d-8f16df8bd719 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.423157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f7a93-0fcb-4af7-8ee6-6e84c184ceec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.423784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f7a93-0fcb-4af7-8ee6-6e84c184ceec None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.424067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f7a93-0fcb-4af7-8ee6-6e84c184ceec None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.424342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f7a93-0fcb-4af7-8ee6-6e84c184ceec None admin] PATH_INFO: `/v3/projects/c118f878b9a7431f80be270566f8291e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.425602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f7a93-0fcb-4af7-8ee6-6e84c184ceec None admin] RBAC: Authorizing `identity:get_project(project_id=c118f878b9a7431f80be270566f8291e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.426987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f7a93-0fcb-4af7-8ee6-6e84c184ceec None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.429163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 565/1152] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:34 2022] GET /identity/v3/projects/c118f878b9a7431f80be270566f8291e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:34.435311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e3323-3ae6-4008-984f-a74183c69df4 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:34.498147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:34.536323 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e3323-3ae6-4008-984f-a74183c69df4 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:34.571648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6594ed0-6a92-4124-af28-553aab415943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:34.572292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6594ed0-6a92-4124-af28-553aab415943 None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:34.572568 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6594ed0-6a92-4124-af28-553aab415943 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:34.572840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6594ed0-6a92-4124-af28-553aab415943 None admin] PATH_INFO: `/v3/projects/c118f878b9a7431f80be270566f8291e/users/c0ac53726a5d42b190d72e045f5a01a3/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:34.574832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6594ed0-6a92-4124-af28-553aab415943 None admin] RBAC: Authorizing `identity:create_grant(project_id=c118f878b9a7431f80be270566f8291e, user_id=c0ac53726a5d42b190d72e045f5a01a3, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:34.576253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6594ed0-6a92-4124-af28-553aab415943 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:34.679558 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 588/1153] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:17:34 2022] PUT /identity/v3/projects/c118f878b9a7431f80be270566f8291e/users/c0ac53726a5d42b190d72e045f5a01a3/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:36.598606 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f6c4f-5775-41db-a941-1a0f086bfbce None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:36.599150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f6c4f-5775-41db-a941-1a0f086bfbce None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:36.599150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f6c4f-5775-41db-a941-1a0f086bfbce None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:36.601077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 566/1154] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:36.606468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dadc90-1d19-4022-9d67-16b94af3ee99 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:36.607017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dadc90-1d19-4022-9d67-16b94af3ee99 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:36.607017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dadc90-1d19-4022-9d67-16b94af3ee99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:36.625872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b5dadc90-1d19-4022-9d67-16b94af3ee99 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:36.627403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b5dadc90-1d19-4022-9d67-16b94af3ee99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:36.695568 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 589/1155] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:36.966707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f6c4f-5775-41db-a941-1a0f086bfbce None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:37.069431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f6c4f-5775-41db-a941-1a0f086bfbce None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:37.082481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:37.104377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb482d-25cc-47c4-9bd2-9826cb3f947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:37.104998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb482d-25cc-47c4-9bd2-9826cb3f947b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:37.105280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb482d-25cc-47c4-9bd2-9826cb3f947b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:37.105554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb482d-25cc-47c4-9bd2-9826cb3f947b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:37.115873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb482d-25cc-47c4-9bd2-9826cb3f947b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-aaeb482d-25cc-47c4-9bd2-9826cb3f947b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:17:37.120651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:37.121805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:37.123040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 567/1156] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:17:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:37.127812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dadc90-1d19-4022-9d67-16b94af3ee99 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:37.180161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:37.227593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dadc90-1d19-4022-9d67-16b94af3ee99 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:37.262576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debbb16-4cf3-4e7f-80f3-5a6a3cec7723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:37.263190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debbb16-4cf3-4e7f-80f3-5a6a3cec7723 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:37.263469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debbb16-4cf3-4e7f-80f3-5a6a3cec7723 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:37.263747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debbb16-4cf3-4e7f-80f3-5a6a3cec7723 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:37.264416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debbb16-4cf3-4e7f-80f3-5a6a3cec7723 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:37.264723 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debbb16-4cf3-4e7f-80f3-5a6a3cec7723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:37.266140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debbb16-4cf3-4e7f-80f3-5a6a3cec7723 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:37.275182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 590/1157] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:17:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:37.281106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb482d-25cc-47c4-9bd2-9826cb3f947b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:37.380910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb482d-25cc-47c4-9bd2-9826cb3f947b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:37.415447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72a81b-e016-4191-a2a1-3ce6fb52de6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:37.416065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72a81b-e016-4191-a2a1-3ce6fb52de6d None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:37.416341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72a81b-e016-4191-a2a1-3ce6fb52de6d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:37.416609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72a81b-e016-4191-a2a1-3ce6fb52de6d None admin] PATH_INFO: `/v3/users/c0ac53726a5d42b190d72e045f5a01a3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:37.417738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72a81b-e016-4191-a2a1-3ce6fb52de6d None admin] RBAC: Authorizing `identity:get_user(user_id=c0ac53726a5d42b190d72e045f5a01a3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:37.419161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72a81b-e016-4191-a2a1-3ce6fb52de6d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:37.420986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 568/1158] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:37 2022] GET /identity/v3/users/c0ac53726a5d42b190d72e045f5a01a3 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:37.427060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debbb16-4cf3-4e7f-80f3-5a6a3cec7723 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:37.532228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debbb16-4cf3-4e7f-80f3-5a6a3cec7723 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:37.546762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:37.568125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452059d-1777-4010-93a9-b416b47d2829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:37.569732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452059d-1777-4010-93a9-b416b47d2829 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:37.570115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452059d-1777-4010-93a9-b416b47d2829 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:37.570412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452059d-1777-4010-93a9-b416b47d2829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:37.641216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452059d-1777-4010-93a9-b416b47d2829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:37.642687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452059d-1777-4010-93a9-b416b47d2829 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:37.753617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 591/1159] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:17:37.759066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72a81b-e016-4191-a2a1-3ce6fb52de6d None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:37.804534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:37.863795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72a81b-e016-4191-a2a1-3ce6fb52de6d None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:37.899252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290961fd-5190-4d94-ab7b-6de7b290cbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:37.899890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290961fd-5190-4d94-ab7b-6de7b290cbf5 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:37.900168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290961fd-5190-4d94-ab7b-6de7b290cbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:37.900441 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290961fd-5190-4d94-ab7b-6de7b290cbf5 None admin] PATH_INFO: `/v3/projects/c118f878b9a7431f80be270566f8291e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:37.901567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290961fd-5190-4d94-ab7b-6de7b290cbf5 None admin] RBAC: Authorizing `identity:get_project(project_id=c118f878b9a7431f80be270566f8291e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:37.903009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290961fd-5190-4d94-ab7b-6de7b290cbf5 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:37.904642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 569/1160] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:37 2022] GET /identity/v3/projects/c118f878b9a7431f80be270566f8291e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:37.910814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452059d-1777-4010-93a9-b416b47d2829 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:37.926140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:38.014649 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452059d-1777-4010-93a9-b416b47d2829 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:38.050174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b154e7a-9139-4352-a95a-e91f65ab9a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:38.050777 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154e7a-9139-4352-a95a-e91f65ab9a4b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:38.051057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154e7a-9139-4352-a95a-e91f65ab9a4b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:38.051329 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b154e7a-9139-4352-a95a-e91f65ab9a4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:38.052063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b154e7a-9139-4352-a95a-e91f65ab9a4b None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=c118f878b9a7431f80be270566f8291e, user.id=c0ac53726a5d42b190d72e045f5a01a3) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:38.052361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b154e7a-9139-4352-a95a-e91f65ab9a4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:38.053845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b154e7a-9139-4352-a95a-e91f65ab9a4b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:38.059634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 592/1161] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:17:37 2022] GET /identity/v3/role_assignments?user.id=c0ac53726a5d42b190d72e045f5a01a3&scope.project.id=c118f878b9a7431f80be270566f8291e&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:40.114128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76aad4-c488-4afa-a97a-47152b859c64 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:40.114712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76aad4-c488-4afa-a97a-47152b859c64 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:40.114712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76aad4-c488-4afa-a97a-47152b859c64 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:40.116055 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 570/1162] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:40.121477 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953460bd-d835-4b8f-8165-3ffec0079f00 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:40.122006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953460bd-d835-4b8f-8165-3ffec0079f00 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:40.122107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953460bd-d835-4b8f-8165-3ffec0079f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:40.140673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-953460bd-d835-4b8f-8165-3ffec0079f00 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:40.141849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-953460bd-d835-4b8f-8165-3ffec0079f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:40.216288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 593/1163] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:40.486039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76aad4-c488-4afa-a97a-47152b859c64 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:40.588667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76aad4-c488-4afa-a97a-47152b859c64 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:40.597997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:40.622794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bfe0a-b8d1-42c0-8b03-2885ccfaa9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:40.623403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bfe0a-b8d1-42c0-8b03-2885ccfaa9ae None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:40.623675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bfe0a-b8d1-42c0-8b03-2885ccfaa9ae None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:40.623943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bfe0a-b8d1-42c0-8b03-2885ccfaa9ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:40.697293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bfe0a-b8d1-42c0-8b03-2885ccfaa9ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:40.698772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bfe0a-b8d1-42c0-8b03-2885ccfaa9ae None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:40.803881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 571/1164] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 00:17:40.809892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953460bd-d835-4b8f-8165-3ffec0079f00 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:40.820810 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:40.914719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953460bd-d835-4b8f-8165-3ffec0079f00 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:40.949059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a9ca9-c285-4ebc-a3a2-b60dc6829e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:40.949712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a9ca9-c285-4ebc-a3a2-b60dc6829e64 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:40.949992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a9ca9-c285-4ebc-a3a2-b60dc6829e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:40.950264 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a9ca9-c285-4ebc-a3a2-b60dc6829e64 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:40.956825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a9ca9-c285-4ebc-a3a2-b60dc6829e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:40.958277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a9ca9-c285-4ebc-a3a2-b60dc6829e64 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-242a9ca9-c285-4ebc-a3a2-b60dc6829e64 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:40.970700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:40.972029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:40.972951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 594/1165] 10.222.0.74 () {56 vars in 1117 bytes} [Wed Aug 31 00:17:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:40.978436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bfe0a-b8d1-42c0-8b03-2885ccfaa9ae None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:40.988726 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:41.096425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bfe0a-b8d1-42c0-8b03-2885ccfaa9ae None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:41.133210 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbee63-ffb3-47f4-8da2-eeb99c3cbab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:41.133910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbee63-ffb3-47f4-8da2-eeb99c3cbab9 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:41.134113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbee63-ffb3-47f4-8da2-eeb99c3cbab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:41.134383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbee63-ffb3-47f4-8da2-eeb99c3cbab9 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:41.135018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbee63-ffb3-47f4-8da2-eeb99c3cbab9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:41.135312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbee63-ffb3-47f4-8da2-eeb99c3cbab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:41.136661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbee63-ffb3-47f4-8da2-eeb99c3cbab9 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:41.144057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 572/1166] 10.222.0.74 () {56 vars in 1115 bytes} [Wed Aug 31 00:17:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:43.160456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3467-05e0-44b5-a9b0-502eb9679828 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:43.160984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3467-05e0-44b5-a9b0-502eb9679828 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:43.160984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3467-05e0-44b5-a9b0-502eb9679828 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:43.163151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 595/1167] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:43.168690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fe25d-6339-4f55-b497-aca13e4d74dc None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:43.169148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fe25d-6339-4f55-b497-aca13e4d74dc None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:43.169332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fe25d-6339-4f55-b497-aca13e4d74dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:43.188423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-fa3fe25d-6339-4f55-b497-aca13e4d74dc None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:43.189679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-fa3fe25d-6339-4f55-b497-aca13e4d74dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:43.259459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 573/1168] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:43.533021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf3467-05e0-44b5-a9b0-502eb9679828 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:43.605989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:43.639825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf3467-05e0-44b5-a9b0-502eb9679828 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:43.675746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d0a69-274e-4f1f-b48c-db2669c67f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:43.676343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0a69-274e-4f1f-b48c-db2669c67f69 None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:43.676624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0a69-274e-4f1f-b48c-db2669c67f69 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:43.676899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0a69-274e-4f1f-b48c-db2669c67f69 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:43.677566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d0a69-274e-4f1f-b48c-db2669c67f69 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:43.679647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d0a69-274e-4f1f-b48c-db2669c67f69 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:43.751930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 596/1169] 10.222.0.74 () {60 vars in 1138 bytes} [Wed Aug 31 00:17:43 2022] POST /identity/v3/domains => generated 267 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:45.736900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11589e1a-df2d-4ebd-9f93-8dbb2160cbba None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:45.737476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11589e1a-df2d-4ebd-9f93-8dbb2160cbba None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:45.737476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11589e1a-df2d-4ebd-9f93-8dbb2160cbba None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:45.738846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 574/1170] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:45.745212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ce526-a64c-4063-8426-60b4b6931535 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:45.745702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ce526-a64c-4063-8426-60b4b6931535 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:45.745802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ce526-a64c-4063-8426-60b4b6931535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:45.765569 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-ac9ce526-a64c-4063-8426-60b4b6931535 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:45.767050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ac9ce526-a64c-4063-8426-60b4b6931535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:45.845376 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 597/1171] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:46.120068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11589e1a-df2d-4ebd-9f93-8dbb2160cbba None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:46.123023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:46.229710 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11589e1a-df2d-4ebd-9f93-8dbb2160cbba None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:46.265784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa328a2e-9bbf-49df-b30c-c5d6cb6d27f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:46.266422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa328a2e-9bbf-49df-b30c-c5d6cb6d27f0 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:46.266699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa328a2e-9bbf-49df-b30c-c5d6cb6d27f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:46.266972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa328a2e-9bbf-49df-b30c-c5d6cb6d27f0 None admin] PATH_INFO: `/v3/domains/a7a44e4dc8664934b4ca587d17a7cd0d` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:46.277783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa328a2e-9bbf-49df-b30c-c5d6cb6d27f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a7a44e4dc8664934b4ca587d17a7cd0d)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:46.279239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa328a2e-9bbf-49df-b30c-c5d6cb6d27f0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:46.280868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 575/1172] 10.222.0.74 () {56 vars in 1183 bytes} [Wed Aug 31 00:17:46 2022] GET /identity/v3/domains/a7a44e4dc8664934b4ca587d17a7cd0d => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:46.286952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ce526-a64c-4063-8426-60b4b6931535 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:46.345183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:46.389131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ce526-a64c-4063-8426-60b4b6931535 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:46.424864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329cdf9-d081-49c7-acb1-84b1ec65fbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:46.425459 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329cdf9-d081-49c7-acb1-84b1ec65fbef None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:46.425765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329cdf9-d081-49c7-acb1-84b1ec65fbef None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:46.426138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329cdf9-d081-49c7-acb1-84b1ec65fbef None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:46.426814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329cdf9-d081-49c7-acb1-84b1ec65fbef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:46.428970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329cdf9-d081-49c7-acb1-84b1ec65fbef None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:46.560408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 598/1173] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:17:46 2022] POST /identity/v3/projects => generated 361 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:48.527118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ff669-67bf-4056-bd6d-1ec8e66d9154 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:48.527662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ff669-67bf-4056-bd6d-1ec8e66d9154 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:48.527662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ff669-67bf-4056-bd6d-1ec8e66d9154 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:48.529011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 576/1174] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:48.534268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640130f-858b-4439-8606-4844dff004d8 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:48.534643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640130f-858b-4439-8606-4844dff004d8 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:48.534817 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0640130f-858b-4439-8606-4844dff004d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:48.554702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0640130f-858b-4439-8606-4844dff004d8 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:48.555910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0640130f-858b-4439-8606-4844dff004d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:48.623487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 599/1175] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:48.893309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ff669-67bf-4056-bd6d-1ec8e66d9154 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:48.956837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:48.995701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ff669-67bf-4056-bd6d-1ec8e66d9154 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:49.029787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e32f7-8f31-4ae6-9bfe-5ce8d714027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:49.030417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e32f7-8f31-4ae6-9bfe-5ce8d714027e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:49.030698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e32f7-8f31-4ae6-9bfe-5ce8d714027e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:49.030972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e32f7-8f31-4ae6-9bfe-5ce8d714027e None admin] PATH_INFO: `/v3/domains/a7a44e4dc8664934b4ca587d17a7cd0d` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:49.032081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e32f7-8f31-4ae6-9bfe-5ce8d714027e None admin] RBAC: Authorizing `identity:get_domain(domain_id=a7a44e4dc8664934b4ca587d17a7cd0d)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:49.033507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e32f7-8f31-4ae6-9bfe-5ce8d714027e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:49.035207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 577/1176] 10.222.0.74 () {56 vars in 1183 bytes} [Wed Aug 31 00:17:48 2022] GET /identity/v3/domains/a7a44e4dc8664934b4ca587d17a7cd0d => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:49.041011 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640130f-858b-4439-8606-4844dff004d8 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:49.083031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:49.141378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0640130f-858b-4439-8606-4844dff004d8 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:49.176772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f6fc81-6a98-48fc-9d1c-40d4bc2b446d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:49.177363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6fc81-6a98-48fc-9d1c-40d4bc2b446d None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:49.178289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6fc81-6a98-48fc-9d1c-40d4bc2b446d None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:49.178565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f6fc81-6a98-48fc-9d1c-40d4bc2b446d None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:49.179225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6fc81-6a98-48fc-9d1c-40d4bc2b446d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:49.180643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f6fc81-6a98-48fc-9d1c-40d4bc2b446d None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:49.272758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 600/1177] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:17:49 2022] POST /identity/v3/users => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:17:51.362062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c95ac5-7da6-486e-9b4c-df23c13526c3 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:51.362609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c95ac5-7da6-486e-9b4c-df23c13526c3 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:51.362609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c95ac5-7da6-486e-9b4c-df23c13526c3 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:51.364048 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 578/1178] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:51.369210 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398678e-a59b-4e80-939d-70c41930f0b8 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:51.369670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398678e-a59b-4e80-939d-70c41930f0b8 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:51.369797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398678e-a59b-4e80-939d-70c41930f0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:51.389993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-1398678e-a59b-4e80-939d-70c41930f0b8 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:51.391228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1398678e-a59b-4e80-939d-70c41930f0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:51.466092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 601/1179] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:51.738069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c95ac5-7da6-486e-9b4c-df23c13526c3 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:51.847701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c95ac5-7da6-486e-9b4c-df23c13526c3 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:51.879713 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:51.886094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e2843-1aba-44a1-92b8-f13bde3014a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:51.886753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2843-1aba-44a1-92b8-f13bde3014a0 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:51.887032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2843-1aba-44a1-92b8-f13bde3014a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:51.890824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2843-1aba-44a1-92b8-f13bde3014a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:51.903593 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e2843-1aba-44a1-92b8-f13bde3014a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-ba0e2843-1aba-44a1-92b8-f13bde3014a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:17:51.908459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:51.909549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:51.910482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 579/1180] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:17:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:51.916875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398678e-a59b-4e80-939d-70c41930f0b8 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:51.944999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:52.017513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398678e-a59b-4e80-939d-70c41930f0b8 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:52.053292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031638-e14f-4078-8329-ec6467732dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:52.053928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031638-e14f-4078-8329-ec6467732dc3 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:52.054212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031638-e14f-4078-8329-ec6467732dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:52.054487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79031638-e14f-4078-8329-ec6467732dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:52.055154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79031638-e14f-4078-8329-ec6467732dc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:52.055460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79031638-e14f-4078-8329-ec6467732dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:52.056848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79031638-e14f-4078-8329-ec6467732dc3 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:52.065367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 602/1181] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:17:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:52.071775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e2843-1aba-44a1-92b8-f13bde3014a0 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:52.177961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e2843-1aba-44a1-92b8-f13bde3014a0 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:52.217369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125ec9d-9cfe-4bce-8764-5237c6a2ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:52.218037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125ec9d-9cfe-4bce-8764-5237c6a2ed51 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:52.218318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125ec9d-9cfe-4bce-8764-5237c6a2ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:52.218598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125ec9d-9cfe-4bce-8764-5237c6a2ed51 None admin] PATH_INFO: `/v3/users/469d5518ed664f18b13aff446ff770d1` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:52.233021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125ec9d-9cfe-4bce-8764-5237c6a2ed51 None admin] RBAC: Authorizing `identity:get_user(user_id=469d5518ed664f18b13aff446ff770d1)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:52.234539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125ec9d-9cfe-4bce-8764-5237c6a2ed51 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:52.236258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 580/1182] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:52 2022] GET /identity/v3/users/469d5518ed664f18b13aff446ff770d1 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:52.242618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031638-e14f-4078-8329-ec6467732dc3 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:52.337029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:52.348579 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79031638-e14f-4078-8329-ec6467732dc3 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:52.386458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01becfa-3138-45f7-841a-4b0dfaa71bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:52.387171 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01becfa-3138-45f7-841a-4b0dfaa71bbf None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:52.387339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01becfa-3138-45f7-841a-4b0dfaa71bbf None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:52.387610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01becfa-3138-45f7-841a-4b0dfaa71bbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:52.460945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01becfa-3138-45f7-841a-4b0dfaa71bbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:52.462441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01becfa-3138-45f7-841a-4b0dfaa71bbf None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:52.552803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:52.566886 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 603/1183] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:17:52.573111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125ec9d-9cfe-4bce-8764-5237c6a2ed51 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:52.627517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:52.682134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125ec9d-9cfe-4bce-8764-5237c6a2ed51 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:52.721101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4c580-a791-4ea5-961c-30979ac239a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:52.721765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4c580-a791-4ea5-961c-30979ac239a6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:52.722045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4c580-a791-4ea5-961c-30979ac239a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:52.722319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4c580-a791-4ea5-961c-30979ac239a6 None admin] PATH_INFO: `/v3/projects/f94b674c3b3f4790b3a576be07df474d` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:52.723464 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4c580-a791-4ea5-961c-30979ac239a6 None admin] RBAC: Authorizing `identity:get_project(project_id=f94b674c3b3f4790b3a576be07df474d)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:52.724915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4c580-a791-4ea5-961c-30979ac239a6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:52.726695 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 581/1184] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:52 2022] GET /identity/v3/projects/f94b674c3b3f4790b3a576be07df474d => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:52.733822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01becfa-3138-45f7-841a-4b0dfaa71bbf None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:52.835046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01becfa-3138-45f7-841a-4b0dfaa71bbf None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:52.869882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b869fa-0e18-47d6-b249-0cef570a68bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:52.870473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b869fa-0e18-47d6-b249-0cef570a68bb None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:52.870751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b869fa-0e18-47d6-b249-0cef570a68bb None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:52.871023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b869fa-0e18-47d6-b249-0cef570a68bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:52.871740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b869fa-0e18-47d6-b249-0cef570a68bb None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=f94b674c3b3f4790b3a576be07df474d, user.id=469d5518ed664f18b13aff446ff770d1) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:52.872048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b869fa-0e18-47d6-b249-0cef570a68bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:52.873467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b869fa-0e18-47d6-b249-0cef570a68bb None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:52.878886 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 604/1185] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:17:52 2022] GET /identity/v3/role_assignments?user.id=469d5518ed664f18b13aff446ff770d1&scope.project.id=f94b674c3b3f4790b3a576be07df474d&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:54.819176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744409-7ec5-4b22-b14a-c1aa596a9c58 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:54.819720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744409-7ec5-4b22-b14a-c1aa596a9c58 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:54.819809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744409-7ec5-4b22-b14a-c1aa596a9c58 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:54.821176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 582/1186] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:54.826691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae3fb8-6eba-4161-befa-4073a83055cb None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:54.827275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae3fb8-6eba-4161-befa-4073a83055cb None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:54.827275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae3fb8-6eba-4161-befa-4073a83055cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:54.846767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-64ae3fb8-6eba-4161-befa-4073a83055cb None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:54.847982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-64ae3fb8-6eba-4161-befa-4073a83055cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:54.899882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:54.921641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 605/1187] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:55.202917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5744409-7ec5-4b22-b14a-c1aa596a9c58 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:55.314988 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5744409-7ec5-4b22-b14a-c1aa596a9c58 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:55.335175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:55.356032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb95b9-21d1-415a-b1ad-da6e6ca2c417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:55.356679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb95b9-21d1-415a-b1ad-da6e6ca2c417 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:55.356956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb95b9-21d1-415a-b1ad-da6e6ca2c417 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:55.357227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb95b9-21d1-415a-b1ad-da6e6ca2c417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:55.369050 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb95b9-21d1-415a-b1ad-da6e6ca2c417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-decb95b9-21d1-415a-b1ad-da6e6ca2c417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:17:55.373941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:55.375157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:17:55.376042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 583/1188] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:17:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:55.382589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae3fb8-6eba-4161-befa-4073a83055cb None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:55.505892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae3fb8-6eba-4161-befa-4073a83055cb None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:55.542061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba60a3-3eac-4f99-ad2a-afff19ecaded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:55.542672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba60a3-3eac-4f99-ad2a-afff19ecaded None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:55.542954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba60a3-3eac-4f99-ad2a-afff19ecaded None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:55.543231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba60a3-3eac-4f99-ad2a-afff19ecaded None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:55.543895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba60a3-3eac-4f99-ad2a-afff19ecaded None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:55.544202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba60a3-3eac-4f99-ad2a-afff19ecaded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:55.545869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba60a3-3eac-4f99-ad2a-afff19ecaded None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:55.555173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 606/1189] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:17:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:55.561117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb95b9-21d1-415a-b1ad-da6e6ca2c417 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:55.666577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb95b9-21d1-415a-b1ad-da6e6ca2c417 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:55.703175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80348-400e-4d03-801b-4f54c3d92fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:55.703796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80348-400e-4d03-801b-4f54c3d92fac None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:55.704071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80348-400e-4d03-801b-4f54c3d92fac None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:55.704529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80348-400e-4d03-801b-4f54c3d92fac None admin] PATH_INFO: `/v3/users/469d5518ed664f18b13aff446ff770d1` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:55.705705 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b80348-400e-4d03-801b-4f54c3d92fac None admin] RBAC: Authorizing `identity:get_user(user_id=469d5518ed664f18b13aff446ff770d1)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:55.707131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b80348-400e-4d03-801b-4f54c3d92fac None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:55.708706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 584/1190] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:55 2022] GET /identity/v3/users/469d5518ed664f18b13aff446ff770d1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:55.714612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba60a3-3eac-4f99-ad2a-afff19ecaded None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:55.762853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:55.817374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba60a3-3eac-4f99-ad2a-afff19ecaded None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:55.857134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e41d1-693d-4b88-a626-5e3a3316923c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:55.857934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e41d1-693d-4b88-a626-5e3a3316923c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:55.858038 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e41d1-693d-4b88-a626-5e3a3316923c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:55.858316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e41d1-693d-4b88-a626-5e3a3316923c None admin] PATH_INFO: `/v3/projects/f94b674c3b3f4790b3a576be07df474d` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:55.859655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e41d1-693d-4b88-a626-5e3a3316923c None admin] RBAC: Authorizing `identity:get_project(project_id=f94b674c3b3f4790b3a576be07df474d)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:55.861102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e41d1-693d-4b88-a626-5e3a3316923c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:55.862830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 607/1191] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:55 2022] GET /identity/v3/projects/f94b674c3b3f4790b3a576be07df474d => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:55.869817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80348-400e-4d03-801b-4f54c3d92fac None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:55.920635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:55.977541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80348-400e-4d03-801b-4f54c3d92fac None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:56.013910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db52d84-ef75-49c4-b1e3-80c9b2ade4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:56.014663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db52d84-ef75-49c4-b1e3-80c9b2ade4eb None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:56.014769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db52d84-ef75-49c4-b1e3-80c9b2ade4eb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:56.015260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db52d84-ef75-49c4-b1e3-80c9b2ade4eb None admin] PATH_INFO: `/v3/projects/f94b674c3b3f4790b3a576be07df474d/users/469d5518ed664f18b13aff446ff770d1/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:56.017405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db52d84-ef75-49c4-b1e3-80c9b2ade4eb None admin] RBAC: Authorizing `identity:create_grant(project_id=f94b674c3b3f4790b3a576be07df474d, user_id=469d5518ed664f18b13aff446ff770d1, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:56.018875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db52d84-ef75-49c4-b1e3-80c9b2ade4eb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:56.087676 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 585/1192] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:17:55 2022] PUT /identity/v3/projects/f94b674c3b3f4790b3a576be07df474d/users/469d5518ed664f18b13aff446ff770d1/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:17:58.053920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ab022-4d1a-4545-a812-a18f65281116 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.054978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ab022-4d1a-4545-a812-a18f65281116 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.055084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ab022-4d1a-4545-a812-a18f65281116 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.056373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 608/1193] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:17:58.061639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03d336-7578-473f-84e0-3628550e74fb None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.062072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03d336-7578-473f-84e0-3628550e74fb None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.062243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03d336-7578-473f-84e0-3628550e74fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.080672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-db03d336-7578-473f-84e0-3628550e74fb None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:17:58.081909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-db03d336-7578-473f-84e0-3628550e74fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:17:58.153825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 586/1194] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:17:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:17:58.430860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ab022-4d1a-4545-a812-a18f65281116 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:58.562589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ab022-4d1a-4545-a812-a18f65281116 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:58.586235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:58.609277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355501a8-b532-4148-a71d-c2482fe539fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:58.609937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355501a8-b532-4148-a71d-c2482fe539fc None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.610232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355501a8-b532-4148-a71d-c2482fe539fc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.610507 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355501a8-b532-4148-a71d-c2482fe539fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.623143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355501a8-b532-4148-a71d-c2482fe539fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-355501a8-b532-4148-a71d-c2482fe539fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:17:58.628049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:17:58.630056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:17:58.631931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 609/1195] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:17:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:17:58.635850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03d336-7578-473f-84e0-3628550e74fb None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:58.677872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:58.761439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03d336-7578-473f-84e0-3628550e74fb None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:58.814503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7211919-d488-468f-9a4c-736ab697be05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:58.818924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211919-d488-468f-9a4c-736ab697be05 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.818924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211919-d488-468f-9a4c-736ab697be05 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.818924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7211919-d488-468f-9a4c-736ab697be05 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.818924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7211919-d488-468f-9a4c-736ab697be05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:58.818924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7211919-d488-468f-9a4c-736ab697be05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:58.818924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7211919-d488-468f-9a4c-736ab697be05 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:58.828629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 587/1196] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:17:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:17:58.834779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355501a8-b532-4148-a71d-c2482fe539fc None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:58.949520 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355501a8-b532-4148-a71d-c2482fe539fc None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:58.987123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258dd2a-32a5-414f-baa8-1e06cefdd779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:58.987754 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258dd2a-32a5-414f-baa8-1e06cefdd779 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:58.988032 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258dd2a-32a5-414f-baa8-1e06cefdd779 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:58.988307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258dd2a-32a5-414f-baa8-1e06cefdd779 None admin] PATH_INFO: `/v3/users/469d5518ed664f18b13aff446ff770d1` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:58.989543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258dd2a-32a5-414f-baa8-1e06cefdd779 None admin] RBAC: Authorizing `identity:get_user(user_id=469d5518ed664f18b13aff446ff770d1)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:58.990970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258dd2a-32a5-414f-baa8-1e06cefdd779 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:58.992710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 610/1197] 10.222.0.74 () {56 vars in 1177 bytes} [Wed Aug 31 00:17:58 2022] GET /identity/v3/users/469d5518ed664f18b13aff446ff770d1 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:58.998901 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7211919-d488-468f-9a4c-736ab697be05 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:59.113113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:59.122701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7211919-d488-468f-9a4c-736ab697be05 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:59.172083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279377c-6985-4e17-9184-323674c68be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:59.172702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279377c-6985-4e17-9184-323674c68be7 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:59.172983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279377c-6985-4e17-9184-323674c68be7 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:59.173252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279377c-6985-4e17-9184-323674c68be7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:59.244752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279377c-6985-4e17-9184-323674c68be7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:59.246245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279377c-6985-4e17-9184-323674c68be7 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:59.348324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:59.361422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 588/1198] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:17:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:17:59.371824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258dd2a-32a5-414f-baa8-1e06cefdd779 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:59.410546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:17:59.472924 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258dd2a-32a5-414f-baa8-1e06cefdd779 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:59.509073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa79dc-b669-4968-8d11-5f7a6c960fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:59.509728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa79dc-b669-4968-8d11-5f7a6c960fe6 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:59.510011 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa79dc-b669-4968-8d11-5f7a6c960fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:59.510282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa79dc-b669-4968-8d11-5f7a6c960fe6 None admin] PATH_INFO: `/v3/projects/f94b674c3b3f4790b3a576be07df474d` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:59.511395 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa79dc-b669-4968-8d11-5f7a6c960fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=f94b674c3b3f4790b3a576be07df474d)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:59.512823 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa79dc-b669-4968-8d11-5f7a6c960fe6 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:59.514481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 611/1199] 10.222.0.74 () {56 vars in 1186 bytes} [Wed Aug 31 00:17:59 2022] GET /identity/v3/projects/f94b674c3b3f4790b3a576be07df474d => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:17:59.520639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279377c-6985-4e17-9184-323674c68be7 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:17:59.621715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279377c-6985-4e17-9184-323674c68be7 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:17:59.655385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acebd98-efdf-4afb-b6f4-888b34cce95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:17:59.655908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acebd98-efdf-4afb-b6f4-888b34cce95d None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:17:59.656188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acebd98-efdf-4afb-b6f4-888b34cce95d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:17:59.656460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acebd98-efdf-4afb-b6f4-888b34cce95d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:17:59.657171 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acebd98-efdf-4afb-b6f4-888b34cce95d None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=f94b674c3b3f4790b3a576be07df474d, user.id=469d5518ed664f18b13aff446ff770d1) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:17:59.657477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acebd98-efdf-4afb-b6f4-888b34cce95d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:17:59.658928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acebd98-efdf-4afb-b6f4-888b34cce95d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:17:59.665436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 589/1200] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:17:59 2022] GET /identity/v3/role_assignments?user.id=469d5518ed664f18b13aff446ff770d1&scope.project.id=f94b674c3b3f4790b3a576be07df474d&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:18:09.504033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=46 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:18:09.662037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=70 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:18.622637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42aa1-83e2-4bb3-9a74-0d501563f126 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:18.623228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42aa1-83e2-4bb3-9a74-0d501563f126 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:18.623228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42aa1-83e2-4bb3-9a74-0d501563f126 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:18.624563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 612/1201] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:18.629733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb735e6c-c395-49eb-98ad-677ebb9187de None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:18.630159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb735e6c-c395-49eb-98ad-677ebb9187de None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:18.630296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb735e6c-c395-49eb-98ad-677ebb9187de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:18.649962 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-fb735e6c-c395-49eb-98ad-677ebb9187de None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:18.651285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-fb735e6c-c395-49eb-98ad-677ebb9187de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:18.720655 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 590/1202] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:19:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:19:18.998020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c42aa1-83e2-4bb3-9a74-0d501563f126 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.099999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c42aa1-83e2-4bb3-9a74-0d501563f126 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.135665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa04957-25b7-424c-aac9-628dd2a2ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.136250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa04957-25b7-424c-aac9-628dd2a2ad3f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.136527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa04957-25b7-424c-aac9-628dd2a2ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.136805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa04957-25b7-424c-aac9-628dd2a2ad3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.147121 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa04957-25b7-424c-aac9-628dd2a2ad3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.149253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa04957-25b7-424c-aac9-628dd2a2ad3f None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-3aa04957-25b7-424c-aac9-628dd2a2ad3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:19.163679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:19.165528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:19.184414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:19.184414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:19.184414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:19.184414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 613/1203] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:19.184738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb735e6c-c395-49eb-98ad-677ebb9187de None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.274012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb735e6c-c395-49eb-98ad-677ebb9187de None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.303942 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:19.310486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc79e5-9147-4a9d-b8a5-44f9917407bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.311092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc79e5-9147-4a9d-b8a5-44f9917407bb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.311374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc79e5-9147-4a9d-b8a5-44f9917407bb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.311644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc79e5-9147-4a9d-b8a5-44f9917407bb None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.312285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc79e5-9147-4a9d-b8a5-44f9917407bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:19.312587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc79e5-9147-4a9d-b8a5-44f9917407bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.313998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc79e5-9147-4a9d-b8a5-44f9917407bb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.325302 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 591/1204] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:19.331279 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa04957-25b7-424c-aac9-628dd2a2ad3f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:19.385921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:19.433334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa04957-25b7-424c-aac9-628dd2a2ad3f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:19.466508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e22816-9525-41cc-9895-242c90125db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:19.467107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e22816-9525-41cc-9895-242c90125db0 None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:19.467384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e22816-9525-41cc-9895-242c90125db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:19.467656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e22816-9525-41cc-9895-242c90125db0 None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:19.468315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e22816-9525-41cc-9895-242c90125db0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:19.469800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e22816-9525-41cc-9895-242c90125db0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:19.583766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 614/1205] 10.222.0.74 () {60 vars in 1132 bytes} [Wed Aug 31 00:19:19 2022] POST /identity/v3/users => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:21.571726 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2828a-226e-4417-9120-b5206d179dbd None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:21.572333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2828a-226e-4417-9120-b5206d179dbd None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:21.572333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2828a-226e-4417-9120-b5206d179dbd None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:21.573641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 592/1206] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:21.578869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610874a1-d075-48d9-815d-8702e7b24412 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:21.579268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610874a1-d075-48d9-815d-8702e7b24412 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:21.579425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610874a1-d075-48d9-815d-8702e7b24412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:21.597882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-610874a1-d075-48d9-815d-8702e7b24412 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:21.599080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-610874a1-d075-48d9-815d-8702e7b24412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:21.674242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 615/1207] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:19:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:19:21.951104 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2828a-226e-4417-9120-b5206d179dbd None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.056878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2828a-226e-4417-9120-b5206d179dbd None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.092579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5fcf5-52b6-4bde-8668-1ebd4593428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.093210 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5fcf5-52b6-4bde-8668-1ebd4593428e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.093484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5fcf5-52b6-4bde-8668-1ebd4593428e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.093782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5fcf5-52b6-4bde-8668-1ebd4593428e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.104354 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5fcf5-52b6-4bde-8668-1ebd4593428e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-5de5fcf5-52b6-4bde-8668-1ebd4593428e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:19:22.109127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:22.110316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:22.111253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 593/1208] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:22.116460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610874a1-d075-48d9-815d-8702e7b24412 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.157950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:22.221024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610874a1-d075-48d9-815d-8702e7b24412 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.255575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06d2f-7c9d-4a7e-af6b-5b8796e3ceb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.256178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06d2f-7c9d-4a7e-af6b-5b8796e3ceb8 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.256456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06d2f-7c9d-4a7e-af6b-5b8796e3ceb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.256730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06d2f-7c9d-4a7e-af6b-5b8796e3ceb8 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.257393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa06d2f-7c9d-4a7e-af6b-5b8796e3ceb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:22.258263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa06d2f-7c9d-4a7e-af6b-5b8796e3ceb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.260970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa06d2f-7c9d-4a7e-af6b-5b8796e3ceb8 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.268328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 616/1209] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:19:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:22.275325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5fcf5-52b6-4bde-8668-1ebd4593428e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.326743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:22.376862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5fcf5-52b6-4bde-8668-1ebd4593428e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.412360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cbcaa-c951-4c6c-92f0-0ed4406ed533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.412908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cbcaa-c951-4c6c-92f0-0ed4406ed533 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.413185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cbcaa-c951-4c6c-92f0-0ed4406ed533 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.413456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cbcaa-c951-4c6c-92f0-0ed4406ed533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.426774 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cbcaa-c951-4c6c-92f0-0ed4406ed533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.428213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cbcaa-c951-4c6c-92f0-0ed4406ed533 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-a41cbcaa-c951-4c6c-92f0-0ed4406ed533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:22.443280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:22.446246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:22.447672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:22.447672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:22.447672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:22.447672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 594/1210] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:22.451331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06d2f-7c9d-4a7e-af6b-5b8796e3ceb8 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.555378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:22.558776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06d2f-7c9d-4a7e-af6b-5b8796e3ceb8 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.594674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d794e7-4a36-49d8-b8eb-7bb2d7d378d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.595365 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d794e7-4a36-49d8-b8eb-7bb2d7d378d0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.595549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d794e7-4a36-49d8-b8eb-7bb2d7d378d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.595819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d794e7-4a36-49d8-b8eb-7bb2d7d378d0 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.596457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d794e7-4a36-49d8-b8eb-7bb2d7d378d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:22.596757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d794e7-4a36-49d8-b8eb-7bb2d7d378d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.598150 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d794e7-4a36-49d8-b8eb-7bb2d7d378d0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.609869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 617/1211] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:22.615690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cbcaa-c951-4c6c-92f0-0ed4406ed533 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.723202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cbcaa-c951-4c6c-92f0-0ed4406ed533 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.724624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:22.766117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3401c2-97f4-45ca-8a58-8a94d72e577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.766859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3401c2-97f4-45ca-8a58-8a94d72e577b None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.767166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3401c2-97f4-45ca-8a58-8a94d72e577b None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.767446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3401c2-97f4-45ca-8a58-8a94d72e577b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.775840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3401c2-97f4-45ca-8a58-8a94d72e577b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.777328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3401c2-97f4-45ca-8a58-8a94d72e577b None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-1a3401c2-97f4-45ca-8a58-8a94d72e577b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:19:22.790598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:22.792470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:22.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:22.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:22.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:19:22.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:19:22.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:19:22.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:19:22.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:19:22.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:19:22.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:22.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:22.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 595/1212] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:22.798213 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d794e7-4a36-49d8-b8eb-7bb2d7d378d0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:22.911360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d794e7-4a36-49d8-b8eb-7bb2d7d378d0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:22.953388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a344f6e-7d08-400a-a393-738597aa5ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:22.954085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a344f6e-7d08-400a-a393-738597aa5ff3 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:22.954363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a344f6e-7d08-400a-a393-738597aa5ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:22.954642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a344f6e-7d08-400a-a393-738597aa5ff3 None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:22.955399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a344f6e-7d08-400a-a393-738597aa5ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:22.955709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a344f6e-7d08-400a-a393-738597aa5ff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:22.957153 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a344f6e-7d08-400a-a393-738597aa5ff3 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:22.978016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 618/1213] 10.222.0.74 () {56 vars in 1143 bytes} [Wed Aug 31 00:19:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:19:22.983954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3401c2-97f4-45ca-8a58-8a94d72e577b None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.096738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3401c2-97f4-45ca-8a58-8a94d72e577b None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:23.139090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112a4d1-3c9b-4aa2-aa20-f10ce220e390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:23.139090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a4d1-3c9b-4aa2-aa20-f10ce220e390 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.139090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a4d1-3c9b-4aa2-aa20-f10ce220e390 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.139090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112a4d1-3c9b-4aa2-aa20-f10ce220e390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.168702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:23.210299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112a4d1-3c9b-4aa2-aa20-f10ce220e390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.211915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112a4d1-3c9b-4aa2-aa20-f10ce220e390 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:23.322087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 596/1214] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:19:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:19:23.328097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a344f6e-7d08-400a-a393-738597aa5ff3 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.348444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:23.432702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a344f6e-7d08-400a-a393-738597aa5ff3 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:23.467628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb047f79-0378-42e4-b271-712997113698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:23.468251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb047f79-0378-42e4-b271-712997113698 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.468530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb047f79-0378-42e4-b271-712997113698 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.468801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb047f79-0378-42e4-b271-712997113698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.479052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb047f79-0378-42e4-b271-712997113698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.480498 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb047f79-0378-42e4-b271-712997113698 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-eb047f79-0378-42e4-b271-712997113698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:23.495847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:23.497029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:23.498232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:23.498232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:23.498232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:23.498232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 619/1215] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:23.502745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112a4d1-3c9b-4aa2-aa20-f10ce220e390 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.564861 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:23.604839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112a4d1-3c9b-4aa2-aa20-f10ce220e390 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:23.639618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0696150-5fb9-43ec-8031-f06b001c0476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:23.640247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0696150-5fb9-43ec-8031-f06b001c0476 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.640495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0696150-5fb9-43ec-8031-f06b001c0476 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.640772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0696150-5fb9-43ec-8031-f06b001c0476 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.641408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0696150-5fb9-43ec-8031-f06b001c0476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:23.641746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0696150-5fb9-43ec-8031-f06b001c0476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.643113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0696150-5fb9-43ec-8031-f06b001c0476 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:23.655357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 597/1216] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:23.661101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb047f79-0378-42e4-b271-712997113698 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.735028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:23.767381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb047f79-0378-42e4-b271-712997113698 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:23.801223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518a58-c931-4b7b-8446-1400f78ca4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:23.801875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518a58-c931-4b7b-8446-1400f78ca4a5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.802200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518a58-c931-4b7b-8446-1400f78ca4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.802596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74518a58-c931-4b7b-8446-1400f78ca4a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.809594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518a58-c931-4b7b-8446-1400f78ca4a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.811079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74518a58-c931-4b7b-8446-1400f78ca4a5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-74518a58-c931-4b7b-8446-1400f78ca4a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:19:23.823003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:23.824565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:23.825980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:19:23.825980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:19:23.825980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:19:23.825980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:19:23.825980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:19:23.825980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:19:23.825980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:23.825980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:23.825980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 620/1217] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:23.830135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0696150-5fb9-43ec-8031-f06b001c0476 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:23.952866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0696150-5fb9-43ec-8031-f06b001c0476 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:23.975661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:23.987240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5f58a-34fd-4d4f-b74c-bb18a1bb2199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:23.987852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5f58a-34fd-4d4f-b74c-bb18a1bb2199 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:23.988136 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5f58a-34fd-4d4f-b74c-bb18a1bb2199 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:23.988410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5f58a-34fd-4d4f-b74c-bb18a1bb2199 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:23.989109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5f58a-34fd-4d4f-b74c-bb18a1bb2199 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:23.989422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5f58a-34fd-4d4f-b74c-bb18a1bb2199 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:23.990892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5f58a-34fd-4d4f-b74c-bb18a1bb2199 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:24.003478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 598/1218] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:24.010759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518a58-c931-4b7b-8446-1400f78ca4a5 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:24.115583 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74518a58-c931-4b7b-8446-1400f78ca4a5 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:24.143912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:24.150399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818df8e6-ffa7-40f7-a973-f66a0d801e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:24.151005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818df8e6-ffa7-40f7-a973-f66a0d801e0b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:24.151291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818df8e6-ffa7-40f7-a973-f66a0d801e0b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:24.151562 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818df8e6-ffa7-40f7-a973-f66a0d801e0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:24.152282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818df8e6-ffa7-40f7-a973-f66a0d801e0b None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=5f8c004b9fe2402fbe94cfd7c2bf949e) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:24.152590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818df8e6-ffa7-40f7-a973-f66a0d801e0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:24.154132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818df8e6-ffa7-40f7-a973-f66a0d801e0b None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:24.161722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 621/1219] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:19:24 2022] GET /identity/v3/role_assignments?user.id=5f8c004b9fe2402fbe94cfd7c2bf949e&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:26.075635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4946b4-4e99-4022-98e4-031eb189bd00 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:26.076170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4946b4-4e99-4022-98e4-031eb189bd00 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:26.076170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4946b4-4e99-4022-98e4-031eb189bd00 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:26.077545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 599/1220] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:26.083164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dd87-2c6b-4cf7-ba48-1daa8c8e86a6 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:26.083765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dd87-2c6b-4cf7-ba48-1daa8c8e86a6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:26.083765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dd87-2c6b-4cf7-ba48-1daa8c8e86a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:26.103417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0628dd87-2c6b-4cf7-ba48-1daa8c8e86a6 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:26.104674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0628dd87-2c6b-4cf7-ba48-1daa8c8e86a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:26.178791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 622/1221] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:19:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:19:26.455676 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4946b4-4e99-4022-98e4-031eb189bd00 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:26.567020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4946b4-4e99-4022-98e4-031eb189bd00 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:26.611781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59216f8-6339-497d-96ca-9fef68e073b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:26.612417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59216f8-6339-497d-96ca-9fef68e073b7 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:26.612703 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59216f8-6339-497d-96ca-9fef68e073b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:26.612980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59216f8-6339-497d-96ca-9fef68e073b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:26.623805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59216f8-6339-497d-96ca-9fef68e073b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-e59216f8-6339-497d-96ca-9fef68e073b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:19:26.628658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:26.630013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:26.631065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 600/1222] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:19:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:26.636688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628dd87-2c6b-4cf7-ba48-1daa8c8e86a6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:26.752206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628dd87-2c6b-4cf7-ba48-1daa8c8e86a6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:26.776941 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:26.787896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36decdd3-fb19-435b-8c42-3b6d01cc0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:26.788512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decdd3-fb19-435b-8c42-3b6d01cc0896 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:26.788795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decdd3-fb19-435b-8c42-3b6d01cc0896 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:26.789624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decdd3-fb19-435b-8c42-3b6d01cc0896 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:26.790299 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36decdd3-fb19-435b-8c42-3b6d01cc0896 None admin] RBAC: Adding query filter params (name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:26.790607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36decdd3-fb19-435b-8c42-3b6d01cc0896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:26.791989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36decdd3-fb19-435b-8c42-3b6d01cc0896 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:26.800958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 623/1223] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:19:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:19:26.807719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59216f8-6339-497d-96ca-9fef68e073b7 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:26.856499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:26.918314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59216f8-6339-497d-96ca-9fef68e073b7 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:26.953288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b2efe-5fbf-4f88-af20-bad8e3a67ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:26.953950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b2efe-5fbf-4f88-af20-bad8e3a67ceb None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:26.954228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b2efe-5fbf-4f88-af20-bad8e3a67ceb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:26.954496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b2efe-5fbf-4f88-af20-bad8e3a67ceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:26.966609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b2efe-5fbf-4f88-af20-bad8e3a67ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:26.968072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b2efe-5fbf-4f88-af20-bad8e3a67ceb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-bc9b2efe-5fbf-4f88-af20-bad8e3a67ceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:26.984701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:26.985881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:26.986830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:26.986830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:26.986830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:26.986830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 601/1224] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:26.994811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36decdd3-fb19-435b-8c42-3b6d01cc0896 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:27.113036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36decdd3-fb19-435b-8c42-3b6d01cc0896 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:27.147691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43215589-049e-4bbb-a270-c29b2f4075ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:27.148971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43215589-049e-4bbb-a270-c29b2f4075ae None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:27.149106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43215589-049e-4bbb-a270-c29b2f4075ae None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:27.149444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43215589-049e-4bbb-a270-c29b2f4075ae None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:27.150054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43215589-049e-4bbb-a270-c29b2f4075ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:27.150362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43215589-049e-4bbb-a270-c29b2f4075ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:27.151724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43215589-049e-4bbb-a270-c29b2f4075ae None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:27.165806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 624/1225] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:27.172044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b2efe-5fbf-4f88-af20-bad8e3a67ceb None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:27.272223 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:27.279598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b2efe-5fbf-4f88-af20-bad8e3a67ceb None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:27.314839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e45128-c31b-49d6-a70d-e5234a07560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:27.315471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e45128-c31b-49d6-a70d-e5234a07560c None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:27.315775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e45128-c31b-49d6-a70d-e5234a07560c None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:27.316046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e45128-c31b-49d6-a70d-e5234a07560c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:27.324268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e45128-c31b-49d6-a70d-e5234a07560c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:27.325758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e45128-c31b-49d6-a70d-e5234a07560c None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-e0e45128-c31b-49d6-a70d-e5234a07560c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:19:27.338335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:27.344576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:27.345768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:27.345768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:27.345768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:19:27.345768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:19:27.345768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:19:27.345768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:19:27.345768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:19:27.345768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:19:27.345768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:27.345768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:27.345768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 602/1226] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:27.346507 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43215589-049e-4bbb-a270-c29b2f4075ae None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:27.402679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:27.463094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43215589-049e-4bbb-a270-c29b2f4075ae None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:27.498398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a58b93-e53b-478a-92a6-2d6b7b890f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:27.499013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a58b93-e53b-478a-92a6-2d6b7b890f2e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:27.499295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a58b93-e53b-478a-92a6-2d6b7b890f2e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:27.499571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a58b93-e53b-478a-92a6-2d6b7b890f2e None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:27.500304 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a58b93-e53b-478a-92a6-2d6b7b890f2e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:27.500611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a58b93-e53b-478a-92a6-2d6b7b890f2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:27.502096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a58b93-e53b-478a-92a6-2d6b7b890f2e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:27.522595 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 625/1227] 10.222.0.74 () {56 vars in 1143 bytes} [Wed Aug 31 00:19:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:27.528882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e45128-c31b-49d6-a70d-e5234a07560c None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:27.639384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e45128-c31b-49d6-a70d-e5234a07560c None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:27.677145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718738b0-b4c4-488f-bbfd-542023eab5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:27.677911 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718738b0-b4c4-488f-bbfd-542023eab5d0 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:27.678063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718738b0-b4c4-488f-bbfd-542023eab5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:27.678273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718738b0-b4c4-488f-bbfd-542023eab5d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:27.689705 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718738b0-b4c4-488f-bbfd-542023eab5d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:27.691219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718738b0-b4c4-488f-bbfd-542023eab5d0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-718738b0-b4c4-488f-bbfd-542023eab5d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:27.706550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:27.707761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:27.709011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:27.709011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:27.709011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:27.709011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 603/1228] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:27.714501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a58b93-e53b-478a-92a6-2d6b7b890f2e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:27.822541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a58b93-e53b-478a-92a6-2d6b7b890f2e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:27.824873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:27.858063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d20ce-608e-4e19-b2fa-1f37ddf8b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:27.858681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d20ce-608e-4e19-b2fa-1f37ddf8b6db None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:27.858960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d20ce-608e-4e19-b2fa-1f37ddf8b6db None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:27.859236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d20ce-608e-4e19-b2fa-1f37ddf8b6db None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:27.859885 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d20ce-608e-4e19-b2fa-1f37ddf8b6db None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:27.860190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d20ce-608e-4e19-b2fa-1f37ddf8b6db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:27.861656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d20ce-608e-4e19-b2fa-1f37ddf8b6db None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:27.876055 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 626/1229] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:27.882246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718738b0-b4c4-488f-bbfd-542023eab5d0 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:27.895059 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:28.038679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718738b0-b4c4-488f-bbfd-542023eab5d0 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:28.084543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466883ef-0ada-458b-80bb-969a73f5fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:28.085550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466883ef-0ada-458b-80bb-969a73f5fb39 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:28.086744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466883ef-0ada-458b-80bb-969a73f5fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:28.087195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466883ef-0ada-458b-80bb-969a73f5fb39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:28.097815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466883ef-0ada-458b-80bb-969a73f5fb39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:28.099470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466883ef-0ada-458b-80bb-969a73f5fb39 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-466883ef-0ada-458b-80bb-969a73f5fb39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:19:28.111858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:28.112931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:28.113969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:19:28.113969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:19:28.113969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:19:28.113969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:19:28.113969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:19:28.113969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:19:28.113969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:28.113969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:28.113969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 604/1230] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:19:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:28.119815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d20ce-608e-4e19-b2fa-1f37ddf8b6db None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:28.254987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d20ce-608e-4e19-b2fa-1f37ddf8b6db None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:28.302592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490d5ca-7903-4a8e-83be-c0afa9c7653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:28.303125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d5ca-7903-4a8e-83be-c0afa9c7653c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:28.303447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d5ca-7903-4a8e-83be-c0afa9c7653c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:28.303729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d5ca-7903-4a8e-83be-c0afa9c7653c None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:28.304476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490d5ca-7903-4a8e-83be-c0afa9c7653c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:28.305446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490d5ca-7903-4a8e-83be-c0afa9c7653c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:28.307128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490d5ca-7903-4a8e-83be-c0afa9c7653c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:28.320341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 627/1231] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:28.326646 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466883ef-0ada-458b-80bb-969a73f5fb39 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:28.395269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:28.434289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466883ef-0ada-458b-80bb-969a73f5fb39 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:28.470856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f77cce-cc17-4bae-a9b4-8c9a69a742eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:28.471507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77cce-cc17-4bae-a9b4-8c9a69a742eb None admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:28.471787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77cce-cc17-4bae-a9b4-8c9a69a742eb None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:28.472057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f77cce-cc17-4bae-a9b4-8c9a69a742eb None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/5f8c004b9fe2402fbe94cfd7c2bf949e/roles/a6ed0e9279a54b28a542e9a12ad503a3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:28.489526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f77cce-cc17-4bae-a9b4-8c9a69a742eb None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=5f8c004b9fe2402fbe94cfd7c2bf949e, role_id=a6ed0e9279a54b28a542e9a12ad503a3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:28.499183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f77cce-cc17-4bae-a9b4-8c9a69a742eb None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:28.666780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 605/1232] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:19:28 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/5f8c004b9fe2402fbe94cfd7c2bf949e/roles/a6ed0e9279a54b28a542e9a12ad503a3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:30.723627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960adf-b96c-4ee0-a94b-ee59b19143ae None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:30.724484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960adf-b96c-4ee0-a94b-ee59b19143ae None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:30.724642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960adf-b96c-4ee0-a94b-ee59b19143ae None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:30.726624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 628/1233] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:30.732023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07f7a9-5647-4120-af51-c5bb878a30c1 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:30.732490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07f7a9-5647-4120-af51-c5bb878a30c1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:30.732611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07f7a9-5647-4120-af51-c5bb878a30c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:30.752342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2c07f7a9-5647-4120-af51-c5bb878a30c1 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:30.753596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2c07f7a9-5647-4120-af51-c5bb878a30c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:30.827027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 606/1234] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:19:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:19:31.106018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d960adf-b96c-4ee0-a94b-ee59b19143ae None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:31.135007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:31.223286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d960adf-b96c-4ee0-a94b-ee59b19143ae None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:31.262085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f82c6-c12b-4579-a10a-d678cd55405f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:31.262462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f82c6-c12b-4579-a10a-d678cd55405f None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:31.262741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f82c6-c12b-4579-a10a-d678cd55405f None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:31.263016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f82c6-c12b-4579-a10a-d678cd55405f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:31.274609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f82c6-c12b-4579-a10a-d678cd55405f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-1b6f82c6-c12b-4579-a10a-d678cd55405f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:19:31.279825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:31.287489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:31.288368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 629/1235] 10.222.0.74 () {56 vars in 1102 bytes} [Wed Aug 31 00:19:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:31.289702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07f7a9-5647-4120-af51-c5bb878a30c1 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:31.341212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:31.409905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07f7a9-5647-4120-af51-c5bb878a30c1 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:31.452333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd963bea-a606-4824-a4f4-9d4849ba87d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:31.453182 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd963bea-a606-4824-a4f4-9d4849ba87d4 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:31.453607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd963bea-a606-4824-a4f4-9d4849ba87d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:31.454058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd963bea-a606-4824-a4f4-9d4849ba87d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:31.455140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd963bea-a606-4824-a4f4-9d4849ba87d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:31.455644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd963bea-a606-4824-a4f4-9d4849ba87d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:31.457967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd963bea-a606-4824-a4f4-9d4849ba87d4 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:31.468730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 607/1236] 10.222.0.74 () {56 vars in 1103 bytes} [Wed Aug 31 00:19:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:31.474803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f82c6-c12b-4579-a10a-d678cd55405f None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:31.569450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:31.588272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f82c6-c12b-4579-a10a-d678cd55405f None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:31.629018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5716bd-b2e1-4e0e-88fd-451457c9ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:31.629676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5716bd-b2e1-4e0e-88fd-451457c9ba5e None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:31.629963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5716bd-b2e1-4e0e-88fd-451457c9ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:31.630245 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5716bd-b2e1-4e0e-88fd-451457c9ba5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:31.641273 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5716bd-b2e1-4e0e-88fd-451457c9ba5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:31.642778 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5716bd-b2e1-4e0e-88fd-451457c9ba5e None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-1f5716bd-b2e1-4e0e-88fd-451457c9ba5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:31.659466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:31.660774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:31.661900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:31.661900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:31.661900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:31.661900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 630/1237] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:31.667343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd963bea-a606-4824-a4f4-9d4849ba87d4 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:31.777642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd963bea-a606-4824-a4f4-9d4849ba87d4 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:31.787285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:31.815275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc3754-ac40-403d-8f59-8066647b47ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:31.815893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc3754-ac40-403d-8f59-8066647b47ae None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:31.816176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc3754-ac40-403d-8f59-8066647b47ae None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:31.816445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc3754-ac40-403d-8f59-8066647b47ae None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:31.817098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc3754-ac40-403d-8f59-8066647b47ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:31.817404 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc3754-ac40-403d-8f59-8066647b47ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:31.818827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc3754-ac40-403d-8f59-8066647b47ae None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:31.831097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 608/1238] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:31.837169 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5716bd-b2e1-4e0e-88fd-451457c9ba5e None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:31.948986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5716bd-b2e1-4e0e-88fd-451457c9ba5e None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:31.994939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11fdd5-5823-4881-ab39-3d79af5b9957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:32.005964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11fdd5-5823-4881-ab39-3d79af5b9957 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:32.005964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11fdd5-5823-4881-ab39-3d79af5b9957 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:32.005964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11fdd5-5823-4881-ab39-3d79af5b9957 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:32.005964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:32.005964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11fdd5-5823-4881-ab39-3d79af5b9957 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:32.006566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11fdd5-5823-4881-ab39-3d79af5b9957 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-6c11fdd5-5823-4881-ab39-3d79af5b9957 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:19:32.018749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:32.019894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:32.020882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:32.020882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:32.020882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:19:32.020882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:19:32.020882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:19:32.020882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:19:32.020882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:19:32.020882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:19:32.020882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:32.020882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:32.020882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 631/1239] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:32.026571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc3754-ac40-403d-8f59-8066647b47ae None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:32.146861 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc3754-ac40-403d-8f59-8066647b47ae None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:32.188622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f05f-f4f8-42d7-9d64-9a3be7b6d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:32.189294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f05f-f4f8-42d7-9d64-9a3be7b6d077 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:32.189595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f05f-f4f8-42d7-9d64-9a3be7b6d077 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:32.189875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f05f-f4f8-42d7-9d64-9a3be7b6d077 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:32.190614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175f05f-f4f8-42d7-9d64-9a3be7b6d077 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:32.194444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175f05f-f4f8-42d7-9d64-9a3be7b6d077 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:32.194444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175f05f-f4f8-42d7-9d64-9a3be7b6d077 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:32.213765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 609/1240] 10.222.0.74 () {56 vars in 1143 bytes} [Wed Aug 31 00:19:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:32.220072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11fdd5-5823-4881-ab39-3d79af5b9957 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:32.338747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11fdd5-5823-4881-ab39-3d79af5b9957 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:32.373674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eae50b-3233-4c77-acaf-bb9ce93af5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:32.374276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eae50b-3233-4c77-acaf-bb9ce93af5b6 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:32.374530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eae50b-3233-4c77-acaf-bb9ce93af5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:32.374801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eae50b-3233-4c77-acaf-bb9ce93af5b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:32.442527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:32.450839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eae50b-3233-4c77-acaf-bb9ce93af5b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:32.452287 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eae50b-3233-4c77-acaf-bb9ce93af5b6 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:32.561853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 632/1241] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:19:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:19:32.567762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f05f-f4f8-42d7-9d64-9a3be7b6d077 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:32.596955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:32.688976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f05f-f4f8-42d7-9d64-9a3be7b6d077 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:32.724514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b370ca3-44d5-4303-9741-f59cb19821a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:32.725143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b370ca3-44d5-4303-9741-f59cb19821a9 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:32.725421 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b370ca3-44d5-4303-9741-f59cb19821a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:32.725733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b370ca3-44d5-4303-9741-f59cb19821a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:32.736513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b370ca3-44d5-4303-9741-f59cb19821a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:32.737987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b370ca3-44d5-4303-9741-f59cb19821a9 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-7b370ca3-44d5-4303-9741-f59cb19821a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:32.754260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:32.758880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:32.759997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:32.759997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:32.759997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:32.759997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 610/1242] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:32.762456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eae50b-3233-4c77-acaf-bb9ce93af5b6 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:32.863245 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:32.870368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eae50b-3233-4c77-acaf-bb9ce93af5b6 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:32.911156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d843e-9dd0-4215-820c-1fd01b68ecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:32.911852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d843e-9dd0-4215-820c-1fd01b68ecf2 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:32.912214 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d843e-9dd0-4215-820c-1fd01b68ecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:32.912528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d843e-9dd0-4215-820c-1fd01b68ecf2 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:32.913302 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d843e-9dd0-4215-820c-1fd01b68ecf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:32.914439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d843e-9dd0-4215-820c-1fd01b68ecf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:32.915818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d843e-9dd0-4215-820c-1fd01b68ecf2 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:32.927597 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 633/1243] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:32.933887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b370ca3-44d5-4303-9741-f59cb19821a9 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:33.036415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:33.056622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b370ca3-44d5-4303-9741-f59cb19821a9 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:33.096595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e02c4-5291-471c-8ace-a199d28e8061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:33.097230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e02c4-5291-471c-8ace-a199d28e8061 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:33.097631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e02c4-5291-471c-8ace-a199d28e8061 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:33.097907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e02c4-5291-471c-8ace-a199d28e8061 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:33.105507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e02c4-5291-471c-8ace-a199d28e8061 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:33.107086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e02c4-5291-471c-8ace-a199d28e8061 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-286e02c4-5291-471c-8ace-a199d28e8061 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:19:33.120300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:33.122085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:33.123730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:19:33.123730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:19:33.123730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:19:33.123730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:19:33.123730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:19:33.123730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:19:33.123730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:33.123730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:33.123730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 611/1244] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:19:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:33.129358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d843e-9dd0-4215-820c-1fd01b68ecf2 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:33.251667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d843e-9dd0-4215-820c-1fd01b68ecf2 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:33.288109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfe2c1-a12a-44a2-9ee9-fbba6fa33308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:33.289338 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfe2c1-a12a-44a2-9ee9-fbba6fa33308 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:33.289639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfe2c1-a12a-44a2-9ee9-fbba6fa33308 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:33.289917 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfe2c1-a12a-44a2-9ee9-fbba6fa33308 None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:33.290668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfe2c1-a12a-44a2-9ee9-fbba6fa33308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:33.290970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfe2c1-a12a-44a2-9ee9-fbba6fa33308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:33.292443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfe2c1-a12a-44a2-9ee9-fbba6fa33308 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:33.305167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 634/1245] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:19:33.312044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e02c4-5291-471c-8ace-a199d28e8061 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:33.424660 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e02c4-5291-471c-8ace-a199d28e8061 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:33.462275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf38c6-4ffb-4c52-b2fd-6fb5c8fe0060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:33.462877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf38c6-4ffb-4c52-b2fd-6fb5c8fe0060 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:33.463157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf38c6-4ffb-4c52-b2fd-6fb5c8fe0060 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:33.463517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf38c6-4ffb-4c52-b2fd-6fb5c8fe0060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:33.464239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf38c6-4ffb-4c52-b2fd-6fb5c8fe0060 None admin] RBAC: Adding query filter params (role.id=a6ed0e9279a54b28a542e9a12ad503a3, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=5f8c004b9fe2402fbe94cfd7c2bf949e) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:33.464545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf38c6-4ffb-4c52-b2fd-6fb5c8fe0060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:33.465992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf38c6-4ffb-4c52-b2fd-6fb5c8fe0060 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:33.472311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 612/1246] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:19:33 2022] GET /identity/v3/role_assignments?user.id=5f8c004b9fe2402fbe94cfd7c2bf949e&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=a6ed0e9279a54b28a542e9a12ad503a3 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:35.550409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bcef2-1482-4de2-a75a-42078997a3d0 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:35.550951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bcef2-1482-4de2-a75a-42078997a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:35.551068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bcef2-1482-4de2-a75a-42078997a3d0 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:35.552473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 635/1247] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:35.558637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ac25-8570-44af-8dd6-eb2482ad6449 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:35.559085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ac25-8570-44af-8dd6-eb2482ad6449 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:35.559176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ac25-8570-44af-8dd6-eb2482ad6449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:35.566445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:35.579390 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-4056ac25-8570-44af-8dd6-eb2482ad6449 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:35.580614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4056ac25-8570-44af-8dd6-eb2482ad6449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:35.651091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 613/1248] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:19:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:19:35.928331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bcef2-1482-4de2-a75a-42078997a3d0 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:35.949425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:36.064452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bcef2-1482-4de2-a75a-42078997a3d0 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:36.102950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0aa5db-3c96-4f87-bc96-cef27730a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:36.103614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aa5db-3c96-4f87-bc96-cef27730a96c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.103896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aa5db-3c96-4f87-bc96-cef27730a96c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.104168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aa5db-3c96-4f87-bc96-cef27730a96c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.119333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0aa5db-3c96-4f87-bc96-cef27730a96c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-3d0aa5db-3c96-4f87-bc96-cef27730a96c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:19:36.124256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:36.125728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:36.126846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 636/1249] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:19:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:36.135762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056ac25-8570-44af-8dd6-eb2482ad6449 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.256102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056ac25-8570-44af-8dd6-eb2482ad6449 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:36.290495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:36.295776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be84e1e-53d2-42e3-8e0d-263d5c5c446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:36.296385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be84e1e-53d2-42e3-8e0d-263d5c5c446e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.296663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be84e1e-53d2-42e3-8e0d-263d5c5c446e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.296933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be84e1e-53d2-42e3-8e0d-263d5c5c446e None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.297662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be84e1e-53d2-42e3-8e0d-263d5c5c446e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:36.297954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be84e1e-53d2-42e3-8e0d-263d5c5c446e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:36.299319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be84e1e-53d2-42e3-8e0d-263d5c5c446e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:36.308999 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 614/1250] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:19:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:36.314423 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0aa5db-3c96-4f87-bc96-cef27730a96c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.398870 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:36.424206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0aa5db-3c96-4f87-bc96-cef27730a96c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:36.462232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285656e-ba60-475d-b3c7-61859f2d7520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:36.462862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285656e-ba60-475d-b3c7-61859f2d7520 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.463160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285656e-ba60-475d-b3c7-61859f2d7520 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.463454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285656e-ba60-475d-b3c7-61859f2d7520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.474383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285656e-ba60-475d-b3c7-61859f2d7520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:36.476920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285656e-ba60-475d-b3c7-61859f2d7520 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-0285656e-ba60-475d-b3c7-61859f2d7520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:36.500316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:36.501521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:36.502582 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:36.502582 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:36.502582 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:36.502582 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 637/1251] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:36.511340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be84e1e-53d2-42e3-8e0d-263d5c5c446e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.630751 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be84e1e-53d2-42e3-8e0d-263d5c5c446e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:36.669739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a138c2-d67d-4d55-bfb9-ec0f19f805f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:36.670109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a138c2-d67d-4d55-bfb9-ec0f19f805f4 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.670239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a138c2-d67d-4d55-bfb9-ec0f19f805f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.670729 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a138c2-d67d-4d55-bfb9-ec0f19f805f4 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.671372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a138c2-d67d-4d55-bfb9-ec0f19f805f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:36.671676 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a138c2-d67d-4d55-bfb9-ec0f19f805f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:36.673097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a138c2-d67d-4d55-bfb9-ec0f19f805f4 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:36.685291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 615/1252] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:36.691054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285656e-ba60-475d-b3c7-61859f2d7520 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.809142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285656e-ba60-475d-b3c7-61859f2d7520 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:36.838246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:36.846785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d43e97-cc89-4daa-8e20-9f6a44ed68dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:36.847421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d43e97-cc89-4daa-8e20-9f6a44ed68dc None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:36.847701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d43e97-cc89-4daa-8e20-9f6a44ed68dc None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:36.847974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d43e97-cc89-4daa-8e20-9f6a44ed68dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:36.857059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d43e97-cc89-4daa-8e20-9f6a44ed68dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:36.858633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d43e97-cc89-4daa-8e20-9f6a44ed68dc None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-76d43e97-cc89-4daa-8e20-9f6a44ed68dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:19:36.870426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:36.871561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:36.872645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:36.872645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:36.872645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:19:36.872645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:19:36.872645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:19:36.872645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:19:36.872645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:19:36.872645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:19:36.872645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:36.872645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:36.872645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 638/1253] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:36.877663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a138c2-d67d-4d55-bfb9-ec0f19f805f4 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:36.936861 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:36.987585 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a138c2-d67d-4d55-bfb9-ec0f19f805f4 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:37.038321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024894-85f3-44f2-9780-2622755c4eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:37.039717 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024894-85f3-44f2-9780-2622755c4eb6 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:37.040137 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024894-85f3-44f2-9780-2622755c4eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:37.040583 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024894-85f3-44f2-9780-2622755c4eb6 None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:37.041642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c024894-85f3-44f2-9780-2622755c4eb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:37.042012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c024894-85f3-44f2-9780-2622755c4eb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:37.043894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c024894-85f3-44f2-9780-2622755c4eb6 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:37.070221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 616/1254] 10.222.0.74 () {56 vars in 1143 bytes} [Wed Aug 31 00:19:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:37.076612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d43e97-cc89-4daa-8e20-9f6a44ed68dc None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:37.208739 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d43e97-cc89-4daa-8e20-9f6a44ed68dc None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:37.247513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb934d-91ed-4b0a-aabb-db40d1950c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:37.248544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb934d-91ed-4b0a-aabb-db40d1950c79 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:37.249039 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb934d-91ed-4b0a-aabb-db40d1950c79 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:37.249514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb934d-91ed-4b0a-aabb-db40d1950c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:37.321384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:37.336023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb934d-91ed-4b0a-aabb-db40d1950c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:37.337610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb934d-91ed-4b0a-aabb-db40d1950c79 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:37.449229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 639/1255] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:19:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:19:37.455535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024894-85f3-44f2-9780-2622755c4eb6 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:37.575678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024894-85f3-44f2-9780-2622755c4eb6 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:37.591160 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:37.619199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c5b4-aaaf-48ab-b473-01c2f3ededf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:37.620240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c5b4-aaaf-48ab-b473-01c2f3ededf0 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:37.620700 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c5b4-aaaf-48ab-b473-01c2f3ededf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:37.621166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17c5b4-aaaf-48ab-b473-01c2f3ededf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:37.639667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17c5b4-aaaf-48ab-b473-01c2f3ededf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:37.642466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17c5b4-aaaf-48ab-b473-01c2f3ededf0 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-de17c5b4-aaaf-48ab-b473-01c2f3ededf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:37.662749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:37.664716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:37.666032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:37.666032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:37.666032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:37.666032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 617/1256] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:19:37.671559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb934d-91ed-4b0a-aabb-db40d1950c79 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:37.776918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:37.790380 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb934d-91ed-4b0a-aabb-db40d1950c79 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:37.827335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2dd72-f503-4080-858c-f152287a3090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:37.827879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2dd72-f503-4080-858c-f152287a3090 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:37.828162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2dd72-f503-4080-858c-f152287a3090 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:37.828438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2dd72-f503-4080-858c-f152287a3090 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:37.829096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2dd72-f503-4080-858c-f152287a3090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:37.829429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2dd72-f503-4080-858c-f152287a3090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:37.830927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2dd72-f503-4080-858c-f152287a3090 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:37.844600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 640/1257] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:37.850522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c5b4-aaaf-48ab-b473-01c2f3ededf0 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:37.955081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17c5b4-aaaf-48ab-b473-01c2f3ededf0 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:37.993003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15735222-d983-4c87-a4d5-3a68058d7930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:37.993657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15735222-d983-4c87-a4d5-3a68058d7930 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:37.993938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15735222-d983-4c87-a4d5-3a68058d7930 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:37.994218 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15735222-d983-4c87-a4d5-3a68058d7930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:38.001918 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15735222-d983-4c87-a4d5-3a68058d7930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:38.003373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15735222-d983-4c87-a4d5-3a68058d7930 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-15735222-d983-4c87-a4d5-3a68058d7930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:19:38.016444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:38.018778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:38.019986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:19:38.019986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:19:38.019986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:19:38.019986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:19:38.019986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:19:38.019986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:19:38.019986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:38.019986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:38.019986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 618/1258] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:19:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:38.024088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2dd72-f503-4080-858c-f152287a3090 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:38.129484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2dd72-f503-4080-858c-f152287a3090 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:38.165680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0607dd-a80a-4312-b1b6-aef0b236dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:38.166294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0607dd-a80a-4312-b1b6-aef0b236dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:38.166571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0607dd-a80a-4312-b1b6-aef0b236dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:38.166841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0607dd-a80a-4312-b1b6-aef0b236dbc5 None admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:38.167538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0607dd-a80a-4312-b1b6-aef0b236dbc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:38.167843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0607dd-a80a-4312-b1b6-aef0b236dbc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:38.169280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0607dd-a80a-4312-b1b6-aef0b236dbc5 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:38.182546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 641/1259] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:38.188845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15735222-d983-4c87-a4d5-3a68058d7930 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:38.215919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:38.299574 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15735222-d983-4c87-a4d5-3a68058d7930 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:38.345070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462345b3-4370-4a85-87d3-45f7165faf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:38.345721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462345b3-4370-4a85-87d3-45f7165faf94 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:38.346008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462345b3-4370-4a85-87d3-45f7165faf94 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:38.346280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462345b3-4370-4a85-87d3-45f7165faf94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:38.347007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462345b3-4370-4a85-87d3-45f7165faf94 None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=5f8c004b9fe2402fbe94cfd7c2bf949e) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:38.347310 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462345b3-4370-4a85-87d3-45f7165faf94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:38.348762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462345b3-4370-4a85-87d3-45f7165faf94 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:38.355570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 619/1260] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:19:38 2022] GET /identity/v3/role_assignments?user.id=5f8c004b9fe2402fbe94cfd7c2bf949e&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:40.331928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23c7ee-e881-48d5-9a6f-1aba24df6c12 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.332515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23c7ee-e881-48d5-9a6f-1aba24df6c12 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.332515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23c7ee-e881-48d5-9a6f-1aba24df6c12 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.333880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 642/1261] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:40.339811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73ec06-bc64-447b-bf52-a3633270d2ea None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.340322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73ec06-bc64-447b-bf52-a3633270d2ea None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.340437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73ec06-bc64-447b-bf52-a3633270d2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.367495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-6c73ec06-bc64-447b-bf52-a3633270d2ea None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:40.368985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6c73ec06-bc64-447b-bf52-a3633270d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:40.447390 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 620/1262] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:19:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:19:40.725542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23c7ee-e881-48d5-9a6f-1aba24df6c12 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:40.737743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:40.835830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23c7ee-e881-48d5-9a6f-1aba24df6c12 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:40.871433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec33037-04c5-4061-9951-0c677ad9465b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:40.872055 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec33037-04c5-4061-9951-0c677ad9465b None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:40.872337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec33037-04c5-4061-9951-0c677ad9465b None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:40.872605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec33037-04c5-4061-9951-0c677ad9465b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:40.887397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec33037-04c5-4061-9951-0c677ad9465b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-9ec33037-04c5-4061-9951-0c677ad9465b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:19:40.891034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:40.892795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:40.894589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 643/1263] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:19:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:40.901073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73ec06-bc64-447b-bf52-a3633270d2ea None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:40.919768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:41.003903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73ec06-bc64-447b-bf52-a3633270d2ea None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.039991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b066a6-2aec-4ae3-88cb-816edc162b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.043062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b066a6-2aec-4ae3-88cb-816edc162b41 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.043062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b066a6-2aec-4ae3-88cb-816edc162b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.043062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b066a6-2aec-4ae3-88cb-816edc162b41 None admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.043062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b066a6-2aec-4ae3-88cb-816edc162b41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:41.043062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b066a6-2aec-4ae3-88cb-816edc162b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.043481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b066a6-2aec-4ae3-88cb-816edc162b41 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.054616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 621/1264] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:19:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:41.060896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec33037-04c5-4061-9951-0c677ad9465b None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.137880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:41.181286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec33037-04c5-4061-9951-0c677ad9465b None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.216825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01de86-fd64-4f69-b997-54f37adec8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.217455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01de86-fd64-4f69-b997-54f37adec8b0 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.217769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01de86-fd64-4f69-b997-54f37adec8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.218043 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01de86-fd64-4f69-b997-54f37adec8b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.229997 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01de86-fd64-4f69-b997-54f37adec8b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.231465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01de86-fd64-4f69-b997-54f37adec8b0 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-9d01de86-fd64-4f69-b997-54f37adec8b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:41.246906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:41.250056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:41.251180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:41.251180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:41.251180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:41.251180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 644/1265] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:41.255024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b066a6-2aec-4ae3-88cb-816edc162b41 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.353532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:41.373786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b066a6-2aec-4ae3-88cb-816edc162b41 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.410367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc7e55-a56f-40b8-87ae-911d28f41aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.410980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7e55-a56f-40b8-87ae-911d28f41aaa None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.411258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7e55-a56f-40b8-87ae-911d28f41aaa None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.411529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc7e55-a56f-40b8-87ae-911d28f41aaa None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.412166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc7e55-a56f-40b8-87ae-911d28f41aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:41.412472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc7e55-a56f-40b8-87ae-911d28f41aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.414428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc7e55-a56f-40b8-87ae-911d28f41aaa None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.426743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 622/1266] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:41.432762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01de86-fd64-4f69-b997-54f37adec8b0 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.551879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01de86-fd64-4f69-b997-54f37adec8b0 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.574433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:41.589747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776e48c-ed01-4c5a-b59d-304c506358a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.592219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e48c-ed01-4c5a-b59d-304c506358a9 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.592219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e48c-ed01-4c5a-b59d-304c506358a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.592219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e48c-ed01-4c5a-b59d-304c506358a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.598939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776e48c-ed01-4c5a-b59d-304c506358a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.600391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776e48c-ed01-4c5a-b59d-304c506358a9 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-c776e48c-ed01-4c5a-b59d-304c506358a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:19:41.612774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:41.614027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:41.615252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:41.615252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:41.615252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:19:41.615252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:19:41.615252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:19:41.615252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:19:41.615252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:19:41.615252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:19:41.615252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:41.615252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:41.615252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 645/1267] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:41.620399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc7e55-a56f-40b8-87ae-911d28f41aaa None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.728406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc7e55-a56f-40b8-87ae-911d28f41aaa None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.764699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df7478-d787-470c-8979-01439d7facfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.765309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7478-d787-470c-8979-01439d7facfd None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.765614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7478-d787-470c-8979-01439d7facfd None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.765889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df7478-d787-470c-8979-01439d7facfd None admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.766609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7478-d787-470c-8979-01439d7facfd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:41.766909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7478-d787-470c-8979-01439d7facfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.768340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df7478-d787-470c-8979-01439d7facfd None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.780171 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:41.791086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 623/1268] 10.222.0.74 () {56 vars in 1143 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:19:41.797121 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776e48c-ed01-4c5a-b59d-304c506358a9 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:41.915859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776e48c-ed01-4c5a-b59d-304c506358a9 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:41.957672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61da39-db32-426e-85ba-ac03bcc76052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:41.958458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61da39-db32-426e-85ba-ac03bcc76052 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:41.958728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61da39-db32-426e-85ba-ac03bcc76052 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:41.958992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61da39-db32-426e-85ba-ac03bcc76052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:41.970808 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61da39-db32-426e-85ba-ac03bcc76052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:41.972260 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61da39-db32-426e-85ba-ac03bcc76052 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-0f61da39-db32-426e-85ba-ac03bcc76052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:41.986902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:41.988216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:41.989521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:41.989521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:41.989521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:41.989521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 646/1269] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:41.995741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df7478-d787-470c-8979-01439d7facfd None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:42.126311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df7478-d787-470c-8979-01439d7facfd None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:42.170772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191742a5-0649-4265-9330-7a44014e5129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:42.172214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191742a5-0649-4265-9330-7a44014e5129 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:42.172214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191742a5-0649-4265-9330-7a44014e5129 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:42.172214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191742a5-0649-4265-9330-7a44014e5129 None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:42.172502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191742a5-0649-4265-9330-7a44014e5129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:42.172804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191742a5-0649-4265-9330-7a44014e5129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:42.174223 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191742a5-0649-4265-9330-7a44014e5129 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:42.187366 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 624/1270] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:42.193319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61da39-db32-426e-85ba-ac03bcc76052 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:42.224718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:42.292901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61da39-db32-426e-85ba-ac03bcc76052 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:42.329513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d623-f024-46c1-9283-729a4552abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:42.330183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d623-f024-46c1-9283-729a4552abce None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:42.330465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d623-f024-46c1-9283-729a4552abce None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:42.330741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d623-f024-46c1-9283-729a4552abce None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:42.337563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565d623-f024-46c1-9283-729a4552abce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:42.339038 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565d623-f024-46c1-9283-729a4552abce None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-a565d623-f024-46c1-9283-729a4552abce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:19:42.350138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:42.352647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:42.354310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:19:42.354310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:19:42.354310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:19:42.354310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:19:42.354310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:19:42.354310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:19:42.354310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:42.354310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:42.354310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 647/1271] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:42.358701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191742a5-0649-4265-9330-7a44014e5129 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:42.422161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:42.465761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191742a5-0649-4265-9330-7a44014e5129 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:42.500107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf585d48-e5a1-4420-b41a-993456ed47c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:42.500706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf585d48-e5a1-4420-b41a-993456ed47c1 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:42.501088 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf585d48-e5a1-4420-b41a-993456ed47c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:42.501367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf585d48-e5a1-4420-b41a-993456ed47c1 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:42.502093 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf585d48-e5a1-4420-b41a-993456ed47c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:42.502400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf585d48-e5a1-4420-b41a-993456ed47c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:42.503929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf585d48-e5a1-4420-b41a-993456ed47c1 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:42.517331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 625/1272] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:19:42.523588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d623-f024-46c1-9283-729a4552abce None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:42.619973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:42.628409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d623-f024-46c1-9283-729a4552abce None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:42.662790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a86540-06a2-4d85-ba0c-c8edaf7e0905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:42.663472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86540-06a2-4d85-ba0c-c8edaf7e0905 None admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:42.663750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86540-06a2-4d85-ba0c-c8edaf7e0905 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:42.664025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a86540-06a2-4d85-ba0c-c8edaf7e0905 None admin] PATH_INFO: `/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/5f8c004b9fe2402fbe94cfd7c2bf949e/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:42.666266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a86540-06a2-4d85-ba0c-c8edaf7e0905 None admin] RBAC: Authorizing `identity:create_grant(project_id=a1465dcc65f9440bae8263a2e2904fab, user_id=5f8c004b9fe2402fbe94cfd7c2bf949e, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:42.667713 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a86540-06a2-4d85-ba0c-c8edaf7e0905 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:42.798149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 648/1273] 10.222.0.74 () {58 vars in 1439 bytes} [Wed Aug 31 00:19:42 2022] PUT /identity/v3/projects/a1465dcc65f9440bae8263a2e2904fab/users/5f8c004b9fe2402fbe94cfd7c2bf949e/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:19:44.782701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f8474-e201-468b-98be-df1be2dfb50c None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.783265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f8474-e201-468b-98be-df1be2dfb50c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.783265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f8474-e201-468b-98be-df1be2dfb50c None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.784582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 626/1274] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:44.797154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727f421-6adc-4190-9996-ab8df863790f None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:44.798129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727f421-6adc-4190-9996-ab8df863790f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:44.798468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727f421-6adc-4190-9996-ab8df863790f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:44.820740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-c727f421-6adc-4190-9996-ab8df863790f None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:44.822005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c727f421-6adc-4190-9996-ab8df863790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:44.891892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 649/1275] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:19:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:19:45.181563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f8474-e201-468b-98be-df1be2dfb50c None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:45.282280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f8474-e201-468b-98be-df1be2dfb50c None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:45.300880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:45.318968 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db1a13-6601-4802-8f59-49fe3377a177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:45.320253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1a13-6601-4802-8f59-49fe3377a177 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:45.320755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1a13-6601-4802-8f59-49fe3377a177 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:45.321117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1a13-6601-4802-8f59-49fe3377a177 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:45.335859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db1a13-6601-4802-8f59-49fe3377a177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-16db1a13-6601-4802-8f59-49fe3377a177 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 00:19:45.344334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:45.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:45.346451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 627/1276] 10.222.0.74 () {56 vars in 1096 bytes} [Wed Aug 31 00:19:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:45.354247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727f421-6adc-4190-9996-ab8df863790f None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:45.440350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:45.458088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727f421-6adc-4190-9996-ab8df863790f None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:45.492874 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a795-6bfd-48bf-830a-a636db578e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:45.496815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a795-6bfd-48bf-830a-a636db578e99 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:45.496815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a795-6bfd-48bf-830a-a636db578e99 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:45.496815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a795-6bfd-48bf-830a-a636db578e99 None admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:45.496815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a795-6bfd-48bf-830a-a636db578e99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:45.496815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a795-6bfd-48bf-830a-a636db578e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:45.496815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a795-6bfd-48bf-830a-a636db578e99 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:45.504536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 650/1277] 10.222.0.74 () {56 vars in 1099 bytes} [Wed Aug 31 00:19:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:45.510698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db1a13-6601-4802-8f59-49fe3377a177 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:45.614427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db1a13-6601-4802-8f59-49fe3377a177 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:45.653186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164101b8-d516-4f25-b6d0-f7fe697cb949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:45.654318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164101b8-d516-4f25-b6d0-f7fe697cb949 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:45.654841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164101b8-d516-4f25-b6d0-f7fe697cb949 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:45.655263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164101b8-d516-4f25-b6d0-f7fe697cb949 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:45.666769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164101b8-d516-4f25-b6d0-f7fe697cb949 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:45.668248 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164101b8-d516-4f25-b6d0-f7fe697cb949 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-164101b8-d516-4f25-b6d0-f7fe697cb949 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:45.686070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:45.687982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:45.689945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:45.689945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:45.689945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:45.689945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 628/1278] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:45.694166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a795-6bfd-48bf-830a-a636db578e99 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:45.797650 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a795-6bfd-48bf-830a-a636db578e99 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:45.836709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88eff4-b721-4acf-ac7f-447049960114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:45.840241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88eff4-b721-4acf-ac7f-447049960114 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:45.840241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88eff4-b721-4acf-ac7f-447049960114 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:45.840241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88eff4-b721-4acf-ac7f-447049960114 None admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:45.840241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88eff4-b721-4acf-ac7f-447049960114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:45.840241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88eff4-b721-4acf-ac7f-447049960114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:45.840241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88eff4-b721-4acf-ac7f-447049960114 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:45.852246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 651/1279] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:45.858152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164101b8-d516-4f25-b6d0-f7fe697cb949 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:45.889729 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:45.962344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164101b8-d516-4f25-b6d0-f7fe697cb949 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:46.000512 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674d092-eb99-447d-9b6d-798b00cafe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:46.001144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674d092-eb99-447d-9b6d-798b00cafe3d None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:46.001428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674d092-eb99-447d-9b6d-798b00cafe3d None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:46.001735 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674d092-eb99-447d-9b6d-798b00cafe3d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:46.010498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674d092-eb99-447d-9b6d-798b00cafe3d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:46.011960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674d092-eb99-447d-9b6d-798b00cafe3d None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-5674d092-eb99-447d-9b6d-798b00cafe3d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 00:19:46.023841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:46.029001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:46.030260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:46.030260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:46.030260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 00:19:46.030260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 00:19:46.030260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 00:19:46.030260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 00:19:46.030260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 00:19:46.030260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 00:19:46.030260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 00:19:46.030260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:46.030260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 629/1280] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:46.031039 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88eff4-b721-4acf-ac7f-447049960114 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:46.034804 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:46.134456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88eff4-b721-4acf-ac7f-447049960114 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:46.169036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1246f53-1908-4b00-9fcb-a2490c2eebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:46.169730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1246f53-1908-4b00-9fcb-a2490c2eebbd None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:46.170016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1246f53-1908-4b00-9fcb-a2490c2eebbd None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:46.170292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1246f53-1908-4b00-9fcb-a2490c2eebbd None admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:46.171274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1246f53-1908-4b00-9fcb-a2490c2eebbd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:46.171583 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1246f53-1908-4b00-9fcb-a2490c2eebbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:46.173006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1246f53-1908-4b00-9fcb-a2490c2eebbd None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:46.190750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 652/1281] 10.222.0.74 () {56 vars in 1143 bytes} [Wed Aug 31 00:19:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:46.196747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674d092-eb99-447d-9b6d-798b00cafe3d None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:46.286117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:46.296873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674d092-eb99-447d-9b6d-798b00cafe3d None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:46.331790 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccc019-8861-49e2-a1aa-83937238ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:46.332435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccc019-8861-49e2-a1aa-83937238ef8e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:46.332713 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccc019-8861-49e2-a1aa-83937238ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:46.332984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccc019-8861-49e2-a1aa-83937238ef8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:46.402484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccc019-8861-49e2-a1aa-83937238ef8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:46.403931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccc019-8861-49e2-a1aa-83937238ef8e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:46.492265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:46.502443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 630/1282] 10.222.0.74 () {58 vars in 1282 bytes} [Wed Aug 31 00:19:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 00:19:46.508516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1246f53-1908-4b00-9fcb-a2490c2eebbd None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:46.580373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:46.619561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1246f53-1908-4b00-9fcb-a2490c2eebbd None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:46.653260 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a9fbf-9203-47d4-9fa8-26429c9fde25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:46.653915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a9fbf-9203-47d4-9fa8-26429c9fde25 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:46.654199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a9fbf-9203-47d4-9fa8-26429c9fde25 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:46.654476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a9fbf-9203-47d4-9fa8-26429c9fde25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:46.666539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a9fbf-9203-47d4-9fa8-26429c9fde25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:46.667993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a9fbf-9203-47d4-9fa8-26429c9fde25 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-a09a9fbf-9203-47d4-9fa8-26429c9fde25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 00:19:46.683691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:46.684782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 00:19:46.686077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 00:19:46.686077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 00:19:46.686077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:46.686077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 653/1283] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:46.690837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccc019-8861-49e2-a1aa-83937238ef8e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:46.792982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccc019-8861-49e2-a1aa-83937238ef8e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:46.828219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e72808-fc19-4772-b978-d726f20e27ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:46.828819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e72808-fc19-4772-b978-d726f20e27ed None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:46.829096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e72808-fc19-4772-b978-d726f20e27ed None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:46.829365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e72808-fc19-4772-b978-d726f20e27ed None admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:46.830031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e72808-fc19-4772-b978-d726f20e27ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:46.830355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e72808-fc19-4772-b978-d726f20e27ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:46.831806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e72808-fc19-4772-b978-d726f20e27ed None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:46.843405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 631/1284] 10.222.0.74 () {56 vars in 1109 bytes} [Wed Aug 31 00:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:46.849381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a9fbf-9203-47d4-9fa8-26429c9fde25 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:46.950434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a9fbf-9203-47d4-9fa8-26429c9fde25 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:46.964193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:46.984887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edefc07-7aac-4fd7-9d87-4be363b20978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:46.985508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edefc07-7aac-4fd7-9d87-4be363b20978 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:46.985820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edefc07-7aac-4fd7-9d87-4be363b20978 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:46.986097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edefc07-7aac-4fd7-9d87-4be363b20978 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:46.992640 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edefc07-7aac-4fd7-9d87-4be363b20978 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:47.002630 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edefc07-7aac-4fd7-9d87-4be363b20978 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application [None req-3edefc07-7aac-4fd7-9d87-4be363b20978 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 00:19:47.004994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:47.006045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:47.007519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 00:19:47.007519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 00:19:47.007519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 00:19:47.007519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 00:19:47.007519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 00:19:47.007519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 00:19:47.007519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 00:19:47.007519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: ERROR keystone.server.flask.application Aug 31 00:19:47.007519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 654/1285] 10.222.0.74 () {56 vars in 1111 bytes} [Wed Aug 31 00:19:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:47.013010 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e72808-fc19-4772-b978-d726f20e27ed None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:47.063257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:47.113324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e72808-fc19-4772-b978-d726f20e27ed None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:47.150910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc46ac-9999-4995-abed-d694ef182557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:47.151662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc46ac-9999-4995-abed-d694ef182557 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.151953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc46ac-9999-4995-abed-d694ef182557 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.152224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc46ac-9999-4995-abed-d694ef182557 None admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.152913 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc46ac-9999-4995-abed-d694ef182557 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:47.153221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc46ac-9999-4995-abed-d694ef182557 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:47.154676 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc46ac-9999-4995-abed-d694ef182557 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:47.166723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 632/1286] 10.222.0.74 () {56 vars in 1148 bytes} [Wed Aug 31 00:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:47.173235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edefc07-7aac-4fd7-9d87-4be363b20978 None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:47.275370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edefc07-7aac-4fd7-9d87-4be363b20978 None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:47.312642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa67f82-5485-4675-bf73-042fed70b9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:47.313232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa67f82-5485-4675-bf73-042fed70b9e8 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:47.313508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa67f82-5485-4675-bf73-042fed70b9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:47.313807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa67f82-5485-4675-bf73-042fed70b9e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:47.314575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa67f82-5485-4675-bf73-042fed70b9e8 None admin] RBAC: Adding query filter params (role.id=ee97cd77207b4be8aa55a8eb6093bb75, scope.project.id=a1465dcc65f9440bae8263a2e2904fab, user.id=5f8c004b9fe2402fbe94cfd7c2bf949e) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:47.314872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa67f82-5485-4675-bf73-042fed70b9e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:47.316286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa67f82-5485-4675-bf73-042fed70b9e8 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:47.322111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 655/1287] 10.222.0.74 () {56 vars in 1374 bytes} [Wed Aug 31 00:19:47 2022] GET /identity/v3/role_assignments?user.id=5f8c004b9fe2402fbe94cfd7c2bf949e&scope.project.id=a1465dcc65f9440bae8263a2e2904fab&role.id=ee97cd77207b4be8aa55a8eb6093bb75 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:49.365143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6da7fb-2f52-4ac4-970c-8e440dc263ed None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:49.365981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6da7fb-2f52-4ac4-970c-8e440dc263ed None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:49.365981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6da7fb-2f52-4ac4-970c-8e440dc263ed None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:49.367880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 633/1288] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:19:49.375586 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806a1a9-f563-43e4-ae74-22a3c8476e16 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:49.377936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806a1a9-f563-43e4-ae74-22a3c8476e16 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:49.377936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806a1a9-f563-43e4-ae74-22a3c8476e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:49.398569 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-6806a1a9-f563-43e4-ae74-22a3c8476e16 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:49.399820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6806a1a9-f563-43e4-ae74-22a3c8476e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:49.440120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:49.493289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 656/1289] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:19:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:19:49.780246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6da7fb-2f52-4ac4-970c-8e440dc263ed None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:49.904701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6da7fb-2f52-4ac4-970c-8e440dc263ed None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:49.916130 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:49.939606 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc659f-c5c0-4e61-a564-f7c83f2c2913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:49.940235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc659f-c5c0-4e61-a564-f7c83f2c2913 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:49.940513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc659f-c5c0-4e61-a564-f7c83f2c2913 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:49.940784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc659f-c5c0-4e61-a564-f7c83f2c2913 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:49.941358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc659f-c5c0-4e61-a564-f7c83f2c2913 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:49.942770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc659f-c5c0-4e61-a564-f7c83f2c2913 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-6bcc659f-c5c0-4e61-a564-f7c83f2c2913 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:49.951829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:49.954563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:49.955484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 634/1290] 10.222.0.74 () {56 vars in 1117 bytes} [Wed Aug 31 00:19:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 00:19:49.960044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806a1a9-f563-43e4-ae74-22a3c8476e16 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:50.093788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806a1a9-f563-43e4-ae74-22a3c8476e16 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:50.137903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25272a8f-6fa0-4d0c-8a41-f62ff5881162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:50.138601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25272a8f-6fa0-4d0c-8a41-f62ff5881162 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:50.138940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25272a8f-6fa0-4d0c-8a41-f62ff5881162 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:50.139253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25272a8f-6fa0-4d0c-8a41-f62ff5881162 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:50.139926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25272a8f-6fa0-4d0c-8a41-f62ff5881162 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:50.140271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25272a8f-6fa0-4d0c-8a41-f62ff5881162 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:50.141838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25272a8f-6fa0-4d0c-8a41-f62ff5881162 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:50.146862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 657/1291] 10.222.0.74 () {56 vars in 1116 bytes} [Wed Aug 31 00:19:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:50.153382 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc659f-c5c0-4e61-a564-f7c83f2c2913 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:50.259825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc659f-c5c0-4e61-a564-f7c83f2c2913 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:50.299450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7a255-ca79-4e93-8a98-2db73a59e617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:50.300056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a255-ca79-4e93-8a98-2db73a59e617 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:50.300335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a255-ca79-4e93-8a98-2db73a59e617 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:50.300613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a255-ca79-4e93-8a98-2db73a59e617 None admin] PATH_INFO: `/v3/services` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:50.301274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7a255-ca79-4e93-8a98-2db73a59e617 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:50.301606 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7a255-ca79-4e93-8a98-2db73a59e617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:50.303161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7a255-ca79-4e93-8a98-2db73a59e617 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:50.308117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 635/1292] 10.222.0.74 () {56 vars in 1116 bytes} [Wed Aug 31 00:19:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:52.291734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ee86c-dfb8-406d-a165-bf068f19e5e6 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:52.292310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ee86c-dfb8-406d-a165-bf068f19e5e6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:52.292310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ee86c-dfb8-406d-a165-bf068f19e5e6 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:52.293681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 658/1293] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:52.299640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8f6a7-52f5-4899-89d2-32675d68d538 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:52.300181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8f6a7-52f5-4899-89d2-32675d68d538 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:52.300520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8f6a7-52f5-4899-89d2-32675d68d538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:52.318807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-48c8f6a7-52f5-4899-89d2-32675d68d538 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:52.320829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-48c8f6a7-52f5-4899-89d2-32675d68d538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:52.351787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:52.390720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 636/1294] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:19:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 00:19:52.657890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ee86c-dfb8-406d-a165-bf068f19e5e6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:52.689999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:52.761693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ee86c-dfb8-406d-a165-bf068f19e5e6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:52.796434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3806f-df78-4b7f-acef-1ba159d41c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:52.797027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3806f-df78-4b7f-acef-1ba159d41c64 None admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:52.797303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3806f-df78-4b7f-acef-1ba159d41c64 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:52.797594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3806f-df78-4b7f-acef-1ba159d41c64 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:52.798249 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3806f-df78-4b7f-acef-1ba159d41c64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:52.799640 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3806f-df78-4b7f-acef-1ba159d41c64 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:52.886497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 659/1295] 10.222.0.74 () {60 vars in 1141 bytes} [Wed Aug 31 00:19:52 2022] POST /identity/v3/services => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:19:55.036688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8670ab0-2da2-4d72-8488-21252c94a192 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.037238 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8670ab0-2da2-4d72-8488-21252c94a192 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.037427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8670ab0-2da2-4d72-8488-21252c94a192 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.039651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 637/1296] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:19:55.044884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c4179-7cfd-4261-9836-3739df757665 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.045313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c4179-7cfd-4261-9836-3739df757665 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.045711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c4179-7cfd-4261-9836-3739df757665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.071154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-177c4179-7cfd-4261-9836-3739df757665 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:55.072661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-177c4179-7cfd-4261-9836-3739df757665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:55.150351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 660/1297] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:19:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:19:55.423164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8670ab0-2da2-4d72-8488-21252c94a192 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:55.540549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8670ab0-2da2-4d72-8488-21252c94a192 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:55.597401 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084f9cd-36cb-4b20-af46-841f9ca15c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:55.598498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084f9cd-36cb-4b20-af46-841f9ca15c97 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.598992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084f9cd-36cb-4b20-af46-841f9ca15c97 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.599471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084f9cd-36cb-4b20-af46-841f9ca15c97 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.600518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084f9cd-36cb-4b20-af46-841f9ca15c97 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:55.603081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084f9cd-36cb-4b20-af46-841f9ca15c97 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-5084f9cd-36cb-4b20-af46-841f9ca15c97 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:55.619927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:55.621217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:55.626358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 638/1298] 10.222.0.74 () {56 vars in 1117 bytes} [Wed Aug 31 00:19:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:19:55.628017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c4179-7cfd-4261-9836-3739df757665 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:55.647045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:55.730790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c4179-7cfd-4261-9836-3739df757665 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:55.767546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d425e9-0760-4719-be44-29a633577e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:55.767546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d425e9-0760-4719-be44-29a633577e8c None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.767881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d425e9-0760-4719-be44-29a633577e8c None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.767970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d425e9-0760-4719-be44-29a633577e8c None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.768557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d425e9-0760-4719-be44-29a633577e8c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:55.768858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d425e9-0760-4719-be44-29a633577e8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:55.770271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d425e9-0760-4719-be44-29a633577e8c None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:55.776589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 661/1299] 10.222.0.74 () {56 vars in 1116 bytes} [Wed Aug 31 00:19:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:19:55.782716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084f9cd-36cb-4b20-af46-841f9ca15c97 None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:55.827396 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:55.899709 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084f9cd-36cb-4b20-af46-841f9ca15c97 None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:55.933718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c4272-60d2-40ac-a61e-2c14bc733461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:55.934325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4272-60d2-40ac-a61e-2c14bc733461 None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:55.934603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4272-60d2-40ac-a61e-2c14bc733461 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:55.934871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4272-60d2-40ac-a61e-2c14bc733461 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:55.935565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c4272-60d2-40ac-a61e-2c14bc733461 None admin] RBAC: Adding query filter params (interface=public, service_id=128fe68f0304463b90f3a5ac394d2f6d, region_id=RegionOne) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:55.935869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c4272-60d2-40ac-a61e-2c14bc733461 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:55.937218 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c4272-60d2-40ac-a61e-2c14bc733461 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:55.942074 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 639/1300] 10.222.0.74 () {56 vars in 1251 bytes} [Wed Aug 31 00:19:55 2022] GET /identity/v3/endpoints?service_id=128fe68f0304463b90f3a5ac394d2f6d&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:19:55.948472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d425e9-0760-4719-be44-29a633577e8c None admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:56.032507 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:56.050426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d425e9-0760-4719-be44-29a633577e8c None admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:56.083370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53781c-c0b7-4a33-b29a-2dc6a9f2d8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:56.083965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53781c-c0b7-4a33-b29a-2dc6a9f2d8fb None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:56.084241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53781c-c0b7-4a33-b29a-2dc6a9f2d8fb None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:56.084553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53781c-c0b7-4a33-b29a-2dc6a9f2d8fb None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:56.085244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53781c-c0b7-4a33-b29a-2dc6a9f2d8fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:56.086637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53781c-c0b7-4a33-b29a-2dc6a9f2d8fb None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:56.093193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 662/1301] 10.222.0.74 () {56 vars in 1087 bytes} [Wed Aug 31 00:19:55 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:19:58.154636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4d87-d085-43a0-9ef3-b343e942b886 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:58.155146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4d87-d085-43a0-9ef3-b343e942b886 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:58.155146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4d87-d085-43a0-9ef3-b343e942b886 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:58.157364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 640/1302] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:19:58.163600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee355ea-b12d-48ca-8f46-be6fa1838bda None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:58.164149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee355ea-b12d-48ca-8f46-be6fa1838bda None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:58.164793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee355ea-b12d-48ca-8f46-be6fa1838bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:58.188209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-7ee355ea-b12d-48ca-8f46-be6fa1838bda None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:19:58.189442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7ee355ea-b12d-48ca-8f46-be6fa1838bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:19:58.287218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 663/1303] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:19:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 00:19:58.568381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4d87-d085-43a0-9ef3-b343e942b886 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:58.679019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:58.686254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4d87-d085-43a0-9ef3-b343e942b886 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:58.722201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6608f-e3ef-4908-8e2a-817d074ead5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:58.722830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6608f-e3ef-4908-8e2a-817d074ead5e None admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:58.723107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6608f-e3ef-4908-8e2a-817d074ead5e None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:58.723378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6608f-e3ef-4908-8e2a-817d074ead5e None admin] PATH_INFO: `/v3/services/placement` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:58.723957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6608f-e3ef-4908-8e2a-817d074ead5e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:58.726054 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6608f-e3ef-4908-8e2a-817d074ead5e None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application [None req-7ce6608f-e3ef-4908-8e2a-817d074ead5e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 00:19:58.734841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 00:19:58.737744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application with Lock( Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self._enter() Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application return self.creator() Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application created_value = creator( Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: ERROR keystone.server.flask.application Aug 31 00:19:58.738823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 641/1304] 10.222.0.74 () {56 vars in 1117 bytes} [Wed Aug 31 00:19:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 00:19:58.742535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee355ea-b12d-48ca-8f46-be6fa1838bda None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:58.825460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:19:58.849368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee355ea-b12d-48ca-8f46-be6fa1838bda None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:58.885268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae444-1aea-476b-9208-2d024ca60d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:58.885931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae444-1aea-476b-9208-2d024ca60d54 None admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:58.886246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae444-1aea-476b-9208-2d024ca60d54 None admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:58.886530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae444-1aea-476b-9208-2d024ca60d54 None admin] PATH_INFO: `/v3/services` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:58.887192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae444-1aea-476b-9208-2d024ca60d54 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:19:58.887499 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae444-1aea-476b-9208-2d024ca60d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:58.888874 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae444-1aea-476b-9208-2d024ca60d54 None admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:58.894888 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 664/1305] 10.222.0.74 () {56 vars in 1116 bytes} [Wed Aug 31 00:19:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:19:58.901847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6608f-e3ef-4908-8e2a-817d074ead5e None admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:19:59.002579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6608f-e3ef-4908-8e2a-817d074ead5e None admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:19:59.037464 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34984e9-f389-4bde-8744-93b53192d8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:19:59.038423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34984e9-f389-4bde-8744-93b53192d8c4 None admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:19:59.038720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34984e9-f389-4bde-8744-93b53192d8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:19:59.039001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34984e9-f389-4bde-8744-93b53192d8c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:19:59.039687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34984e9-f389-4bde-8744-93b53192d8c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:19:59.041072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34984e9-f389-4bde-8744-93b53192d8c4 None admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:19:59.168523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 642/1306] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:19:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:20:08.891934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=30 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:20:09.163222 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:38.506932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2337f0-1b0a-418e-8d08-ae38b3c49d18 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.508301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2337f0-1b0a-418e-8d08-ae38b3c49d18 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.508835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2337f0-1b0a-418e-8d08-ae38b3c49d18 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.517019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4026d-d556-4994-aadf-7b6c7f7f53ca None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:38.517981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4026d-d556-4994-aadf-7b6c7f7f53ca None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:38.519036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4026d-d556-4994-aadf-7b6c7f7f53ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:38.524593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 665/1307] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:27:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:27:38.604066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-6ac4026d-d556-4994-aadf-7b6c7f7f53ca None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:38.605651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6ac4026d-d556-4994-aadf-7b6c7f7f53ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:38.746035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 643/1308] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:39.097960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440400-c4c8-4a96-b167-da91671490b9 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.098653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440400-c4c8-4a96-b167-da91671490b9 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.099108 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec440400-c4c8-4a96-b167-da91671490b9 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.100864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 666/1309] 10.222.0.74 () {54 vars in 965 bytes} [Wed Aug 31 00:27:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:27:39.107871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f406bb-e20e-4eb5-bdee-7529eea2a7cf None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.108267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f406bb-e20e-4eb5-bdee-7529eea2a7cf None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.108732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f406bb-e20e-4eb5-bdee-7529eea2a7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.329253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-22f406bb-e20e-4eb5-bdee-7529eea2a7cf None None] MFA Rules not processed for user `6f5149b369e34afca6dd41a0082701e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:39.332446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-22f406bb-e20e-4eb5-bdee-7529eea2a7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:39.361960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:39.436743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 644/1310] 10.222.0.74 () {58 vars in 1062 bytes} [Wed Aug 31 00:27:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:39.449475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440400-c4c8-4a96-b167-da91671490b9 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:39.451337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ec440400-c4c8-4a96-b167-da91671490b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:39.595906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec440400-c4c8-4a96-b167-da91671490b9 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:39.691093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57f3f1-1168-4238-82a0-296f1e1d599c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:39.691982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57f3f1-1168-4238-82a0-296f1e1d599c service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:39.692412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57f3f1-1168-4238-82a0-296f1e1d599c service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:39.692832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57f3f1-1168-4238-82a0-296f1e1d599c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:39.694788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-fb57f3f1-1168-4238-82a0-296f1e1d599c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:39.769507 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:39.843853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57f3f1-1168-4238-82a0-296f1e1d599c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:39.847447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57f3f1-1168-4238-82a0-296f1e1d599c service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:39.872184 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 667/1311] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:42.462700 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93bc9-0f7b-4745-99a7-873556a68a31 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:42.464639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93bc9-0f7b-4745-99a7-873556a68a31 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:42.464639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93bc9-0f7b-4745-99a7-873556a68a31 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:42.466510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 645/1312] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:27:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:27:42.474007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bccd8-990f-4897-8d6f-d7177eed1b11 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:42.474590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bccd8-990f-4897-8d6f-d7177eed1b11 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:42.474590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bccd8-990f-4897-8d6f-d7177eed1b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:42.564434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-550bccd8-990f-4897-8d6f-d7177eed1b11 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:42.566286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-550bccd8-990f-4897-8d6f-d7177eed1b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:42.670405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 668/1313] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:42.966015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b93bc9-0f7b-4745-99a7-873556a68a31 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:42.967623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d1b93bc9-0f7b-4745-99a7-873556a68a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:43.075464 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b93bc9-0f7b-4745-99a7-873556a68a31 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:43.148087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:43.150662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d24ca-9e15-487c-8c58-2d03f1022e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:43.151268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d24ca-9e15-487c-8c58-2d03f1022e4c service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:43.151549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d24ca-9e15-487c-8c58-2d03f1022e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:43.151823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d24ca-9e15-487c-8c58-2d03f1022e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:43.153438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-de1d24ca-9e15-487c-8c58-2d03f1022e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:43.263925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d24ca-9e15-487c-8c58-2d03f1022e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:43.265372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d24ca-9e15-487c-8c58-2d03f1022e4c service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:43.285046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 646/1314] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:45.886816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459166-5319-400f-9640-a42e16a48213 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:45.887532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459166-5319-400f-9640-a42e16a48213 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:45.887733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61459166-5319-400f-9640-a42e16a48213 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:45.889236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 669/1315] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:27:45.896535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fa253-abb8-4be5-8f1a-3f52bf686559 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:45.897016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fa253-abb8-4be5-8f1a-3f52bf686559 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:45.897219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fa253-abb8-4be5-8f1a-3f52bf686559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:45.968651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0a1fa253-abb8-4be5-8f1a-3f52bf686559 None None] MFA Rules not processed for user `179076a3421248bdafab3719775f8040`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:45.969941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0a1fa253-abb8-4be5-8f1a-3f52bf686559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.032278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:46.086624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 647/1316] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:27:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:46.381644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61459166-5319-400f-9640-a42e16a48213 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:46.383465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-61459166-5319-400f-9640-a42e16a48213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.400183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:46.508768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61459166-5319-400f-9640-a42e16a48213 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:46.590142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf2c9a-ddcd-49cd-bd3e-60b22f475441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:46.591099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf2c9a-ddcd-49cd-bd3e-60b22f475441 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:46.591541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf2c9a-ddcd-49cd-bd3e-60b22f475441 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:46.592000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf2c9a-ddcd-49cd-bd3e-60b22f475441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:46.594879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8bdf2c9a-ddcd-49cd-bd3e-60b22f475441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:46.660890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:46.710276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf2c9a-ddcd-49cd-bd3e-60b22f475441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:46.711709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf2c9a-ddcd-49cd-bd3e-60b22f475441 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:46.731249 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 670/1317] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:49.676892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca55c-246d-4357-885a-6ecded856687 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.677463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca55c-246d-4357-885a-6ecded856687 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.677463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca55c-246d-4357-885a-6ecded856687 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.678829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 648/1318] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:27:49.684664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7c95a-007a-4df8-9a31-3d8d95cfdbb4 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:49.685347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7c95a-007a-4df8-9a31-3d8d95cfdbb4 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:49.685347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7c95a-007a-4df8-9a31-3d8d95cfdbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:49.779709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-87e7c95a-007a-4df8-9a31-3d8d95cfdbb4 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:49.780955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-87e7c95a-007a-4df8-9a31-3d8d95cfdbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:49.885239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 671/1319] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:27:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:50.181565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ca55c-246d-4357-885a-6ecded856687 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:50.183134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bf1ca55c-246d-4357-885a-6ecded856687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:50.297442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ca55c-246d-4357-885a-6ecded856687 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:50.375558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1538c-09a5-4493-9663-1b42bce11d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:50.376247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1538c-09a5-4493-9663-1b42bce11d4c service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:50.376531 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1538c-09a5-4493-9663-1b42bce11d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:50.376805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1538c-09a5-4493-9663-1b42bce11d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:50.379138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-00a1538c-09a5-4493-9663-1b42bce11d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:50.386904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:50.517471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1538c-09a5-4493-9663-1b42bce11d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:50.519495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1538c-09a5-4493-9663-1b42bce11d4c service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:50.539066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 649/1320] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:27:53.666934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037b970-cd7b-466d-a433-3a17fcaeb5d9 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:53.667849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037b970-cd7b-466d-a433-3a17fcaeb5d9 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:53.667849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037b970-cd7b-466d-a433-3a17fcaeb5d9 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:53.669960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 672/1321] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:27:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:27:53.679258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f622b9e-d5d1-4784-8701-a13c7aee6f0c None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:53.680000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f622b9e-d5d1-4784-8701-a13c7aee6f0c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:53.680000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f622b9e-d5d1-4784-8701-a13c7aee6f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:53.782708 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0f622b9e-d5d1-4784-8701-a13c7aee6f0c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:53.783927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0f622b9e-d5d1-4784-8701-a13c7aee6f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:53.847054 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:53.890510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 650/1322] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:54.182739 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037b970-cd7b-466d-a433-3a17fcaeb5d9 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:54.186104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f037b970-cd7b-466d-a433-3a17fcaeb5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:54.213447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:54.333813 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037b970-cd7b-466d-a433-3a17fcaeb5d9 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:54.417760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94827034-7f37-4786-a2c7-b64697f1622b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:54.418373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94827034-7f37-4786-a2c7-b64697f1622b service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:54.418654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94827034-7f37-4786-a2c7-b64697f1622b service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:54.418929 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94827034-7f37-4786-a2c7-b64697f1622b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:54.420549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-94827034-7f37-4786-a2c7-b64697f1622b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:54.507270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:54.547519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94827034-7f37-4786-a2c7-b64697f1622b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:54.549177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94827034-7f37-4786-a2c7-b64697f1622b service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:54.569322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 673/1323] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:27:56.673434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b977381-40d9-41b4-b81e-21bfb7317cd0 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:56.674060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b977381-40d9-41b4-b81e-21bfb7317cd0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:56.674060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b977381-40d9-41b4-b81e-21bfb7317cd0 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:56.675480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 651/1324] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:27:56.682679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df4c9e-f333-4c77-a323-cd58d1f10695 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:56.683281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df4c9e-f333-4c77-a323-cd58d1f10695 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:56.683753 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df4c9e-f333-4c77-a323-cd58d1f10695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:56.765932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-c7df4c9e-f333-4c77-a323-cd58d1f10695 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:56.767178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c7df4c9e-f333-4c77-a323-cd58d1f10695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:56.896731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 674/1325] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:27:57.200640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303f9a3-ad80-468f-beab-9da1b998274f None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:57.201290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303f9a3-ad80-468f-beab-9da1b998274f None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:57.201290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303f9a3-ad80-468f-beab-9da1b998274f None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:57.202698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 652/1326] 10.222.0.74 () {54 vars in 965 bytes} [Wed Aug 31 00:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:27:57.209104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478a2d-0358-4622-945e-e649101755f7 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:57.209392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478a2d-0358-4622-945e-e649101755f7 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:57.209706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478a2d-0358-4622-945e-e649101755f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:57.249888 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:57.305430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-da478a2d-0358-4622-945e-e649101755f7 None None] MFA Rules not processed for user `6f5149b369e34afca6dd41a0082701e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:27:57.306786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-da478a2d-0358-4622-945e-e649101755f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:57.387105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 675/1327] 10.222.0.74 () {58 vars in 1062 bytes} [Wed Aug 31 00:27:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:27:57.397509 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303f9a3-ad80-468f-beab-9da1b998274f None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:27:57.400080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3303f9a3-ad80-468f-beab-9da1b998274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:57.521998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303f9a3-ad80-468f-beab-9da1b998274f None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:27:57.601928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41d9af-aa6b-4444-ae7d-36dbf22777be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:27:57.602562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41d9af-aa6b-4444-ae7d-36dbf22777be service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:27:57.602844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41d9af-aa6b-4444-ae7d-36dbf22777be service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:27:57.603114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41d9af-aa6b-4444-ae7d-36dbf22777be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:27:57.604727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4f41d9af-aa6b-4444-ae7d-36dbf22777be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:27:57.622537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:27:57.730704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41d9af-aa6b-4444-ae7d-36dbf22777be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:27:57.733217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41d9af-aa6b-4444-ae7d-36dbf22777be service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:27:57.760297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 653/1328] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:00.161767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c7ed1-5cf8-41b3-a2fe-e5cd2dfa8702 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.162361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c7ed1-5cf8-41b3-a2fe-e5cd2dfa8702 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.162361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c7ed1-5cf8-41b3-a2fe-e5cd2dfa8702 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.163694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 676/1329] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:00.169745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39c8b5-a74f-4ebd-9925-5e07a7d8f488 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:00.170357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39c8b5-a74f-4ebd-9925-5e07a7d8f488 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:00.170357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39c8b5-a74f-4ebd-9925-5e07a7d8f488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:00.266613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-da39c8b5-a74f-4ebd-9925-5e07a7d8f488 None None] MFA Rules not processed for user `179076a3421248bdafab3719775f8040`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:00.268745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-da39c8b5-a74f-4ebd-9925-5e07a7d8f488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:00.379739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:00.426668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 654/1330] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:00.795906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c7ed1-5cf8-41b3-a2fe-e5cd2dfa8702 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:00.797672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8b5c7ed1-5cf8-41b3-a2fe-e5cd2dfa8702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:00.992425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c7ed1-5cf8-41b3-a2fe-e5cd2dfa8702 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:01.028539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:01.116489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50c42e-2db7-49a8-b556-d440823ec825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:01.117246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c42e-2db7-49a8-b556-d440823ec825 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:01.117662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c42e-2db7-49a8-b556-d440823ec825 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:01.117939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50c42e-2db7-49a8-b556-d440823ec825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:01.120584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1d50c42e-2db7-49a8-b556-d440823ec825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:01.296099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50c42e-2db7-49a8-b556-d440823ec825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:01.297968 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50c42e-2db7-49a8-b556-d440823ec825 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:01.331653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 677/1331] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:00 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:04.121673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd196ea-73b8-4bb8-9a8a-967dbbe2d2a8 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:04.122236 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd196ea-73b8-4bb8-9a8a-967dbbe2d2a8 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:04.122236 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd196ea-73b8-4bb8-9a8a-967dbbe2d2a8 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:04.123618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 655/1332] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:04.129238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e40fd6-838a-4053-a3d9-bf45f770b3d7 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:04.130090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e40fd6-838a-4053-a3d9-bf45f770b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:04.130090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e40fd6-838a-4053-a3d9-bf45f770b3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:04.207003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:04.209900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-90e40fd6-838a-4053-a3d9-bf45f770b3d7 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:04.211188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-90e40fd6-838a-4053-a3d9-bf45f770b3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:04.325742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 678/1333] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:04.616017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd196ea-73b8-4bb8-9a8a-967dbbe2d2a8 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:04.618692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5bd196ea-73b8-4bb8-9a8a-967dbbe2d2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:04.768203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd196ea-73b8-4bb8-9a8a-967dbbe2d2a8 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:04.845563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73221b-8c3d-40e4-b907-c7d7be0e1364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:04.846203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73221b-8c3d-40e4-b907-c7d7be0e1364 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:04.846480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73221b-8c3d-40e4-b907-c7d7be0e1364 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:04.846751 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73221b-8c3d-40e4-b907-c7d7be0e1364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:04.848995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8f73221b-8c3d-40e4-b907-c7d7be0e1364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:04.876335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:04.963484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73221b-8c3d-40e4-b907-c7d7be0e1364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:04.964974 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73221b-8c3d-40e4-b907-c7d7be0e1364 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:04.985585 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 656/1334] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:07.043306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d677-ba03-4cac-8e77-c653c3d2ae91 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:07.043878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d677-ba03-4cac-8e77-c653c3d2ae91 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:07.043878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936d677-ba03-4cac-8e77-c653c3d2ae91 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:07.045125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 679/1335] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:28:07.050602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75215c-3409-407e-91d5-302f7d5a3518 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:07.051971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75215c-3409-407e-91d5-302f7d5a3518 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:07.051971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75215c-3409-407e-91d5-302f7d5a3518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:07.240516 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8d75215c-3409-407e-91d5-302f7d5a3518 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:07.241807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8d75215c-3409-407e-91d5-302f7d5a3518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:07.323850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:07.346007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 657/1336] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:07.633666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936d677-ba03-4cac-8e77-c653c3d2ae91 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:07.635689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6936d677-ba03-4cac-8e77-c653c3d2ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:07.749249 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936d677-ba03-4cac-8e77-c653c3d2ae91 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:07.780282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:07.829096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de14df-eb66-4181-b589-61d49d8abfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:07.829764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de14df-eb66-4181-b589-61d49d8abfcb service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:07.830245 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de14df-eb66-4181-b589-61d49d8abfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:07.830674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de14df-eb66-4181-b589-61d49d8abfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:07.832685 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b7de14df-eb66-4181-b589-61d49d8abfcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:07.950203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de14df-eb66-4181-b589-61d49d8abfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:07.951659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de14df-eb66-4181-b589-61d49d8abfcb service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:07.970336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 680/1337] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:10.579108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d48734-7432-44ef-b6a3-55fe66a45e4a None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.579682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d48734-7432-44ef-b6a3-55fe66a45e4a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.579682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d48734-7432-44ef-b6a3-55fe66a45e4a None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.580993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 658/1338] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:10.586412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98196e09-6b6d-4ba9-8bdc-4b9fec6fc93c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:10.586857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98196e09-6b6d-4ba9-8bdc-4b9fec6fc93c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:10.586969 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98196e09-6b6d-4ba9-8bdc-4b9fec6fc93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:10.661150 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-98196e09-6b6d-4ba9-8bdc-4b9fec6fc93c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:10.662405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-98196e09-6b6d-4ba9-8bdc-4b9fec6fc93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:10.670946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:10.771901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 681/1339] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:11.064138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d48734-7432-44ef-b6a3-55fe66a45e4a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:11.065742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c3d48734-7432-44ef-b6a3-55fe66a45e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:11.178583 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d48734-7432-44ef-b6a3-55fe66a45e4a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:11.258378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3d0d3-8936-4c9b-9ea8-9e32a2bfa779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:11.258998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d0d3-8936-4c9b-9ea8-9e32a2bfa779 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:11.259278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d0d3-8936-4c9b-9ea8-9e32a2bfa779 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:11.259552 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d0d3-8936-4c9b-9ea8-9e32a2bfa779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:11.261228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-06f3d0d3-8936-4c9b-9ea8-9e32a2bfa779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:11.307121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:11.387646 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3d0d3-8936-4c9b-9ea8-9e32a2bfa779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:11.389119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3d0d3-8936-4c9b-9ea8-9e32a2bfa779 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:11.413089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 659/1340] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:15.864724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a6043-e18f-4316-9a95-6659e1e0f391 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.865292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a6043-e18f-4316-9a95-6659e1e0f391 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.865292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a6043-e18f-4316-9a95-6659e1e0f391 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.866776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 682/1341] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:15.872611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15672fc8-cbb5-454f-9ee5-dfe12431cb13 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:15.873240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15672fc8-cbb5-454f-9ee5-dfe12431cb13 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:15.873240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15672fc8-cbb5-454f-9ee5-dfe12431cb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:15.952451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-15672fc8-cbb5-454f-9ee5-dfe12431cb13 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:15.953731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-15672fc8-cbb5-454f-9ee5-dfe12431cb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:16.046788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:16.064115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 660/1342] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:16.351432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a6043-e18f-4316-9a95-6659e1e0f391 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:16.353059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-887a6043-e18f-4316-9a95-6659e1e0f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:16.462074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a6043-e18f-4316-9a95-6659e1e0f391 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:16.500217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:16.543605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c6033-3b05-490e-823d-f191ebb6a380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:16.544218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6033-3b05-490e-823d-f191ebb6a380 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:16.544498 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6033-3b05-490e-823d-f191ebb6a380 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:16.544772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6033-3b05-490e-823d-f191ebb6a380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:16.546472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-335c6033-3b05-490e-823d-f191ebb6a380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:16.670169 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c6033-3b05-490e-823d-f191ebb6a380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:16.671543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c6033-3b05-490e-823d-f191ebb6a380 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:16.692978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 683/1343] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:20.026950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe9a24-dba0-4ea0-879f-2de5e58b5af0 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:20.027494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe9a24-dba0-4ea0-879f-2de5e58b5af0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:20.027604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe9a24-dba0-4ea0-879f-2de5e58b5af0 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:20.029013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 661/1344] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:20.035070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c7a4-319a-4555-bb04-72bf05680e5e None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:20.035617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c7a4-319a-4555-bb04-72bf05680e5e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:20.036079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c7a4-319a-4555-bb04-72bf05680e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:20.123675 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-f058c7a4-319a-4555-bb04-72bf05680e5e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:20.124931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f058c7a4-319a-4555-bb04-72bf05680e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:20.145988 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:20.243755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 684/1345] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:20.555215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe9a24-dba0-4ea0-879f-2de5e58b5af0 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:20.564275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-fafe9a24-dba0-4ea0-879f-2de5e58b5af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:20.695197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe9a24-dba0-4ea0-879f-2de5e58b5af0 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:20.774826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36a7a-aaf7-4719-b8bf-18941c622e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:20.775365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36a7a-aaf7-4719-b8bf-18941c622e48 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:20.775649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36a7a-aaf7-4719-b8bf-18941c622e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:20.775921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36a7a-aaf7-4719-b8bf-18941c622e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:20.777637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1af36a7a-aaf7-4719-b8bf-18941c622e48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:20.831526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:20.908590 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af36a7a-aaf7-4719-b8bf-18941c622e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:20.910888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af36a7a-aaf7-4719-b8bf-18941c622e48 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:20.934878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 662/1346] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:25.397323 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202be35-376f-4595-8154-80d2ec64ef4e None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.397323 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202be35-376f-4595-8154-80d2ec64ef4e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.398189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202be35-376f-4595-8154-80d2ec64ef4e None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.403068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 685/1347] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:25.404682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e19009-eb0a-45f7-a629-56a01cd89858 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:25.405361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e19009-eb0a-45f7-a629-56a01cd89858 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:25.405361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e19009-eb0a-45f7-a629-56a01cd89858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:25.495485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-21e19009-eb0a-45f7-a629-56a01cd89858 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:25.500910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-21e19009-eb0a-45f7-a629-56a01cd89858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:25.614555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:25.619983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 663/1348] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:25.912721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202be35-376f-4595-8154-80d2ec64ef4e None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:25.914366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0202be35-376f-4595-8154-80d2ec64ef4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:26.033077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202be35-376f-4595-8154-80d2ec64ef4e None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:26.090862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:26.121896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee00912-8bc5-4b9a-b2cd-18dc872f82ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:26.122620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00912-8bc5-4b9a-b2cd-18dc872f82ad service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:26.122886 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00912-8bc5-4b9a-b2cd-18dc872f82ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:26.123537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00912-8bc5-4b9a-b2cd-18dc872f82ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:26.125665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1ee00912-8bc5-4b9a-b2cd-18dc872f82ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:26.245814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee00912-8bc5-4b9a-b2cd-18dc872f82ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:26.247261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee00912-8bc5-4b9a-b2cd-18dc872f82ad service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:26.266406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 686/1349] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:31.544673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf673c54-0933-479e-9f09-2c87c48d305a None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:31.545202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf673c54-0933-479e-9f09-2c87c48d305a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:31.545202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf673c54-0933-479e-9f09-2c87c48d305a None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:31.546897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 664/1350] 10.222.0.74 () {54 vars in 921 bytes} [Wed Aug 31 00:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:31.552154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300024-50c8-4b4c-ba98-f4177b94672a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:31.552625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300024-50c8-4b4c-ba98-f4177b94672a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:31.552738 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32300024-50c8-4b4c-ba98-f4177b94672a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:31.666601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-32300024-50c8-4b4c-ba98-f4177b94672a None None] MFA Rules not processed for user `5f8c004b9fe2402fbe94cfd7c2bf949e`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:31.668134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-32300024-50c8-4b4c-ba98-f4177b94672a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:31.702663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:31.813528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 687/1351] 10.222.0.74 () {58 vars in 1018 bytes} [Wed Aug 31 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:36.404005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730015f-8086-4cdb-bf02-680962df5e20 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:36.404577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730015f-8086-4cdb-bf02-680962df5e20 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:36.404577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730015f-8086-4cdb-bf02-680962df5e20 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:36.406152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 665/1352] 10.222.0.74 () {54 vars in 921 bytes} [Wed Aug 31 00:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:36.412064 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1acea-41ca-476c-8ccc-32d9c7ac6dea None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:36.412541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1acea-41ca-476c-8ccc-32d9c7ac6dea None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:36.412831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1acea-41ca-476c-8ccc-32d9c7ac6dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:36.508433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-e8d1acea-41ca-476c-8ccc-32d9c7ac6dea None None] MFA Rules not processed for user `5f8c004b9fe2402fbe94cfd7c2bf949e`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:36.509803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e8d1acea-41ca-476c-8ccc-32d9c7ac6dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:36.591408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:36.635588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 688/1353] 10.222.0.74 () {58 vars in 1018 bytes} [Wed Aug 31 00:28:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:38.068126 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c859-4e1d-40ca-9ca4-9f976abfff27 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:38.068680 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c859-4e1d-40ca-9ca4-9f976abfff27 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:38.068680 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00c859-4e1d-40ca-9ca4-9f976abfff27 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:38.070190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 666/1354] 10.222.0.74 () {54 vars in 921 bytes} [Wed Aug 31 00:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:38.075035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c044ca-78ad-4470-88ea-e56ec1811fbe None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:38.075429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c044ca-78ad-4470-88ea-e56ec1811fbe None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:38.075718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c044ca-78ad-4470-88ea-e56ec1811fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:38.157337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-c6c044ca-78ad-4470-88ea-e56ec1811fbe None None] MFA Rules not processed for user `5f8c004b9fe2402fbe94cfd7c2bf949e`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:38.158639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c6c044ca-78ad-4470-88ea-e56ec1811fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:38.274465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 689/1355] 10.222.0.74 () {58 vars in 1018 bytes} [Wed Aug 31 00:28:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:41.740751 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef30bec-d5e8-4735-aacd-b3469a361d16 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.741318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef30bec-d5e8-4735-aacd-b3469a361d16 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.741318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef30bec-d5e8-4735-aacd-b3469a361d16 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.742684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 667/1356] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:41.748478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750a0a-ed4c-429c-a4ad-9894a111b1a5 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:41.748991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750a0a-ed4c-429c-a4ad-9894a111b1a5 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:41.749105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb750a0a-ed4c-429c-a4ad-9894a111b1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:41.789462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:41.845609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-cb750a0a-ed4c-429c-a4ad-9894a111b1a5 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:41.847964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cb750a0a-ed4c-429c-a4ad-9894a111b1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:42.021765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 690/1357] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:42.332293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436a6b-13ae-472d-8869-09f295889bd4 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.336961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436a6b-13ae-472d-8869-09f295889bd4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.336961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436a6b-13ae-472d-8869-09f295889bd4 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:42.336961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 668/1358] 10.222.0.74 () {54 vars in 962 bytes} [Wed Aug 31 00:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:42.346353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebea7e-a474-449d-bafc-1ea83c7c6225 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.347165 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebea7e-a474-449d-bafc-1ea83c7c6225 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.347502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebea7e-a474-449d-bafc-1ea83c7c6225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:42.439683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-a1ebea7e-a474-449d-bafc-1ea83c7c6225 None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:42.441774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a1ebea7e-a474-449d-bafc-1ea83c7c6225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:42.498619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:42.587791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 691/1359] 10.222.0.74 () {58 vars in 1059 bytes} [Wed Aug 31 00:28:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:42.595404 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04436a6b-13ae-472d-8869-09f295889bd4 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:42.597195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-04436a6b-13ae-472d-8869-09f295889bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:42.763152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04436a6b-13ae-472d-8869-09f295889bd4 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:42.844886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:42.890944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ed279-9cf6-408d-83da-fd188a8b8393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:42.891588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ed279-9cf6-408d-83da-fd188a8b8393 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:42.894183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ed279-9cf6-408d-83da-fd188a8b8393 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:42.894183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ed279-9cf6-408d-83da-fd188a8b8393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:42.894528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c27ed279-9cf6-408d-83da-fd188a8b8393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:42.991573 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ed279-9cf6-408d-83da-fd188a8b8393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:42.993186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ed279-9cf6-408d-83da-fd188a8b8393 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:43.019801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 669/1360] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:45.230673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a014840-ead7-4b98-9d01-9583a0cc7ef6 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.231200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a014840-ead7-4b98-9d01-9583a0cc7ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.231313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a014840-ead7-4b98-9d01-9583a0cc7ef6 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.232560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 692/1361] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:45.238044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec5bb8-7cbb-4ac3-bd54-b3f24a32d7a9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:45.238563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec5bb8-7cbb-4ac3-bd54-b3f24a32d7a9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:45.238563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec5bb8-7cbb-4ac3-bd54-b3f24a32d7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:45.327538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-d3ec5bb8-7cbb-4ac3-bd54-b3f24a32d7a9 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:45.330547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d3ec5bb8-7cbb-4ac3-bd54-b3f24a32d7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:45.389752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:45.462138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 670/1362] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:45.807633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a014840-ead7-4b98-9d01-9583a0cc7ef6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:45.810334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8a014840-ead7-4b98-9d01-9583a0cc7ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:46.005227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a014840-ead7-4b98-9d01-9583a0cc7ef6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:46.019395 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:46.181849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6417f43-675b-4cbb-a0a6-c17b4ecc50da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:46.182531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6417f43-675b-4cbb-a0a6-c17b4ecc50da service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:46.182872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6417f43-675b-4cbb-a0a6-c17b4ecc50da service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:46.183143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6417f43-675b-4cbb-a0a6-c17b4ecc50da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:46.184915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c6417f43-675b-4cbb-a0a6-c17b4ecc50da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:46.294782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6417f43-675b-4cbb-a0a6-c17b4ecc50da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:46.296474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6417f43-675b-4cbb-a0a6-c17b4ecc50da service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:46.326764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 693/1363] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:48.732619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558661c0-b15b-439b-99b9-78cf9e1f466a None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:48.733150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558661c0-b15b-439b-99b9-78cf9e1f466a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:48.733150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558661c0-b15b-439b-99b9-78cf9e1f466a None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:48.734541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 671/1364] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:48.741854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83824193-66a2-4bec-bbb7-02e17279a1f2 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:48.742349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83824193-66a2-4bec-bbb7-02e17279a1f2 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:48.742657 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83824193-66a2-4bec-bbb7-02e17279a1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:48.762848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:48.829072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-83824193-66a2-4bec-bbb7-02e17279a1f2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:48.830462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-83824193-66a2-4bec-bbb7-02e17279a1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:48.949627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 694/1365] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:49.244956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce19d91-b797-449c-841d-b4df829c64e4 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:49.245252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce19d91-b797-449c-841d-b4df829c64e4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:49.245513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce19d91-b797-449c-841d-b4df829c64e4 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:49.247117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 672/1366] 10.222.0.74 () {54 vars in 962 bytes} [Wed Aug 31 00:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:49.255025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c493c34-9745-4bbd-b847-f524becbb718 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:49.255437 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c493c34-9745-4bbd-b847-f524becbb718 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:49.255813 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c493c34-9745-4bbd-b847-f524becbb718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:49.345839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-6c493c34-9745-4bbd-b847-f524becbb718 None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:49.347889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6c493c34-9745-4bbd-b847-f524becbb718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:49.386280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:49.487691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 695/1367] 10.222.0.74 () {58 vars in 1059 bytes} [Wed Aug 31 00:28:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:49.495796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce19d91-b797-449c-841d-b4df829c64e4 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:49.497375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0ce19d91-b797-449c-841d-b4df829c64e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:49.677278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce19d91-b797-449c-841d-b4df829c64e4 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:49.716643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:49.828871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ca100-a53a-427d-9ec7-50222f5f7e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:49.829564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca100-a53a-427d-9ec7-50222f5f7e80 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:49.829829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca100-a53a-427d-9ec7-50222f5f7e80 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:49.830063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ca100-a53a-427d-9ec7-50222f5f7e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:49.831797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0e9ca100-a53a-427d-9ec7-50222f5f7e80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:49.940404 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ca100-a53a-427d-9ec7-50222f5f7e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:49.942081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ca100-a53a-427d-9ec7-50222f5f7e80 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:49.961138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 673/1368] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:50.291607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e7fee-123f-4ad3-88ef-e610c16554c0 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.292106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e7fee-123f-4ad3-88ef-e610c16554c0 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.292209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e7fee-123f-4ad3-88ef-e610c16554c0 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.293850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 696/1369] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:50.300192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a9240-56d8-432c-bc86-c777c2053c86 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:50.300526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a9240-56d8-432c-bc86-c777c2053c86 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:50.300756 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a9240-56d8-432c-bc86-c777c2053c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:50.340890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:50.390772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-b76a9240-56d8-432c-bc86-c777c2053c86 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:50.392077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b76a9240-56d8-432c-bc86-c777c2053c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:50.504964 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 674/1370] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:51.086760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17191bce-b6f9-4afc-a9c1-54ae1476aca7 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:51.088686 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17191bce-b6f9-4afc-a9c1-54ae1476aca7 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:51.090253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17191bce-b6f9-4afc-a9c1-54ae1476aca7 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:51.091853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 697/1371] 10.222.0.74 () {54 vars in 964 bytes} [Wed Aug 31 00:28:51 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:51.097888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c86f-1d4c-4d6d-826b-0112cca3ac79 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:51.098928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c86f-1d4c-4d6d-826b-0112cca3ac79 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:51.098928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c86f-1d4c-4d6d-826b-0112cca3ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:51.193641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-9fa6c86f-1d4c-4d6d-826b-0112cca3ac79 None None] MFA Rules not processed for user `75f62fa62f2d420a998f236ff7f9b6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:51.194900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9fa6c86f-1d4c-4d6d-826b-0112cca3ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:51.255648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:51.290361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 675/1372] 10.222.0.74 () {58 vars in 1061 bytes} [Wed Aug 31 00:28:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:51.298177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17191bce-b6f9-4afc-a9c1-54ae1476aca7 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:51.300653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-17191bce-b6f9-4afc-a9c1-54ae1476aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:51.483307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17191bce-b6f9-4afc-a9c1-54ae1476aca7 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:51.545926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:51.590071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16573ebc-57bb-4a18-96cc-f5172fae39e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:51.590997 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16573ebc-57bb-4a18-96cc-f5172fae39e1 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:51.591432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16573ebc-57bb-4a18-96cc-f5172fae39e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:51.591856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16573ebc-57bb-4a18-96cc-f5172fae39e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:51.593715 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-16573ebc-57bb-4a18-96cc-f5172fae39e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:51.729031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16573ebc-57bb-4a18-96cc-f5172fae39e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:51.730574 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16573ebc-57bb-4a18-96cc-f5172fae39e1 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:51.753283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 698/1373] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:52.459853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506ab83-994b-4003-b3b6-9b6627da7d59 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:52.460359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506ab83-994b-4003-b3b6-9b6627da7d59 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:52.460473 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506ab83-994b-4003-b3b6-9b6627da7d59 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:52.461792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 676/1374] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:52.467325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7dfc-7c5c-499c-adbb-e3ae88ee38f2 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:52.467773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7dfc-7c5c-499c-adbb-e3ae88ee38f2 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:52.467874 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce7dfc-7c5c-499c-adbb-e3ae88ee38f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:52.537850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-6bce7dfc-7c5c-499c-adbb-e3ae88ee38f2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:52.539079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6bce7dfc-7c5c-499c-adbb-e3ae88ee38f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:52.562642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:52.651693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 699/1375] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:28:52.940082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506ab83-994b-4003-b3b6-9b6627da7d59 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:52.942522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b506ab83-994b-4003-b3b6-9b6627da7d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:53.098984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506ab83-994b-4003-b3b6-9b6627da7d59 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:53.151165 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:53.215888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a93df-1d95-4537-a6e1-9d83961c4672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:53.216500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a93df-1d95-4537-a6e1-9d83961c4672 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:53.216780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a93df-1d95-4537-a6e1-9d83961c4672 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:53.217056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a93df-1d95-4537-a6e1-9d83961c4672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:53.218691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-192a93df-1d95-4537-a6e1-9d83961c4672 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:53.321453 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a93df-1d95-4537-a6e1-9d83961c4672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:53.323282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a93df-1d95-4537-a6e1-9d83961c4672 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:53.344992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 677/1376] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:55.513119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea689854-6ae0-4463-b1f2-4d27faeb6aea None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:55.513798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea689854-6ae0-4463-b1f2-4d27faeb6aea None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:55.514186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea689854-6ae0-4463-b1f2-4d27faeb6aea None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:55.516572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 700/1377] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:28:55.523211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81abcd-f3bc-4211-9aff-54e1092e9871 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:55.523772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81abcd-f3bc-4211-9aff-54e1092e9871 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:55.523772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81abcd-f3bc-4211-9aff-54e1092e9871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:55.619494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0a81abcd-f3bc-4211-9aff-54e1092e9871 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:55.620872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0a81abcd-f3bc-4211-9aff-54e1092e9871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:55.631204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:55.761248 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 678/1378] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:56.086280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea689854-6ae0-4463-b1f2-4d27faeb6aea None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:56.088005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ea689854-6ae0-4463-b1f2-4d27faeb6aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:56.291794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea689854-6ae0-4463-b1f2-4d27faeb6aea None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:28:56.296475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:56.438939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32757686-b584-4165-a632-dee922d13e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:28:56.440420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757686-b584-4165-a632-dee922d13e8e service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:56.440963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757686-b584-4165-a632-dee922d13e8e service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:56.441518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757686-b584-4165-a632-dee922d13e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:56.443722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-32757686-b584-4165-a632-dee922d13e8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:56.582286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32757686-b584-4165-a632-dee922d13e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:28:56.592113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32757686-b584-4165-a632-dee922d13e8e service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:28:56.619775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 701/1379] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:28:59.329800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f196-6b2d-472c-a4c0-28d7688195c7 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.331613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f196-6b2d-472c-a4c0-28d7688195c7 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.331613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129f196-6b2d-472c-a4c0-28d7688195c7 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.332974 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 679/1380] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:28:59.339014 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27428c-4747-4153-8e2e-c69496bed229 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:28:59.340180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27428c-4747-4153-8e2e-c69496bed229 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:28:59.340470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27428c-4747-4153-8e2e-c69496bed229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:28:59.354611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:28:59.429096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-1c27428c-4747-4153-8e2e-c69496bed229 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:28:59.430437 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1c27428c-4747-4153-8e2e-c69496bed229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:28:59.542164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 702/1381] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:28:59.852678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129f196-6b2d-472c-a4c0-28d7688195c7 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:28:59.854221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3129f196-6b2d-472c-a4c0-28d7688195c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:00.076969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:00.093929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129f196-6b2d-472c-a4c0-28d7688195c7 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:00.275820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ccc7f-975b-4161-83ca-9be483018abb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:00.276851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ccc7f-975b-4161-83ca-9be483018abb service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:00.276851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ccc7f-975b-4161-83ca-9be483018abb service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:00.276851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ccc7f-975b-4161-83ca-9be483018abb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:00.279006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3d7ccc7f-975b-4161-83ca-9be483018abb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:00.447959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ccc7f-975b-4161-83ca-9be483018abb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:00.449765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ccc7f-975b-4161-83ca-9be483018abb service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:00.463688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:00.478883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 680/1382] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:03.216850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8e719-ee65-48a7-a3bb-66ff86035b0d None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:03.217765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8e719-ee65-48a7-a3bb-66ff86035b0d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:03.217765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8e719-ee65-48a7-a3bb-66ff86035b0d None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:03.219940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 703/1383] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:29:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:29:03.228331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e319-e8ca-42cd-9e50-052aca0921c1 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:03.229014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e319-e8ca-42cd-9e50-052aca0921c1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:03.229014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e319-e8ca-42cd-9e50-052aca0921c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:03.326690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-05f6e319-e8ca-42cd-9e50-052aca0921c1 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:03.327940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-05f6e319-e8ca-42cd-9e50-052aca0921c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:03.439130 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 681/1384] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:03.750277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8e719-ee65-48a7-a3bb-66ff86035b0d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:03.751845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0ed8e719-ee65-48a7-a3bb-66ff86035b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:03.889909 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:03.977864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8e719-ee65-48a7-a3bb-66ff86035b0d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:04.168815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383645c-5207-4759-b74d-15cc4d445917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:04.170278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383645c-5207-4759-b74d-15cc4d445917 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:04.170846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383645c-5207-4759-b74d-15cc4d445917 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:04.172127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383645c-5207-4759-b74d-15cc4d445917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:04.177418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-9383645c-5207-4759-b74d-15cc4d445917 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:04.239850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:04.309422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383645c-5207-4759-b74d-15cc4d445917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:04.311973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383645c-5207-4759-b74d-15cc4d445917 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:04.339885 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 704/1385] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:06.494838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86267531-551c-4d65-a06f-c68d9e7b4fb0 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.495407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86267531-551c-4d65-a06f-c68d9e7b4fb0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.495407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86267531-551c-4d65-a06f-c68d9e7b4fb0 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.496744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 682/1386] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:06.502243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040253c4-8b92-48db-b8a3-e4e9d96ea33f None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:06.502800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040253c4-8b92-48db-b8a3-e4e9d96ea33f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:06.502800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040253c4-8b92-48db-b8a3-e4e9d96ea33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:06.583529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-040253c4-8b92-48db-b8a3-e4e9d96ea33f None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:06.584822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-040253c4-8b92-48db-b8a3-e4e9d96ea33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:06.687172 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 705/1387] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:06.997992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86267531-551c-4d65-a06f-c68d9e7b4fb0 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:07.000514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-86267531-551c-4d65-a06f-c68d9e7b4fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:07.115659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:07.212628 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86267531-551c-4d65-a06f-c68d9e7b4fb0 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:07.335625 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f856e-e791-497e-b182-85fb0ed9cb22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:07.336241 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f856e-e791-497e-b182-85fb0ed9cb22 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:07.336513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f856e-e791-497e-b182-85fb0ed9cb22 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:07.336783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f856e-e791-497e-b182-85fb0ed9cb22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:07.338417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-fc7f856e-e791-497e-b182-85fb0ed9cb22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:07.396137 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:07.461269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f856e-e791-497e-b182-85fb0ed9cb22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:07.462919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f856e-e791-497e-b182-85fb0ed9cb22 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:07.484110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 683/1388] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:08.256437 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff5e3-5fa0-4f80-9080-0f7d08c71e48 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:08.256994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff5e3-5fa0-4f80-9080-0f7d08c71e48 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:08.256994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff5e3-5fa0-4f80-9080-0f7d08c71e48 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:08.258219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 706/1389] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:08.263921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c84b2-cb4f-4b68-b0ec-4c5cfd5b5c8b None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:08.264382 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c84b2-cb4f-4b68-b0ec-4c5cfd5b5c8b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:08.264532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c84b2-cb4f-4b68-b0ec-4c5cfd5b5c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:08.347592 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-087c84b2-cb4f-4b68-b0ec-4c5cfd5b5c8b None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:08.348807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-087c84b2-cb4f-4b68-b0ec-4c5cfd5b5c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:08.471002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 684/1390] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:08.792883 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48f71-f13a-44c1-99c8-90c880a75417 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:08.793166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48f71-f13a-44c1-99c8-90c880a75417 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:08.793447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48f71-f13a-44c1-99c8-90c880a75417 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:08.794822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 707/1391] 10.222.0.74 () {54 vars in 967 bytes} [Wed Aug 31 00:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:08.800118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab35f-2971-4cb1-b677-fb073359342a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:08.800410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab35f-2971-4cb1-b677-fb073359342a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:08.800686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab35f-2971-4cb1-b677-fb073359342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:08.818142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:08.891749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-73fab35f-2971-4cb1-b677-fb073359342a None None] MFA Rules not processed for user `d8590378b14c49cf9266a0d859db5bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:08.893797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-73fab35f-2971-4cb1-b677-fb073359342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:08.978065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 685/1392] 10.222.0.74 () {58 vars in 1064 bytes} [Wed Aug 31 00:29:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:08.987150 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48f71-f13a-44c1-99c8-90c880a75417 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:08.988664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-59e48f71-f13a-44c1-99c8-90c880a75417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:09.021955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:09.122828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48f71-f13a-44c1-99c8-90c880a75417 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:09.217296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82f682-8aa7-46e6-a65e-e741b9c1fa14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8590378b14c49cf9266a0d859db5bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:09.218047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82f682-8aa7-46e6-a65e-e741b9c1fa14 service glance] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:09.218336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82f682-8aa7-46e6-a65e-e741b9c1fa14 service glance] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:09.218636 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82f682-8aa7-46e6-a65e-e741b9c1fa14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:09.221422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5f82f682-8aa7-46e6-a65e-e741b9c1fa14 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:09.328614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:09.365681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82f682-8aa7-46e6-a65e-e741b9c1fa14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:09.367230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82f682-8aa7-46e6-a65e-e741b9c1fa14 service glance] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:09.389510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 708/1393] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:09.731004 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11762981-75c2-4887-9a31-bcbc26c0e8bf None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:09.731853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11762981-75c2-4887-9a31-bcbc26c0e8bf None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:09.731853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11762981-75c2-4887-9a31-bcbc26c0e8bf None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:09.733347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 686/1394] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:09.740104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78ba1f-7357-4305-9422-42954765e42e None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:09.740528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78ba1f-7357-4305-9422-42954765e42e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:09.740813 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78ba1f-7357-4305-9422-42954765e42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:09.823501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-aa78ba1f-7357-4305-9422-42954765e42e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:09.824745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-aa78ba1f-7357-4305-9422-42954765e42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:09.945784 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 709/1395] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:10.247171 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11762981-75c2-4887-9a31-bcbc26c0e8bf None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:10.248831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-11762981-75c2-4887-9a31-bcbc26c0e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:10.385646 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:10.388890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6568f2-fa85-42cd-81bf-901cc164f101 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.389384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6568f2-fa85-42cd-81bf-901cc164f101 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.389481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6568f2-fa85-42cd-81bf-901cc164f101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.443112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:10.449603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11762981-75c2-4887-9a31-bcbc26c0e8bf None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:10.467082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-8a6568f2-fa85-42cd-81bf-901cc164f101 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:10.468462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8a6568f2-fa85-42cd-81bf-901cc164f101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:10.585994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 710/1396] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:29:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:10.611798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb8108-936e-4532-83c0-d010e781108c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:10.612628 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb8108-936e-4532-83c0-d010e781108c service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.612908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb8108-936e-4532-83c0-d010e781108c service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.613184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb8108-936e-4532-83c0-d010e781108c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.616761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7ceb8108-936e-4532-83c0-d010e781108c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:10.636970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303fae1-d40c-4950-a253-a10737c066f3 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.637359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303fae1-d40c-4950-a253-a10737c066f3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.637914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303fae1-d40c-4950-a253-a10737c066f3 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.639535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 711/1397] 10.222.0.74 () {54 vars in 943 bytes} [Wed Aug 31 00:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:29:10.647945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be014a3-edb4-456f-826d-4ad00cf9bebb None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:10.648393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be014a3-edb4-456f-826d-4ad00cf9bebb None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:10.648906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be014a3-edb4-456f-826d-4ad00cf9bebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:10.726012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:10.757907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb8108-936e-4532-83c0-d010e781108c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:10.759862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb8108-936e-4532-83c0-d010e781108c service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:10.768366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2be014a3-edb4-456f-826d-4ad00cf9bebb None None] MFA Rules not processed for user `045ff88aba374cc889389ba07e884462`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:10.769933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2be014a3-edb4-456f-826d-4ad00cf9bebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:10.793806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 687/1398] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:29:10.852894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:10.910439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 712/1399] 10.222.0.74 () {58 vars in 1040 bytes} [Wed Aug 31 00:29:10 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:29:10.921222 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb8108-936e-4532-83c0-d010e781108c service nova] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:10.922865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7ceb8108-936e-4532-83c0-d010e781108c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:11.057458 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb8108-936e-4532-83c0-d010e781108c service nova] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:11.203144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:11.203144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb31db-1275-4e8a-9ba2-060a2ab9781f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:11.203144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb31db-1275-4e8a-9ba2-060a2ab9781f service swift] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:11.203144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb31db-1275-4e8a-9ba2-060a2ab9781f service swift] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:11.203663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb31db-1275-4e8a-9ba2-060a2ab9781f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:11.203663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-edbb31db-1275-4e8a-9ba2-060a2ab9781f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:11.277986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb31db-1275-4e8a-9ba2-060a2ab9781f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:11.281203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb31db-1275-4e8a-9ba2-060a2ab9781f service swift] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:11.292342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 688/1400] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:29:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:29:13.887808 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed4042-d9e0-4f16-83e2-645d94142c4d None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.888784 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed4042-d9e0-4f16-83e2-645d94142c4d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.888784 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed4042-d9e0-4f16-83e2-645d94142c4d None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:13.895953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 713/1401] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:29:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:13.900132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd87a2e-f413-4696-adfe-655d07068f40 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:13.900132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd87a2e-f413-4696-adfe-655d07068f40 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:13.900132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd87a2e-f413-4696-adfe-655d07068f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:14.044005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-9bd87a2e-f413-4696-adfe-655d07068f40 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:14.045707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9bd87a2e-f413-4696-adfe-655d07068f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:14.204001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:14.217654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 689/1402] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:14.553871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed4042-d9e0-4f16-83e2-645d94142c4d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:14.556743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-31ed4042-d9e0-4f16-83e2-645d94142c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:14.822838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed4042-d9e0-4f16-83e2-645d94142c4d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:14.910628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:15.048335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0eadd-104c-4822-ab31-09c2b8d7abb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:15.050535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0eadd-104c-4822-ab31-09c2b8d7abb5 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:15.050871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0eadd-104c-4822-ab31-09c2b8d7abb5 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:15.051207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0eadd-104c-4822-ab31-09c2b8d7abb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:15.053088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-36b0eadd-104c-4822-ab31-09c2b8d7abb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:15.222116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0eadd-104c-4822-ab31-09c2b8d7abb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:15.225127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0eadd-104c-4822-ab31-09c2b8d7abb5 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:15.262867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 714/1403] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:17.925538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e91d7-c029-4959-a88f-512dfe3c2cf0 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:17.926610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e91d7-c029-4959-a88f-512dfe3c2cf0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:17.926610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e91d7-c029-4959-a88f-512dfe3c2cf0 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:17.927523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 690/1404] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:29:17.933209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005e77b-9da1-40f4-baf7-0c4af8464353 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:17.933744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005e77b-9da1-40f4-baf7-0c4af8464353 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:17.933836 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005e77b-9da1-40f4-baf7-0c4af8464353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:18.000713 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:18.010767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-e005e77b-9da1-40f4-baf7-0c4af8464353 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:18.014390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e005e77b-9da1-40f4-baf7-0c4af8464353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:18.131337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 715/1405] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:18.433350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e91d7-c029-4959-a88f-512dfe3c2cf0 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:18.435383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c29e91d7-c029-4959-a88f-512dfe3c2cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:18.610228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e91d7-c029-4959-a88f-512dfe3c2cf0 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:18.688533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:18.744641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8b132-f841-4d95-89ce-259b22382000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:18.745263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8b132-f841-4d95-89ce-259b22382000 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:18.745541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8b132-f841-4d95-89ce-259b22382000 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:18.745843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8b132-f841-4d95-89ce-259b22382000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:18.747469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-95f8b132-f841-4d95-89ce-259b22382000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:18.862534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8b132-f841-4d95-89ce-259b22382000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:18.864897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8b132-f841-4d95-89ce-259b22382000 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:18.901962 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 691/1406] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:21.106912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d701529-e49e-42bc-b8ef-0a6b93ec09d6 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:21.107440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d701529-e49e-42bc-b8ef-0a6b93ec09d6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:21.107440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d701529-e49e-42bc-b8ef-0a6b93ec09d6 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:21.108729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 716/1407] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:21.121231 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365fc26-05ae-4cb8-8e15-f3e3aae7335a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:21.121821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365fc26-05ae-4cb8-8e15-f3e3aae7335a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:21.121919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365fc26-05ae-4cb8-8e15-f3e3aae7335a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:21.206663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-4365fc26-05ae-4cb8-8e15-f3e3aae7335a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:21.208255 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4365fc26-05ae-4cb8-8e15-f3e3aae7335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:21.242365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:21.329326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 692/1408] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:21.635109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d701529-e49e-42bc-b8ef-0a6b93ec09d6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:21.636811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1d701529-e49e-42bc-b8ef-0a6b93ec09d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:21.787788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:21.817548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d701529-e49e-42bc-b8ef-0a6b93ec09d6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:21.955326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f6b21-d645-4761-b56e-12219ff7f841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:21.956049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f6b21-d645-4761-b56e-12219ff7f841 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:21.956380 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f6b21-d645-4761-b56e-12219ff7f841 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:21.956668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f6b21-d645-4761-b56e-12219ff7f841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:21.958378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-855f6b21-d645-4761-b56e-12219ff7f841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:22.062439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:22.067052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f6b21-d645-4761-b56e-12219ff7f841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:22.068734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f6b21-d645-4761-b56e-12219ff7f841 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:22.088337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 717/1409] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:31.385204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=30 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:32.133313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=7 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:36.231935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803b32-f605-4972-b91f-9a8d3a2a44ab None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.232468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803b32-f605-4972-b91f-9a8d3a2a44ab None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.232695 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92803b32-f605-4972-b91f-9a8d3a2a44ab None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.234569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 693/1410] 10.222.0.74 () {54 vars in 918 bytes} [Wed Aug 31 00:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:36.240192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27727530-704b-4b23-94c8-3c90cdaf4ca5 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.240961 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27727530-704b-4b23-94c8-3c90cdaf4ca5 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.241243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27727530-704b-4b23-94c8-3c90cdaf4ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.322684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-27727530-704b-4b23-94c8-3c90cdaf4ca5 None None] MFA Rules not processed for user `5f8c004b9fe2402fbe94cfd7c2bf949e`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:36.323900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-27727530-704b-4b23-94c8-3c90cdaf4ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:36.436195 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 718/1411] 10.222.0.74 () {58 vars in 1015 bytes} [Wed Aug 31 00:29:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:36.450845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df744797-c672-4495-83c5-e33dadfd1cd9 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.451134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df744797-c672-4495-83c5-e33dadfd1cd9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.451411 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df744797-c672-4495-83c5-e33dadfd1cd9 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.452745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 694/1412] 10.222.0.74 () {54 vars in 918 bytes} [Wed Aug 31 00:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:36.458128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7fb50-1217-43a3-a334-615ee5d91e34 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:36.458417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7fb50-1217-43a3-a334-615ee5d91e34 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:36.458692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7fb50-1217-43a3-a334-615ee5d91e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:36.531119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:36.534781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b1c7fb50-1217-43a3-a334-615ee5d91e34 None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:36.535998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b1c7fb50-1217-43a3-a334-615ee5d91e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:36.648802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 719/1413] 10.222.0.74 () {58 vars in 1015 bytes} [Wed Aug 31 00:29:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:39.090868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6487ad-99f9-45a7-8741-be8a7e23921e None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:39.091480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6487ad-99f9-45a7-8741-be8a7e23921e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:39.091587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6487ad-99f9-45a7-8741-be8a7e23921e None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:39.092886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:39.098405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53f51-9ac3-407d-b3f3-ed2179521848 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:39.098838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53f51-9ac3-407d-b3f3-ed2179521848 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:39.099029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53f51-9ac3-407d-b3f3-ed2179521848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:39.165471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b7f53f51-9ac3-407d-b3f3-ed2179521848 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:39.166645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b7f53f51-9ac3-407d-b3f3-ed2179521848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:39.221995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:39.266468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:39.572989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6487ad-99f9-45a7-8741-be8a7e23921e None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:39.574604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1c6487ad-99f9-45a7-8741-be8a7e23921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:39.728343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6487ad-99f9-45a7-8741-be8a7e23921e None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:39.801626 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:39.842153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f8cd2-234c-499d-afff-1bbb25e69fa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:39.842690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8cd2-234c-499d-afff-1bbb25e69fa1 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:39.842969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8cd2-234c-499d-afff-1bbb25e69fa1 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:39.843238 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8cd2-234c-499d-afff-1bbb25e69fa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:39.844825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bf7f8cd2-234c-499d-afff-1bbb25e69fa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:39.936272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f8cd2-234c-499d-afff-1bbb25e69fa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:39.938219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f8cd2-234c-499d-afff-1bbb25e69fa1 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:39.957775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 696/1416] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:40.863243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffbd29-18e3-4097-8ebb-ac2a29ab4aa1 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:40.863730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffbd29-18e3-4097-8ebb-ac2a29ab4aa1 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:40.863856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffbd29-18e3-4097-8ebb-ac2a29ab4aa1 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:40.865173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:40.870121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc802f64-6380-4f98-b316-65dd1e4dd9b8 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:40.870523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc802f64-6380-4f98-b316-65dd1e4dd9b8 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:40.870680 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc802f64-6380-4f98-b316-65dd1e4dd9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:40.950002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-bc802f64-6380-4f98-b316-65dd1e4dd9b8 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:40.951224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bc802f64-6380-4f98-b316-65dd1e4dd9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:40.978965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:41.052934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:41.202492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffbd29-18e3-4097-8ebb-ac2a29ab4aa1 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:41.204013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bcffbd29-18e3-4097-8ebb-ac2a29ab4aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:41.355452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcffbd29-18e3-4097-8ebb-ac2a29ab4aa1 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:41.396256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:41.472733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf269248-d455-4114-8f98-a8228f405cfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:41.473331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf269248-d455-4114-8f98-a8228f405cfd service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:41.473629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf269248-d455-4114-8f98-a8228f405cfd service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:41.473903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf269248-d455-4114-8f98-a8228f405cfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:41.475488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bf269248-d455-4114-8f98-a8228f405cfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:41.563074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf269248-d455-4114-8f98-a8228f405cfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:41.565310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf269248-d455-4114-8f98-a8228f405cfd service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:41.583301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 722/1419] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:42.471888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228607c8-9e2c-4b90-bb8e-cfe0cbd478d5 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:42.472470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228607c8-9e2c-4b90-bb8e-cfe0cbd478d5 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:42.472470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228607c8-9e2c-4b90-bb8e-cfe0cbd478d5 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:42.473824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:42.478837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accc4d1-93d8-4b28-8655-8cd20f1d7692 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:42.479271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accc4d1-93d8-4b28-8655-8cd20f1d7692 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:42.479394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accc4d1-93d8-4b28-8655-8cd20f1d7692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:42.533952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:42.555311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2accc4d1-93d8-4b28-8655-8cd20f1d7692 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:42.556534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2accc4d1-93d8-4b28-8655-8cd20f1d7692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:42.660358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:42.816591 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228607c8-9e2c-4b90-bb8e-cfe0cbd478d5 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:42.818277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-228607c8-9e2c-4b90-bb8e-cfe0cbd478d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:42.980371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228607c8-9e2c-4b90-bb8e-cfe0cbd478d5 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:42.994400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:43.096409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3358a72-ac48-4076-9954-cb88fa35978a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:43.096927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358a72-ac48-4076-9954-cb88fa35978a service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:43.097237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358a72-ac48-4076-9954-cb88fa35978a service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:43.097510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358a72-ac48-4076-9954-cb88fa35978a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:43.099142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d3358a72-ac48-4076-9954-cb88fa35978a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:43.187114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3358a72-ac48-4076-9954-cb88fa35978a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:43.189556 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3358a72-ac48-4076-9954-cb88fa35978a service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:43.207325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 699/1422] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:29:44.078537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b367a6-a57a-4e41-ad6f-aa7e74e2a703 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:44.079661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b367a6-a57a-4e41-ad6f-aa7e74e2a703 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:44.079856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b367a6-a57a-4e41-ad6f-aa7e74e2a703 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:44.081094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:44.086072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6919-e977-4c29-8f34-cdbce33ca45a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:44.086557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6919-e977-4c29-8f34-cdbce33ca45a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:44.086671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6919-e977-4c29-8f34-cdbce33ca45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:44.107051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:44.164828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-02fc6919-e977-4c29-8f34-cdbce33ca45a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:44.166074 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-02fc6919-e977-4c29-8f34-cdbce33ca45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:44.262705 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:44.415158 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b367a6-a57a-4e41-ad6f-aa7e74e2a703 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:44.416599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-97b367a6-a57a-4e41-ad6f-aa7e74e2a703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:44.530194 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:44.568207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b367a6-a57a-4e41-ad6f-aa7e74e2a703 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:44.804674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb0816-f504-4ab8-a092-df01d3a09551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:44.805284 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0816-f504-4ab8-a092-df01d3a09551 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:44.805561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0816-f504-4ab8-a092-df01d3a09551 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:44.805864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0816-f504-4ab8-a092-df01d3a09551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:44.807477 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8bcb0816-f504-4ab8-a092-df01d3a09551 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:44.886093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:44.900887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb0816-f504-4ab8-a092-df01d3a09551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:44.902525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb0816-f504-4ab8-a092-df01d3a09551 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:44.920831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 725/1425] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:45.799136 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614f0d-9d02-4f94-b5b4-2ac609215d35 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:45.799726 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614f0d-9d02-4f94-b5b4-2ac609215d35 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:45.799726 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00614f0d-9d02-4f94-b5b4-2ac609215d35 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:45.801075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:45.806256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dcdad-e3f1-4ac0-afe9-ca00756408a8 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:45.806648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dcdad-e3f1-4ac0-afe9-ca00756408a8 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:45.806842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dcdad-e3f1-4ac0-afe9-ca00756408a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:45.883255 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-cc6dcdad-e3f1-4ac0-afe9-ca00756408a8 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:45.884491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cc6dcdad-e3f1-4ac0-afe9-ca00756408a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:45.981028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:46.131608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00614f0d-9d02-4f94-b5b4-2ac609215d35 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:46.133087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-00614f0d-9d02-4f94-b5b4-2ac609215d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:46.217766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:46.279689 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00614f0d-9d02-4f94-b5b4-2ac609215d35 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:46.395180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c44b2-b0f5-4bbc-b9f3-4e451c8c25f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:46.400824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c44b2-b0f5-4bbc-b9f3-4e451c8c25f9 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:46.401106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c44b2-b0f5-4bbc-b9f3-4e451c8c25f9 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:46.401377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c44b2-b0f5-4bbc-b9f3-4e451c8c25f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:46.403064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7a1c44b2-b0f5-4bbc-b9f3-4e451c8c25f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:46.457996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:46.499842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c44b2-b0f5-4bbc-b9f3-4e451c8c25f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:46.502106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c44b2-b0f5-4bbc-b9f3-4e451c8c25f9 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:46.521016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 702/1428] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:47.472124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e144-9a2c-4365-b00c-c2f3581a5de6 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:47.472726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e144-9a2c-4365-b00c-c2f3581a5de6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:47.472726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6e144-9a2c-4365-b00c-c2f3581a5de6 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:47.474069 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:47.480957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7c205-fb79-4178-a7d4-9d7bdcaf158d None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:47.487787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7c205-fb79-4178-a7d4-9d7bdcaf158d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:47.487787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7c205-fb79-4178-a7d4-9d7bdcaf158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:47.565031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-90e7c205-fb79-4178-a7d4-9d7bdcaf158d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:47.566267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-90e7c205-fb79-4178-a7d4-9d7bdcaf158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:47.664654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:47.827892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6e144-9a2c-4365-b00c-c2f3581a5de6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:47.829527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-fdf6e144-9a2c-4365-b00c-c2f3581a5de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:47.878689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:47.979435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6e144-9a2c-4365-b00c-c2f3581a5de6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:48.091712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9aa3a-430e-42d4-b4b1-b9d1fbaf8505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:48.092232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9aa3a-430e-42d4-b4b1-b9d1fbaf8505 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:48.092512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9aa3a-430e-42d4-b4b1-b9d1fbaf8505 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:48.092786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9aa3a-430e-42d4-b4b1-b9d1fbaf8505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:48.094419 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cad9aa3a-430e-42d4-b4b1-b9d1fbaf8505 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:48.101935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:48.185683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9aa3a-430e-42d4-b4b1-b9d1fbaf8505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:48.187590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9aa3a-430e-42d4-b4b1-b9d1fbaf8505 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:48.206338 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 728/1431] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:49.099071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229ad97-4569-4496-8bdc-f48f87af4c79 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:49.099617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229ad97-4569-4496-8bdc-f48f87af4c79 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:49.099617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229ad97-4569-4496-8bdc-f48f87af4c79 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:49.101811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:29:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:49.107487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bf625-6bb7-4d31-bfaf-71db66362537 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:49.108356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bf625-6bb7-4d31-bfaf-71db66362537 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:49.108356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bf625-6bb7-4d31-bfaf-71db66362537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:49.189946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-198bf625-6bb7-4d31-bfaf-71db66362537 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:49.191178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-198bf625-6bb7-4d31-bfaf-71db66362537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:49.260584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:49.289867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:49.445521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229ad97-4569-4496-8bdc-f48f87af4c79 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:49.447036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9229ad97-4569-4496-8bdc-f48f87af4c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:49.464317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:49.602869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229ad97-4569-4496-8bdc-f48f87af4c79 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:49.689156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:49.714894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05063bb-7f7c-4ffd-9705-4f96be2564c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:49.715443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05063bb-7f7c-4ffd-9705-4f96be2564c4 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:49.715720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05063bb-7f7c-4ffd-9705-4f96be2564c4 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:49.715998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05063bb-7f7c-4ffd-9705-4f96be2564c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:49.717597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c05063bb-7f7c-4ffd-9705-4f96be2564c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:49.807254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05063bb-7f7c-4ffd-9705-4f96be2564c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:49.808842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05063bb-7f7c-4ffd-9705-4f96be2564c4 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:49.827306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 705/1434] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:50.709500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b20d3-b98d-4076-a84a-b989be2f46f3 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:50.710098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b20d3-b98d-4076-a84a-b989be2f46f3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:50.710098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b20d3-b98d-4076-a84a-b989be2f46f3 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:50.711455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:50.716339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69c42-f9d9-4e84-83fd-b63f7f0c3c57 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:50.716745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69c42-f9d9-4e84-83fd-b63f7f0c3c57 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:50.716890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69c42-f9d9-4e84-83fd-b63f7f0c3c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:50.794937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-42b69c42-f9d9-4e84-83fd-b63f7f0c3c57 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:50.796179 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-42b69c42-f9d9-4e84-83fd-b63f7f0c3c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:50.839169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:50.899003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:51.051349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b20d3-b98d-4076-a84a-b989be2f46f3 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:51.052922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e11b20d3-b98d-4076-a84a-b989be2f46f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.202409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b20d3-b98d-4076-a84a-b989be2f46f3 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:51.259615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:51.320856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf94a3f-9e28-4b99-bc82-ad54886e25b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:51.321376 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94a3f-9e28-4b99-bc82-ad54886e25b0 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:51.321687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94a3f-9e28-4b99-bc82-ad54886e25b0 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:51.321962 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf94a3f-9e28-4b99-bc82-ad54886e25b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:51.323577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0bf94a3f-9e28-4b99-bc82-ad54886e25b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:51.415539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf94a3f-9e28-4b99-bc82-ad54886e25b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:51.417146 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf94a3f-9e28-4b99-bc82-ad54886e25b0 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:51.435614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 731/1437] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:52.311502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7783c3-6f18-46b5-b7cc-6913ca869b12 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.312303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7783c3-6f18-46b5-b7cc-6913ca869b12 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.312303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7783c3-6f18-46b5-b7cc-6913ca869b12 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.314560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:52.320015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfb226-5b03-41b6-ab01-a97a71a4ac61 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.320473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfb226-5b03-41b6-ab01-a97a71a4ac61 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.320812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfb226-5b03-41b6-ab01-a97a71a4ac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.399364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-cadfb226-5b03-41b6-ab01-a97a71a4ac61 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:52.400641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cadfb226-5b03-41b6-ab01-a97a71a4ac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:52.402718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:52.506896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:52.660422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7783c3-6f18-46b5-b7cc-6913ca869b12 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:52.662044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cf7783c3-6f18-46b5-b7cc-6913ca869b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:52.821616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7783c3-6f18-46b5-b7cc-6913ca869b12 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:52.848660 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:52.939275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6359cd-a479-49bd-ade8-129bb06a35ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:52.939879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6359cd-a479-49bd-ade8-129bb06a35ef service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:52.940155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6359cd-a479-49bd-ade8-129bb06a35ef service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:52.940426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6359cd-a479-49bd-ade8-129bb06a35ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:52.942043 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cd6359cd-a479-49bd-ade8-129bb06a35ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:53.037768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6359cd-a479-49bd-ade8-129bb06a35ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:53.039377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6359cd-a479-49bd-ade8-129bb06a35ef service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:53.057918 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 708/1440] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:54.903907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351bbb-96cf-481b-9dba-e232edaeecaf None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.904493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351bbb-96cf-481b-9dba-e232edaeecaf None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.904493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351bbb-96cf-481b-9dba-e232edaeecaf None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.905822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:54.911264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917be8-4a87-42c5-9f10-3fd654dfdf74 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:54.911730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917be8-4a87-42c5-9f10-3fd654dfdf74 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:54.911841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917be8-4a87-42c5-9f10-3fd654dfdf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:54.953591 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:54.979078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8b917be8-4a87-42c5-9f10-3fd654dfdf74 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:54.980294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8b917be8-4a87-42c5-9f10-3fd654dfdf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:55.078863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:55.372903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d351bbb-96cf-481b-9dba-e232edaeecaf None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:55.374486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6d351bbb-96cf-481b-9dba-e232edaeecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:55.480452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d351bbb-96cf-481b-9dba-e232edaeecaf None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:55.512654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:55.554826 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f507e26-2d66-4477-be34-a2522f596d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:55.555426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507e26-2d66-4477-be34-a2522f596d66 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:55.555705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507e26-2d66-4477-be34-a2522f596d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:55.555974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f507e26-2d66-4477-be34-a2522f596d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:55.557569 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4f507e26-2d66-4477-be34-a2522f596d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:55.669457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f507e26-2d66-4477-be34-a2522f596d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:55.670844 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f507e26-2d66-4477-be34-a2522f596d66 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:55.690431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 734/1443] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:29:57.787319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff0a3-b1b5-40b9-bcae-0a611a4c6fac None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:57.787871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff0a3-b1b5-40b9-bcae-0a611a4c6fac None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:57.787871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff0a3-b1b5-40b9-bcae-0a611a4c6fac None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:57.789177 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:29:57.794382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7f24-207f-42f3-9535-f9ce66f6b57a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:57.794785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7f24-207f-42f3-9535-f9ce66f6b57a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:57.794947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7f24-207f-42f3-9535-f9ce66f6b57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:57.867136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-268a7f24-207f-42f3-9535-f9ce66f6b57a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:29:57.868361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-268a7f24-207f-42f3-9535-f9ce66f6b57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:57.882001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:57.967610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:29:58.263245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ff0a3-b1b5-40b9-bcae-0a611a4c6fac None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:29:58.264777 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cd2ff0a3-b1b5-40b9-bcae-0a611a4c6fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:58.371132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ff0a3-b1b5-40b9-bcae-0a611a4c6fac None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:29:58.385344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:29:58.448571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b9643-d523-4c80-9140-51427a1d7bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:29:58.450257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9643-d523-4c80-9140-51427a1d7bea service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:29:58.450257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9643-d523-4c80-9140-51427a1d7bea service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:29:58.450257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b9643-d523-4c80-9140-51427a1d7bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:29:58.451374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3e7b9643-d523-4c80-9140-51427a1d7bea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:29:58.567866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b9643-d523-4c80-9140-51427a1d7bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:29:58.569298 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b9643-d523-4c80-9140-51427a1d7bea service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:29:58.588383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 711/1446] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:01.077275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6673c6-7b3d-419a-9d06-65afc88e6950 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:01.077901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6673c6-7b3d-419a-9d06-65afc88e6950 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:01.077901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6673c6-7b3d-419a-9d06-65afc88e6950 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:01.079423 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:01.085908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fe9c1-d22f-48e0-b4b7-bf22b1bc15bf None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:01.086396 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fe9c1-d22f-48e0-b4b7-bf22b1bc15bf None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:01.086536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fe9c1-d22f-48e0-b4b7-bf22b1bc15bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:01.146904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:01.170020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2d8fe9c1-d22f-48e0-b4b7-bf22b1bc15bf None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:01.171343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2d8fe9c1-d22f-48e0-b4b7-bf22b1bc15bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:01.309968 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:01.602371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6673c6-7b3d-419a-9d06-65afc88e6950 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:01.603909 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-3a6673c6-7b3d-419a-9d06-65afc88e6950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:01.732047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6673c6-7b3d-419a-9d06-65afc88e6950 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:01.780751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:01.820619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5f169-70b3-454a-b2b8-ea5c0776be24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:01.821241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5f169-70b3-454a-b2b8-ea5c0776be24 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:01.821518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5f169-70b3-454a-b2b8-ea5c0776be24 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:01.821819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5f169-70b3-454a-b2b8-ea5c0776be24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:01.824420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ffc5f169-70b3-454a-b2b8-ea5c0776be24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:01.957170 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5f169-70b3-454a-b2b8-ea5c0776be24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:01.958687 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5f169-70b3-454a-b2b8-ea5c0776be24 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:01.978760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 737/1449] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:04.100808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d17a-ea53-4e1e-8ce3-4a583aa32c26 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.101360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d17a-ea53-4e1e-8ce3-4a583aa32c26 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.101360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91d17a-ea53-4e1e-8ce3-4a583aa32c26 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.102872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:04.108409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05d92-e7f9-40d0-8109-660d7a7bb3af None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.108873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05d92-e7f9-40d0-8109-660d7a7bb3af None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.108991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05d92-e7f9-40d0-8109-660d7a7bb3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.180350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-d4b05d92-e7f9-40d0-8109-660d7a7bb3af None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:04.181473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d4b05d92-e7f9-40d0-8109-660d7a7bb3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.207780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:04.294388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:04.597089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91d17a-ea53-4e1e-8ce3-4a583aa32c26 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:04.598736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0a91d17a-ea53-4e1e-8ce3-4a583aa32c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.706868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91d17a-ea53-4e1e-8ce3-4a583aa32c26 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:04.729875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:04.798050 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57793518-2b49-4e8b-83e9-08064a1899c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:04.798656 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57793518-2b49-4e8b-83e9-08064a1899c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:04.798934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57793518-2b49-4e8b-83e9-08064a1899c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:04.799205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57793518-2b49-4e8b-83e9-08064a1899c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:04.800793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-57793518-2b49-4e8b-83e9-08064a1899c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:04.917154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57793518-2b49-4e8b-83e9-08064a1899c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:04.918639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57793518-2b49-4e8b-83e9-08064a1899c1 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:04.937697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 714/1452] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:30:07.005830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1924-a330-4ebf-bad1-6f399eabf6ed None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.006393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1924-a330-4ebf-bad1-6f399eabf6ed None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.006393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1924-a330-4ebf-bad1-6f399eabf6ed None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.007765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:07.013594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744ded4-8053-4fb8-a045-d2f092c7c3ff None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.014123 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744ded4-8053-4fb8-a045-d2f092c7c3ff None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.014229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744ded4-8053-4fb8-a045-d2f092c7c3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.082831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:07.086182 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8744ded4-8053-4fb8-a045-d2f092c7c3ff None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:07.087444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8744ded4-8053-4fb8-a045-d2f092c7c3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:07.191677 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:07.481893 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1924-a330-4ebf-bad1-6f399eabf6ed None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:07.483438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a3cb1924-a330-4ebf-bad1-6f399eabf6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:07.616256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1924-a330-4ebf-bad1-6f399eabf6ed None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:07.683483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:07.709672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49108626-4b41-4d70-9895-ae164ce5cb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:07.710294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108626-4b41-4d70-9895-ae164ce5cb5b service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:07.710583 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108626-4b41-4d70-9895-ae164ce5cb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:07.710856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108626-4b41-4d70-9895-ae164ce5cb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:07.712525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-49108626-4b41-4d70-9895-ae164ce5cb5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:07.830055 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49108626-4b41-4d70-9895-ae164ce5cb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:07.831495 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49108626-4b41-4d70-9895-ae164ce5cb5b service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:07.850196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 740/1455] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:09.873177 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38202aa-0c71-45f7-a0ba-bd864616027e None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:09.873787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38202aa-0c71-45f7-a0ba-bd864616027e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:09.873787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38202aa-0c71-45f7-a0ba-bd864616027e None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:09.875721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:30:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:09.881310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa704fc2-81e8-4211-8c5e-a45a0f2df1db None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:09.881838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa704fc2-81e8-4211-8c5e-a45a0f2df1db None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:09.881951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa704fc2-81e8-4211-8c5e-a45a0f2df1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:09.949725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-fa704fc2-81e8-4211-8c5e-a45a0f2df1db None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:09.950946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-fa704fc2-81e8-4211-8c5e-a45a0f2df1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:09.980995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:10.049101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:10.343494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38202aa-0c71-45f7-a0ba-bd864616027e None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:10.346066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c38202aa-0c71-45f7-a0ba-bd864616027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:10.451455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38202aa-0c71-45f7-a0ba-bd864616027e None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:10.479553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:10.525669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512abc9-b2c0-49ee-8973-a9b309e80ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:10.526282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512abc9-b2c0-49ee-8973-a9b309e80ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:10.526567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512abc9-b2c0-49ee-8973-a9b309e80ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:10.526839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512abc9-b2c0-49ee-8973-a9b309e80ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:10.528435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e512abc9-b2c0-49ee-8973-a9b309e80ef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:10.641328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512abc9-b2c0-49ee-8973-a9b309e80ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:10.642963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512abc9-b2c0-49ee-8973-a9b309e80ef5 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:10.662387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 717/1458] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:12.780250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8032592-afdd-4165-a8e4-212b21687e0b None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.780812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8032592-afdd-4165-a8e4-212b21687e0b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.780812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8032592-afdd-4165-a8e4-212b21687e0b None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.782606 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:12.788333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f156-e4f1-4b24-ae52-5b2d434f220d None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:12.788864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f156-e4f1-4b24-ae52-5b2d434f220d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:12.788864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1f156-e4f1-4b24-ae52-5b2d434f220d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:12.862975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-9ec1f156-e4f1-4b24-ae52-5b2d434f220d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:12.864206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9ec1f156-e4f1-4b24-ae52-5b2d434f220d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:12.873250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:12.982044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:13.268757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8032592-afdd-4165-a8e4-212b21687e0b None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:13.270377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d8032592-afdd-4165-a8e4-212b21687e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:13.382571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8032592-afdd-4165-a8e4-212b21687e0b None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:13.438503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:13.458134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa0233-c85e-4b97-b02c-def66c7793e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:13.458134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa0233-c85e-4b97-b02c-def66c7793e3 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:13.458519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa0233-c85e-4b97-b02c-def66c7793e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:13.458650 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa0233-c85e-4b97-b02c-def66c7793e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:13.460175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bbfa0233-c85e-4b97-b02c-def66c7793e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:13.570490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa0233-c85e-4b97-b02c-def66c7793e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:13.571824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa0233-c85e-4b97-b02c-def66c7793e3 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:13.592143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 743/1461] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:15.599698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b428bd-60b5-4fdf-ab51-2f4c5e72e9af None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:15.600308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b428bd-60b5-4fdf-ab51-2f4c5e72e9af None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:15.600308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b428bd-60b5-4fdf-ab51-2f4c5e72e9af None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:15.601597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:15.606964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e62878-79a1-4974-afea-a66860193f77 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:15.607346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e62878-79a1-4974-afea-a66860193f77 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:15.607544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e62878-79a1-4974-afea-a66860193f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:15.675458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-d7e62878-79a1-4974-afea-a66860193f77 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:15.676670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d7e62878-79a1-4974-afea-a66860193f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:15.714820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:15.773398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:30:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:16.062599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b428bd-60b5-4fdf-ab51-2f4c5e72e9af None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:16.064148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b0b428bd-60b5-4fdf-ab51-2f4c5e72e9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:16.176348 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b428bd-60b5-4fdf-ab51-2f4c5e72e9af None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:16.214551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:16.251072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16c051-39da-4998-add9-86ef82f35c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:16.251734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16c051-39da-4998-add9-86ef82f35c46 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:16.252278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16c051-39da-4998-add9-86ef82f35c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:16.252729 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16c051-39da-4998-add9-86ef82f35c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:16.254751 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7a16c051-39da-4998-add9-86ef82f35c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:16.366201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16c051-39da-4998-add9-86ef82f35c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:16.367654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16c051-39da-4998-add9-86ef82f35c46 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:16.386923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 720/1464] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:18.451825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f23ac-289c-43f9-ae54-5baef5c04c8d None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:18.452438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f23ac-289c-43f9-ae54-5baef5c04c8d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:18.452438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f23ac-289c-43f9-ae54-5baef5c04c8d None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:18.454281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:18.459685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1af4da-89b1-4455-b5fd-1d960e1ea623 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:18.460146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1af4da-89b1-4455-b5fd-1d960e1ea623 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:18.460256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1af4da-89b1-4455-b5fd-1d960e1ea623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:18.527935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ff1af4da-89b1-4455-b5fd-1d960e1ea623 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:18.529157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ff1af4da-89b1-4455-b5fd-1d960e1ea623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:18.548865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:18.634253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:18.929781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f23ac-289c-43f9-ae54-5baef5c04c8d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:18.932057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b52f23ac-289c-43f9-ae54-5baef5c04c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:19.059663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f23ac-289c-43f9-ae54-5baef5c04c8d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:19.152337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:19.161292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f747b1-8cc6-47ee-b271-4c46ff4d4033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:19.167159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f747b1-8cc6-47ee-b271-4c46ff4d4033 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:19.167159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f747b1-8cc6-47ee-b271-4c46ff4d4033 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:19.167159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f747b1-8cc6-47ee-b271-4c46ff4d4033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:19.167159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a7f747b1-8cc6-47ee-b271-4c46ff4d4033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:19.303220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f747b1-8cc6-47ee-b271-4c46ff4d4033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:19.305264 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f747b1-8cc6-47ee-b271-4c46ff4d4033 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:19.327228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 746/1467] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:21.320966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da119d4-b16f-435a-b952-409090dffa85 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.321545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da119d4-b16f-435a-b952-409090dffa85 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.321702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da119d4-b16f-435a-b952-409090dffa85 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.322953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:21.329369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77508f9c-c34b-448d-83f3-4fa002e56052 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:21.329848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77508f9c-c34b-448d-83f3-4fa002e56052 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:21.329958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77508f9c-c34b-448d-83f3-4fa002e56052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:21.402214 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-77508f9c-c34b-448d-83f3-4fa002e56052 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:21.404453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-77508f9c-c34b-448d-83f3-4fa002e56052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:21.455210 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:21.516089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:21.809059 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da119d4-b16f-435a-b952-409090dffa85 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:21.810644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7da119d4-b16f-435a-b952-409090dffa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:21.924718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da119d4-b16f-435a-b952-409090dffa85 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:21.976952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:22.004830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53703d35-c23e-4bda-9312-e82a788a319c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:22.005440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53703d35-c23e-4bda-9312-e82a788a319c service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:22.005829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53703d35-c23e-4bda-9312-e82a788a319c service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:22.006668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53703d35-c23e-4bda-9312-e82a788a319c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:22.009155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-53703d35-c23e-4bda-9312-e82a788a319c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:22.128713 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53703d35-c23e-4bda-9312-e82a788a319c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:22.130092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53703d35-c23e-4bda-9312-e82a788a319c service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:22.151998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 723/1470] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:30:31.514428 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=22 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:32.149504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=66 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:42.560629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7dc5-65ca-4fd1-9de0-2b4c7b1e63c3 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:42.561201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7dc5-65ca-4fd1-9de0-2b4c7b1e63c3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:42.561201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7dc5-65ca-4fd1-9de0-2b4c7b1e63c3 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:42.563784 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 748/1471] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:30:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:42.569289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072cf3-a0a2-4be8-8517-5d084bdee631 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:42.569731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072cf3-a0a2-4be8-8517-5d084bdee631 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:42.569952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06072cf3-a0a2-4be8-8517-5d084bdee631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:42.635907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-06072cf3-a0a2-4be8-8517-5d084bdee631 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:42.637122 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-06072cf3-a0a2-4be8-8517-5d084bdee631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:42.735446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 724/1472] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:43.035254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e4413-fa98-47d2-ae68-2fe658d3b96f None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:43.035575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e4413-fa98-47d2-ae68-2fe658d3b96f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:43.035856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e4413-fa98-47d2-ae68-2fe658d3b96f None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:43.037191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 749/1473] 10.222.0.74 () {54 vars in 967 bytes} [Wed Aug 31 00:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:30:43.042031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f635a80-2695-4dba-9e4e-08c052e7e43f None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:43.042322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f635a80-2695-4dba-9e4e-08c052e7e43f None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:43.042599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f635a80-2695-4dba-9e4e-08c052e7e43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:43.122862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-7f635a80-2695-4dba-9e4e-08c052e7e43f None None] MFA Rules not processed for user `d8590378b14c49cf9266a0d859db5bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:43.124181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7f635a80-2695-4dba-9e4e-08c052e7e43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:43.147508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:43.209949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 725/1474] 10.222.0.74 () {58 vars in 1064 bytes} [Wed Aug 31 00:30:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:43.217522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e4413-fa98-47d2-ae68-2fe658d3b96f None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:43.219266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8f4e4413-fa98-47d2-ae68-2fe658d3b96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:43.329930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e4413-fa98-47d2-ae68-2fe658d3b96f None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:43.406026 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b5bbc-a176-4ebb-9e4b-b09124e44843 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8590378b14c49cf9266a0d859db5bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:43.406639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b5bbc-a176-4ebb-9e4b-b09124e44843 service glance] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:43.406923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b5bbc-a176-4ebb-9e4b-b09124e44843 service glance] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:43.407200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b5bbc-a176-4ebb-9e4b-b09124e44843 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:43.408816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d24b5bbc-a176-4ebb-9e4b-b09124e44843 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:43.468305 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:43.528491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b5bbc-a176-4ebb-9e4b-b09124e44843 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:43.529981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b5bbc-a176-4ebb-9e4b-b09124e44843 service glance] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:43.550962 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 750/1475] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:45.618688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cae02b-249b-475d-8e42-12c9d24aa475 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:45.619319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cae02b-249b-475d-8e42-12c9d24aa475 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:45.619319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cae02b-249b-475d-8e42-12c9d24aa475 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:45.620588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 726/1476] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:45.626067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81d415-8701-4662-a5f9-27dff63be921 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:45.626539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81d415-8701-4662-a5f9-27dff63be921 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:45.626651 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81d415-8701-4662-a5f9-27dff63be921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:45.693517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-ba81d415-8701-4662-a5f9-27dff63be921 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:45.694781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ba81d415-8701-4662-a5f9-27dff63be921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:45.794175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 751/1477] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:46.071537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cae02b-249b-475d-8e42-12c9d24aa475 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:46.073085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-11cae02b-249b-475d-8e42-12c9d24aa475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:46.208763 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cae02b-249b-475d-8e42-12c9d24aa475 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:46.258450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:46.304049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff5fb1-343e-4d20-a9dc-ab1fc71416b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:46.304637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff5fb1-343e-4d20-a9dc-ab1fc71416b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:46.304920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff5fb1-343e-4d20-a9dc-ab1fc71416b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:46.305194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff5fb1-343e-4d20-a9dc-ab1fc71416b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:46.305866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff5fb1-343e-4d20-a9dc-ab1fc71416b0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:46.307609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: WARNING py.warnings [None req-fdff5fb1-343e-4d20-a9dc-ab1fc71416b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:30:46.307609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: warnings.warn(msg) Aug 31 00:30:46.307609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: Aug 31 00:30:46.308879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff5fb1-343e-4d20-a9dc-ab1fc71416b0 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:46.330444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 727/1478] 10.222.0.74 () {56 vars in 1108 bytes} [Wed Aug 31 00:30:46 2022] GET /identity/v3/projects => generated 2553 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:30:48.333350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbce963-4b01-4446-822e-3275127f90c4 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:48.334100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbce963-4b01-4446-822e-3275127f90c4 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:48.334100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbce963-4b01-4446-822e-3275127f90c4 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:48.335285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 752/1479] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:48.340748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a50f82-fbde-4a26-9b0b-aa1dfb5e52ca None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:48.341178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a50f82-fbde-4a26-9b0b-aa1dfb5e52ca None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:48.341312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a50f82-fbde-4a26-9b0b-aa1dfb5e52ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:48.409761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-28a50f82-fbde-4a26-9b0b-aa1dfb5e52ca None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:48.411028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-28a50f82-fbde-4a26-9b0b-aa1dfb5e52ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:48.508890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 728/1480] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:48.816272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbce963-4b01-4446-822e-3275127f90c4 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:48.817917 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2fbce963-4b01-4446-822e-3275127f90c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:48.828819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:48.971594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbce963-4b01-4446-822e-3275127f90c4 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:49.056761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:49.090617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b1589-c880-4d24-a508-77c6141b6392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:49.091231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b1589-c880-4d24-a508-77c6141b6392 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:49.091710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b1589-c880-4d24-a508-77c6141b6392 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:49.092196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b1589-c880-4d24-a508-77c6141b6392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:49.094381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-003b1589-c880-4d24-a508-77c6141b6392 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:49.188308 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b1589-c880-4d24-a508-77c6141b6392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:49.189964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b1589-c880-4d24-a508-77c6141b6392 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:49.208506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 753/1481] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:51.336150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44893ab-2df6-4daa-a06a-7d30f8a647f7 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:51.336720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44893ab-2df6-4daa-a06a-7d30f8a647f7 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:51.336720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44893ab-2df6-4daa-a06a-7d30f8a647f7 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:51.338088 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 729/1482] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:51.343584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea873-3f86-4ca7-869a-f696fd16eb52 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:51.344063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea873-3f86-4ca7-869a-f696fd16eb52 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:51.344191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea873-3f86-4ca7-869a-f696fd16eb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:51.410300 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-82dea873-3f86-4ca7-869a-f696fd16eb52 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:51.411552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-82dea873-3f86-4ca7-869a-f696fd16eb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:51.458800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:51.510694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 754/1483] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:30:51.820820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44893ab-2df6-4daa-a06a-7d30f8a647f7 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:51.822411 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b44893ab-2df6-4daa-a06a-7d30f8a647f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:51.846899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:51.930960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44893ab-2df6-4daa-a06a-7d30f8a647f7 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:52.009465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a00dd2-a6d2-4b77-9da7-51602e182e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:52.010120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a00dd2-a6d2-4b77-9da7-51602e182e07 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:52.010398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a00dd2-a6d2-4b77-9da7-51602e182e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:52.010675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a00dd2-a6d2-4b77-9da7-51602e182e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:52.012321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f4a00dd2-a6d2-4b77-9da7-51602e182e07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:52.093621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:52.137957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a00dd2-a6d2-4b77-9da7-51602e182e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:52.140655 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a00dd2-a6d2-4b77-9da7-51602e182e07 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:52.165272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 730/1484] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:54.187145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ef7a9-2730-4060-be43-a9db59135814 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:54.187934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ef7a9-2730-4060-be43-a9db59135814 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:54.187934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ef7a9-2730-4060-be43-a9db59135814 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:54.189079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 755/1485] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:54.194398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c8a4-dd61-407d-b89f-5678cc326592 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:54.194849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c8a4-dd61-407d-b89f-5678cc326592 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:54.194981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c8a4-dd61-407d-b89f-5678cc326592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:54.269122 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-aa85c8a4-dd61-407d-b89f-5678cc326592 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:54.270403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-aa85c8a4-dd61-407d-b89f-5678cc326592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:54.369449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 731/1486] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:54.666071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ef7a9-2730-4060-be43-a9db59135814 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:54.667658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-911ef7a9-2730-4060-be43-a9db59135814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:54.786267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ef7a9-2730-4060-be43-a9db59135814 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:54.861312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:54.863297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c2316-4bbb-47e4-867f-191177a202f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:54.863907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c2316-4bbb-47e4-867f-191177a202f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:54.864183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c2316-4bbb-47e4-867f-191177a202f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:54.864451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c2316-4bbb-47e4-867f-191177a202f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:54.866104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-148c2316-4bbb-47e4-867f-191177a202f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:54.986855 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c2316-4bbb-47e4-867f-191177a202f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:54.988228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c2316-4bbb-47e4-867f-191177a202f3 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:55.006592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 756/1487] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:30:57.074272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208988c-f826-4448-9ae5-a6e5d6e27db2 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:57.074837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208988c-f826-4448-9ae5-a6e5d6e27db2 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:57.074837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208988c-f826-4448-9ae5-a6e5d6e27db2 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:57.076189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 732/1488] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:30:57.083240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00160080-ae9a-4bab-a2f1-a0806041796d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:57.083795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00160080-ae9a-4bab-a2f1-a0806041796d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:57.083795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00160080-ae9a-4bab-a2f1-a0806041796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:57.151799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-00160080-ae9a-4bab-a2f1-a0806041796d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:30:57.152926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-00160080-ae9a-4bab-a2f1-a0806041796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:57.207495 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:57.258843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 757/1489] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:30:57.563623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208988c-f826-4448-9ae5-a6e5d6e27db2 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:30:57.565202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5208988c-f826-4448-9ae5-a6e5d6e27db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:57.603189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:57.674155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208988c-f826-4448-9ae5-a6e5d6e27db2 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:30:57.752744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc9353-743d-4cff-a372-7da9cf45c243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:30:57.753435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9353-743d-4cff-a372-7da9cf45c243 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:30:57.753741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9353-743d-4cff-a372-7da9cf45c243 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:30:57.754025 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc9353-743d-4cff-a372-7da9cf45c243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:30:57.755645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-09dc9353-743d-4cff-a372-7da9cf45c243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:30:57.839253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:30:57.870446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc9353-743d-4cff-a372-7da9cf45c243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:30:57.871892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc9353-743d-4cff-a372-7da9cf45c243 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:30:57.891806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 733/1490] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:00.334752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b6b20-9227-483b-8fd3-89c0defde8d6 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:00.335346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b6b20-9227-483b-8fd3-89c0defde8d6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:00.335346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b6b20-9227-483b-8fd3-89c0defde8d6 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:00.336820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 758/1491] 10.222.0.74 () {54 vars in 927 bytes} [Wed Aug 31 00:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:31:00.344566 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245dc7-30a7-40cf-ae91-8f8d0fefc76d None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:00.345270 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245dc7-30a7-40cf-ae91-8f8d0fefc76d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:00.345373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245dc7-30a7-40cf-ae91-8f8d0fefc76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:00.453558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-95245dc7-30a7-40cf-ae91-8f8d0fefc76d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:31:00.454891 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-95245dc7-30a7-40cf-ae91-8f8d0fefc76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:00.567956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 734/1492] 10.222.0.74 () {58 vars in 1024 bytes} [Wed Aug 31 00:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:31:00.863510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b6b20-9227-483b-8fd3-89c0defde8d6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:31:00.865092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4b4b6b20-9227-483b-8fd3-89c0defde8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:00.978410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b6b20-9227-483b-8fd3-89c0defde8d6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:31:01.055444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb53b4-68f8-4c77-b809-9953990e5aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:31:01.056061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb53b4-68f8-4c77-b809-9953990e5aab service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:31:01.056339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb53b4-68f8-4c77-b809-9953990e5aab service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:31:01.056648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb53b4-68f8-4c77-b809-9953990e5aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:31:01.058287 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f9eb53b4-68f8-4c77-b809-9953990e5aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:31:01.068506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:01.181177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb53b4-68f8-4c77-b809-9953990e5aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:31:01.182597 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb53b4-68f8-4c77-b809-9953990e5aab service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:31:01.202075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 759/1493] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:31:10.566136 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=82 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:31:11.199377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=50 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:30.724311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7a9d-1f74-48e6-a485-5af36e6eea89 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:30.725106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7a9d-1f74-48e6-a485-5af36e6eea89 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:30.725106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7a9d-1f74-48e6-a485-5af36e6eea89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:30.815542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-490c7a9d-1f74-48e6-a485-5af36e6eea89 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:32:30.816880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-490c7a9d-1f74-48e6-a485-5af36e6eea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:30.952080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 735/1494] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:32:30.963050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784440e4-54e0-483f-a83a-ec5272d6ccbf None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:30.963918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784440e4-54e0-483f-a83a-ec5272d6ccbf None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:30.963918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784440e4-54e0-483f-a83a-ec5272d6ccbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:31.080241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-784440e4-54e0-483f-a83a-ec5272d6ccbf None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:32:31.081482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-784440e4-54e0-483f-a83a-ec5272d6ccbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:31.213074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 760/1495] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:32:31.218664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7a9d-1f74-48e6-a485-5af36e6eea89 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:31.220804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-490c7a9d-1f74-48e6-a485-5af36e6eea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:31.236386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7a9d-1f74-48e6-a485-5af36e6eea89 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:31.346743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:31.418959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef041140-a9a5-47d9-9640-cb335c313952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:31.419589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef041140-a9a5-47d9-9640-cb335c313952 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:31.419868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef041140-a9a5-47d9-9640-cb335c313952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:31.420141 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef041140-a9a5-47d9-9640-cb335c313952 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:31.420802 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef041140-a9a5-47d9-9640-cb335c313952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:32:31.421102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef041140-a9a5-47d9-9640-cb335c313952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:31.422584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: WARNING py.warnings [None req-ef041140-a9a5-47d9-9640-cb335c313952 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:32:31.422584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: warnings.warn(msg) Aug 31 00:32:31.422584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: Aug 31 00:32:31.423498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef041140-a9a5-47d9-9640-cb335c313952 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:31.447848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 736/1496] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:32:31.460003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784440e4-54e0-483f-a83a-ec5272d6ccbf None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:31.472965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784440e4-54e0-483f-a83a-ec5272d6ccbf None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:31.553373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:31.594639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f532f-a239-4084-8197-512414641ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:31.595252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f532f-a239-4084-8197-512414641ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:31.595531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f532f-a239-4084-8197-512414641ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:31.595934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f532f-a239-4084-8197-512414641ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:31.596589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f532f-a239-4084-8197-512414641ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:31.598443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: WARNING py.warnings [None req-904f532f-a239-4084-8197-512414641ea3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:32:31.598443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: warnings.warn(msg) Aug 31 00:32:31.598443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: Aug 31 00:32:31.599625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f532f-a239-4084-8197-512414641ea3 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:31.747663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 761/1497] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:32:31 2022] POST /identity/v3/projects => generated 379 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:32:31.752179 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef041140-a9a5-47d9-9640-cb335c313952 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:31.753725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ef041140-a9a5-47d9-9640-cb335c313952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:31.790159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef041140-a9a5-47d9-9640-cb335c313952 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:31.939635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280958c6-7421-4f28-9991-77ba9bad96dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:31.940250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280958c6-7421-4f28-9991-77ba9bad96dc admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:31.940524 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280958c6-7421-4f28-9991-77ba9bad96dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:31.940926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280958c6-7421-4f28-9991-77ba9bad96dc admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:31.946986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280958c6-7421-4f28-9991-77ba9bad96dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:31.946986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: WARNING py.warnings [None req-280958c6-7421-4f28-9991-77ba9bad96dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:32:31.946986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: warnings.warn(msg) Aug 31 00:32:31.946986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: Aug 31 00:32:31.946986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280958c6-7421-4f28-9991-77ba9bad96dc admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:32.108992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 737/1498] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:32:31 2022] POST /identity/v3/users => generated 290 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:32:32.113881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f532f-a239-4084-8197-512414641ea3 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:32.115592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-904f532f-a239-4084-8197-512414641ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:32.193605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f532f-a239-4084-8197-512414641ea3 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:32.296679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:32.309070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf38e9-c06e-4963-8f17-bfcc77d474c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:32.315209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf38e9-c06e-4963-8f17-bfcc77d474c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:32.315209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf38e9-c06e-4963-8f17-bfcc77d474c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:32.315209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf38e9-c06e-4963-8f17-bfcc77d474c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:32.315209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf38e9-c06e-4963-8f17-bfcc77d474c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:32.315209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: WARNING py.warnings [None req-18bf38e9-c06e-4963-8f17-bfcc77d474c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:32:32.315209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: warnings.warn(msg) Aug 31 00:32:32.315209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: Aug 31 00:32:32.315839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf38e9-c06e-4963-8f17-bfcc77d474c4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:32.336431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 762/1499] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:32:32.341500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280958c6-7421-4f28-9991-77ba9bad96dc admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:32.343822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-280958c6-7421-4f28-9991-77ba9bad96dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:32.356697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280958c6-7421-4f28-9991-77ba9bad96dc admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:32.395703 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:32.483890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806993b0-c706-4c96-a15c-9e23a5a23462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:32.484423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806993b0-c706-4c96-a15c-9e23a5a23462 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:32.484708 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806993b0-c706-4c96-a15c-9e23a5a23462 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:32.484983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806993b0-c706-4c96-a15c-9e23a5a23462 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:32.485670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806993b0-c706-4c96-a15c-9e23a5a23462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:32.486706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: WARNING py.warnings [None req-806993b0-c706-4c96-a15c-9e23a5a23462 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:32:32.486706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: warnings.warn(msg) Aug 31 00:32:32.486706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: Aug 31 00:32:32.487614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806993b0-c706-4c96-a15c-9e23a5a23462 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:32.504862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 738/1500] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:32:32.513609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf38e9-c06e-4963-8f17-bfcc77d474c4 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:32.516187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-18bf38e9-c06e-4963-8f17-bfcc77d474c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:32.558970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf38e9-c06e-4963-8f17-bfcc77d474c4 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:32.684356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c2f29-09cb-4869-9a5c-b871d5068037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:32.685188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c2f29-09cb-4869-9a5c-b871d5068037 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:32.685463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c2f29-09cb-4869-9a5c-b871d5068037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:32.685772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c2f29-09cb-4869-9a5c-b871d5068037 admin admin] PATH_INFO: `/v3/projects/e428fb671e6a4322bcb550e34da023ec/users/1d2163ead29546f28d1c05e98b6e3854/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:32.710729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c2f29-09cb-4869-9a5c-b871d5068037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e428fb671e6a4322bcb550e34da023ec, user_id=1d2163ead29546f28d1c05e98b6e3854, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:32.712288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: WARNING py.warnings [None req-6e0c2f29-09cb-4869-9a5c-b871d5068037 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:32:32.712288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: warnings.warn(msg) Aug 31 00:32:32.712288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: Aug 31 00:32:32.715351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c2f29-09cb-4869-9a5c-b871d5068037 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:32.804367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 763/1501] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:32:32 2022] PUT /identity/v3/projects/e428fb671e6a4322bcb550e34da023ec/users/1d2163ead29546f28d1c05e98b6e3854/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:32:32.818741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8fd9-44b6-48c7-965f-89a091611fd0 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:32.819633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8fd9-44b6-48c7-965f-89a091611fd0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:32.819633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8fd9-44b6-48c7-965f-89a091611fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:32.883021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-1c7a8fd9-44b6-48c7-965f-89a091611fd0 None None] MFA Rules not processed for user `1d2163ead29546f28d1c05e98b6e3854`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:32:32.884139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1c7a8fd9-44b6-48c7-965f-89a091611fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:32.983442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 739/1502] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:32:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:32:32.997310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73469103-70dd-4f78-9e6d-e37d0c8ffdc3 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:32.997645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73469103-70dd-4f78-9e6d-e37d0c8ffdc3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:32.997926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73469103-70dd-4f78-9e6d-e37d0c8ffdc3 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:32.999271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 764/1503] 10.222.0.74 () {54 vars in 964 bytes} [Wed Aug 31 00:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:32:33.005095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44d408-2e09-4fb6-be53-e23611c207bd None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:33.005517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44d408-2e09-4fb6-be53-e23611c207bd None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:33.006092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44d408-2e09-4fb6-be53-e23611c207bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:33.044233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:33.094995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-6d44d408-2e09-4fb6-be53-e23611c207bd None None] MFA Rules not processed for user `75f62fa62f2d420a998f236ff7f9b6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:32:33.096188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6d44d408-2e09-4fb6-be53-e23611c207bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:33.188196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 740/1504] 10.222.0.74 () {58 vars in 1061 bytes} [Wed Aug 31 00:32:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:32:33.196627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73469103-70dd-4f78-9e6d-e37d0c8ffdc3 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:33.198269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-73469103-70dd-4f78-9e6d-e37d0c8ffdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:33.255641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:33.323615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73469103-70dd-4f78-9e6d-e37d0c8ffdc3 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:33.408104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a6737-9d8b-4933-80b6-8851808fe260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:33.408617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a6737-9d8b-4933-80b6-8851808fe260 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:33.408896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a6737-9d8b-4933-80b6-8851808fe260 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:33.409164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a6737-9d8b-4933-80b6-8851808fe260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:33.410788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-978a6737-9d8b-4933-80b6-8851808fe260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:33.532277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a6737-9d8b-4933-80b6-8851808fe260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:33.533751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a6737-9d8b-4933-80b6-8851808fe260 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:33.537480 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:33.553478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 765/1505] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:32:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:32:33.607524 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7c28-df0f-42a1-9344-dd02bec4657b None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:33.608032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7c28-df0f-42a1-9344-dd02bec4657b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:33.608485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7c28-df0f-42a1-9344-dd02bec4657b None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:33.609870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 741/1506] 10.222.0.74 () {52 vars in 830 bytes} [Wed Aug 31 00:32:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:32:33.613833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a6737-9d8b-4933-80b6-8851808fe260 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:33.615054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-978a6737-9d8b-4933-80b6-8851808fe260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:33.741181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a6737-9d8b-4933-80b6-8851808fe260 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:33.852603 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:33.853240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:33.853516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:33.853816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] PATH_INFO: `/v3/users/1d2163ead29546f28d1c05e98b6e3854` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:33.867514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d2163ead29546f28d1c05e98b6e3854)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:33.868559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: WARNING py.warnings [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:32:33.868559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: warnings.warn(msg) Aug 31 00:32:33.868559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: Aug 31 00:32:33.870291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:33.880584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:34.049330 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d2163ead29546f28d1c05e98b6e3854'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:34.124698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d2163ead29546f28d1c05e98b6e3854'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:34.155852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d2163ead29546f28d1c05e98b6e3854'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:34.173147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d2163ead29546f28d1c05e98b6e3854'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:34.173865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d2163ead29546f28d1c05e98b6e3854'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:34.181103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 766/1507] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:32:33 2022] DELETE /identity/v3/users/1d2163ead29546f28d1c05e98b6e3854 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:32:34.186444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdae2f-5712-4e31-82c4-f33fc5233662 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:34.187771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdae2f-5712-4e31-82c4-f33fc5233662 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:34.187771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdae2f-5712-4e31-82c4-f33fc5233662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:34.256732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-33fdae2f-5712-4e31-82c4-f33fc5233662 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:32:34.258046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-33fdae2f-5712-4e31-82c4-f33fc5233662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:34.352189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:34.366589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 742/1508] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:32:34.377787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:34.379029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:34.502674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82212ae8-6c7e-4ebf-b22e-5d384eed3cb3 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:34.563157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:34.585644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c5093-6d48-402b-993c-3b43c754dfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:34.586307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c5093-6d48-402b-993c-3b43c754dfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:34.586604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c5093-6d48-402b-993c-3b43c754dfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:34.587387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c5093-6d48-402b-993c-3b43c754dfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:34.588560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8f7c5093-6d48-402b-993c-3b43c754dfe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:34.712157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c5093-6d48-402b-993c-3b43c754dfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:34.713526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c5093-6d48-402b-993c-3b43c754dfe3 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:34.733479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 767/1509] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:32:35.318350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdae2f-5712-4e31-82c4-f33fc5233662 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:32:35.320061 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-33fdae2f-5712-4e31-82c4-f33fc5233662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:32:35.344817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdae2f-5712-4e31-82c4-f33fc5233662 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:32:35.510377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:32:35.511472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:32:35.511899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:32:35.512296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] PATH_INFO: `/v3/projects/e428fb671e6a4322bcb550e34da023ec` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:32:35.529202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e428fb671e6a4322bcb550e34da023ec)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:32:35.531166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: WARNING py.warnings [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:32:35.531166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: warnings.warn(msg) Aug 31 00:32:35.531166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: Aug 31 00:32:35.533747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:32:35.690987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e428fb671e6a4322bcb550e34da023ec', 'request_id': 'req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:35.760609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e428fb671e6a4322bcb550e34da023ec', 'request_id': 'req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:35.771002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e428fb671e6a4322bcb550e34da023ec', 'request_id': 'req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:35.827451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] The token cache is being invalidate because project e428fb671e6a4322bcb550e34da023ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:32:35.827779 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:35.828528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e685cdea-2a3e-4c22-b3ff-3a847f42e6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:32:35.830506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 743/1510] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:32:35 2022] DELETE /identity/v3/projects/e428fb671e6a4322bcb550e34da023ec => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:32:44.731103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=62 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:32:45.822784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:14.425497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb130089-27f0-496f-9dc3-80c8fdb5e8df None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:14.426234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb130089-27f0-496f-9dc3-80c8fdb5e8df None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:14.426234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb130089-27f0-496f-9dc3-80c8fdb5e8df None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:14.427616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:34:14.433901 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395afa-c55e-4c8d-a87d-953427b62fa3 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:14.435269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395afa-c55e-4c8d-a87d-953427b62fa3 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:14.435468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395afa-c55e-4c8d-a87d-953427b62fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:14.551701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-7d395afa-c55e-4c8d-a87d-953427b62fa3 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:34:14.552954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7d395afa-c55e-4c8d-a87d-953427b62fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:14.690112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:34:14.847235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb130089-27f0-496f-9dc3-80c8fdb5e8df None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:34:14.849591 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bb130089-27f0-496f-9dc3-80c8fdb5e8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:14.999626 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb130089-27f0-496f-9dc3-80c8fdb5e8df None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:34:15.008547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4935cd9-5374-4ca9-bdbc-5479b7898476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:34:15.009174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4935cd9-5374-4ca9-bdbc-5479b7898476 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:15.009457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4935cd9-5374-4ca9-bdbc-5479b7898476 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:15.009773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4935cd9-5374-4ca9-bdbc-5479b7898476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:15.021163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4935cd9-5374-4ca9-bdbc-5479b7898476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:34:15.022981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4935cd9-5374-4ca9-bdbc-5479b7898476 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:34:15.037105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 769/1513] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:34:15.924028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fedb08-bc46-4f23-b31f-d9d3f5d3e560 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:15.924841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fedb08-bc46-4f23-b31f-d9d3f5d3e560 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:15.924841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fedb08-bc46-4f23-b31f-d9d3f5d3e560 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:15.926544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 745/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:34:15.932936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596e889-00d2-4c4b-9231-812e6fe1a92d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:15.932936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596e889-00d2-4c4b-9231-812e6fe1a92d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:15.932936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596e889-00d2-4c4b-9231-812e6fe1a92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:15.954705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-a596e889-00d2-4c4b-9231-812e6fe1a92d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:34:15.955982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a596e889-00d2-4c4b-9231-812e6fe1a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:15.964364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 770/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:34:16.151910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fedb08-bc46-4f23-b31f-d9d3f5d3e560 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:34:16.167991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fedb08-bc46-4f23-b31f-d9d3f5d3e560 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:34:16.175157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a8ce7-f02e-4e04-985d-12a3b3029064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:34:16.175773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a8ce7-f02e-4e04-985d-12a3b3029064 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:16.176054 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a8ce7-f02e-4e04-985d-12a3b3029064 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:16.176329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a8ce7-f02e-4e04-985d-12a3b3029064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:16.185466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a8ce7-f02e-4e04-985d-12a3b3029064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:34:16.187087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a8ce7-f02e-4e04-985d-12a3b3029064 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:34:16.198264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 746/1516] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:34:16.375051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0fc2-84c2-4829-ab73-93f7145981a3 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:16.375346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0fc2-84c2-4829-ab73-93f7145981a3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:16.375598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a0fc2-84c2-4829-ab73-93f7145981a3 None None] PATH_INFO: `/v3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:16.376919 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 771/1517] 10.222.0.78 () {54 vars in 925 bytes} [Wed Aug 31 00:34:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:34:16.383983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b2b6b-ac24-4713-a338-6e3695f2dbd9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:16.384270 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b2b6b-ac24-4713-a338-6e3695f2dbd9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:16.384541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b2b6b-ac24-4713-a338-6e3695f2dbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:16.450971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2a4b2b6b-ac24-4713-a338-6e3695f2dbd9 None None] MFA Rules not processed for user `5f8c004b9fe2402fbe94cfd7c2bf949e`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:34:16.452122 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2a4b2b6b-ac24-4713-a338-6e3695f2dbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:16.470039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:16.526489 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 747/1518] 10.222.0.78 () {58 vars in 1015 bytes} [Wed Aug 31 00:34:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:34:25.541907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d19bf8-a54d-4931-8dbc-6afa01aeb5b6 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:25.542447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d19bf8-a54d-4931-8dbc-6afa01aeb5b6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:25.542447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d19bf8-a54d-4931-8dbc-6afa01aeb5b6 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:25.543704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 772/1519] 10.222.0.74 () {54 vars in 961 bytes} [Wed Aug 31 00:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:34:25.548931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c944cb-49dc-4583-9e51-4bb8a79b37ba None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:25.549336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c944cb-49dc-4583-9e51-4bb8a79b37ba None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:25.549505 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c944cb-49dc-4583-9e51-4bb8a79b37ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:25.569955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-82c944cb-49dc-4583-9e51-4bb8a79b37ba None None] MFA Rules not processed for user `5f8c004b9fe2402fbe94cfd7c2bf949e`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:34:25.571173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-82c944cb-49dc-4583-9e51-4bb8a79b37ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:25.580349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 748/1520] 10.222.0.74 () {58 vars in 1058 bytes} [Wed Aug 31 00:34:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:34:25.588031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d19bf8-a54d-4931-8dbc-6afa01aeb5b6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:34:25.602579 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d19bf8-a54d-4931-8dbc-6afa01aeb5b6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:34:25.607969 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd710bff-f9d2-4916-83b0-02887defa240 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:34:25.608571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd710bff-f9d2-4916-83b0-02887defa240 service placement] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:25.608851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd710bff-f9d2-4916-83b0-02887defa240 service placement] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:25.609147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd710bff-f9d2-4916-83b0-02887defa240 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:25.617738 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd710bff-f9d2-4916-83b0-02887defa240 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:34:25.619346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd710bff-f9d2-4916-83b0-02887defa240 service placement] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:34:25.631542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 773/1521] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:34:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:34:27.469052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52617bd6-a11b-4626-84d0-df5a5b33f7c8 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:27.469591 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52617bd6-a11b-4626-84d0-df5a5b33f7c8 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:27.469591 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52617bd6-a11b-4626-84d0-df5a5b33f7c8 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:27.470894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 749/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:34:27.476042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3d914-67c0-453f-8f8e-e27ea8657219 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:27.476464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3d914-67c0-453f-8f8e-e27ea8657219 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:27.476585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3d914-67c0-453f-8f8e-e27ea8657219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:27.502601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-42a3d914-67c0-453f-8f8e-e27ea8657219 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:34:27.503876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-42a3d914-67c0-453f-8f8e-e27ea8657219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:27.512523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 774/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:34:27.680373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52617bd6-a11b-4626-84d0-df5a5b33f7c8 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:34:27.695941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52617bd6-a11b-4626-84d0-df5a5b33f7c8 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:34:27.707351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb274dc-f7e6-46f6-b48d-5c8b39be4780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:34:27.707351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb274dc-f7e6-46f6-b48d-5c8b39be4780 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:27.707351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb274dc-f7e6-46f6-b48d-5c8b39be4780 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:27.707351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb274dc-f7e6-46f6-b48d-5c8b39be4780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:27.710833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb274dc-f7e6-46f6-b48d-5c8b39be4780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:34:27.712463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb274dc-f7e6-46f6-b48d-5c8b39be4780 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:34:27.724719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 750/1524] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:34:28.555144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f40b-4853-4375-81a4-d73faa6d6020 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:28.555724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f40b-4853-4375-81a4-d73faa6d6020 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:28.555724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22f40b-4853-4375-81a4-d73faa6d6020 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:28.557030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 00:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:34:28.562882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a08ed-0430-4f3e-8362-8d4d7a889249 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:28.563328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a08ed-0430-4f3e-8362-8d4d7a889249 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:28.563444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a08ed-0430-4f3e-8362-8d4d7a889249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:28.583021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-269a08ed-0430-4f3e-8362-8d4d7a889249 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:34:28.584220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-269a08ed-0430-4f3e-8362-8d4d7a889249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:28.592586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 00:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:34:28.744225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22f40b-4853-4375-81a4-d73faa6d6020 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:34:28.759405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22f40b-4853-4375-81a4-d73faa6d6020 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:34:28.765292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692ecac-2de4-473f-9707-8874688b0dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:34:28.765940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692ecac-2de4-473f-9707-8874688b0dd3 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:28.766246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692ecac-2de4-473f-9707-8874688b0dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:28.766505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692ecac-2de4-473f-9707-8874688b0dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:28.774954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692ecac-2de4-473f-9707-8874688b0dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:34:28.776555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692ecac-2de4-473f-9707-8874688b0dd3 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:34:28.787526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 776/1527] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:34:32.853455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7007a-15c9-4ebd-b238-d914bcdc3972 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:32.854051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7007a-15c9-4ebd-b238-d914bcdc3972 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:32.854051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7007a-15c9-4ebd-b238-d914bcdc3972 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:32.855428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:34:32.861168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa480d3-b16f-4d50-b282-791cbe150a88 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:32.861690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa480d3-b16f-4d50-b282-791cbe150a88 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:32.861810 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa480d3-b16f-4d50-b282-791cbe150a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:32.884352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-3aa480d3-b16f-4d50-b282-791cbe150a88 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:34:32.885540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-3aa480d3-b16f-4d50-b282-791cbe150a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:32.894646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:34:33.199074 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7007a-15c9-4ebd-b238-d914bcdc3972 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:34:33.201443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5ab7007a-15c9-4ebd-b238-d914bcdc3972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:33.286177 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7007a-15c9-4ebd-b238-d914bcdc3972 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:34:33.290090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2f97c-ea86-4e51-8000-49b150831657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:34:33.290719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2f97c-ea86-4e51-8000-49b150831657 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:33.290999 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2f97c-ea86-4e51-8000-49b150831657 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:33.291272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2f97c-ea86-4e51-8000-49b150831657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:33.301004 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2f97c-ea86-4e51-8000-49b150831657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:34:33.302488 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2f97c-ea86-4e51-8000-49b150831657 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:34:33.312581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 753/1530] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:34:35.256779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ce87-55b2-4fd5-8785-b944f9cc1042 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:35.257394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ce87-55b2-4fd5-8785-b944f9cc1042 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:35.257394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ce87-55b2-4fd5-8785-b944f9cc1042 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:35.258806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:34:35.264427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161be9cc-ff47-424d-871f-b54f2434a9dc None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:35.264991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161be9cc-ff47-424d-871f-b54f2434a9dc None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:35.264991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161be9cc-ff47-424d-871f-b54f2434a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:35.285211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-161be9cc-ff47-424d-871f-b54f2434a9dc None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:34:35.286456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-161be9cc-ff47-424d-871f-b54f2434a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:35.296017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:34:35.589843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ce87-55b2-4fd5-8785-b944f9cc1042 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:34:35.601046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ce87-55b2-4fd5-8785-b944f9cc1042 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:34:35.604580 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b502dee-a3fd-4c32-81ba-27a3cdc7e901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:34:35.605191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502dee-a3fd-4c32-81ba-27a3cdc7e901 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:35.605470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502dee-a3fd-4c32-81ba-27a3cdc7e901 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:35.605771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502dee-a3fd-4c32-81ba-27a3cdc7e901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:35.616386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b502dee-a3fd-4c32-81ba-27a3cdc7e901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:34:35.617884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b502dee-a3fd-4c32-81ba-27a3cdc7e901 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:34:35.628397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 779/1533] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:34:39.341398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb8de6-0547-4c6a-993a-eea2c4b30aaf None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:39.346497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb8de6-0547-4c6a-993a-eea2c4b30aaf None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:39.346497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb8de6-0547-4c6a-993a-eea2c4b30aaf None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:39.346497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:34:39.348789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a127-74c8-4fd7-a3b6-2c0c92c7ba6e None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:39.349208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a127-74c8-4fd7-a3b6-2c0c92c7ba6e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:39.349337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751a127-74c8-4fd7-a3b6-2c0c92c7ba6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:39.369933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-6751a127-74c8-4fd7-a3b6-2c0c92c7ba6e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:34:39.371076 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6751a127-74c8-4fd7-a3b6-2c0c92c7ba6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:39.379564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:34:39.957519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb8de6-0547-4c6a-993a-eea2c4b30aaf None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:34:39.959267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d9fb8de6-0547-4c6a-993a-eea2c4b30aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:40.024462 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:40.038202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb8de6-0547-4c6a-993a-eea2c4b30aaf None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:34:40.043114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae44e9-de21-418d-bf18-50dfb6b1761f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:34:40.043114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae44e9-de21-418d-bf18-50dfb6b1761f service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:40.043114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae44e9-de21-418d-bf18-50dfb6b1761f service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:40.043114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae44e9-de21-418d-bf18-50dfb6b1761f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:40.052776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae44e9-de21-418d-bf18-50dfb6b1761f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:34:40.054260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae44e9-de21-418d-bf18-50dfb6b1761f service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:34:40.065197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 756/1536] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:34:42.141218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8037242-c158-4430-9694-2f62cfa66d6b None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:42.141868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8037242-c158-4430-9694-2f62cfa66d6b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:42.141868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8037242-c158-4430-9694-2f62cfa66d6b None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:42.143062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 00:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:34:42.148409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337354-2c6e-4b53-a786-64c88adf1d19 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:42.148897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337354-2c6e-4b53-a786-64c88adf1d19 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:42.149009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337354-2c6e-4b53-a786-64c88adf1d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:42.169412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-88337354-2c6e-4b53-a786-64c88adf1d19 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:34:42.171960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-88337354-2c6e-4b53-a786-64c88adf1d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:42.180103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 00:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:34:42.746370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8037242-c158-4430-9694-2f62cfa66d6b None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:34:42.748165 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d8037242-c158-4430-9694-2f62cfa66d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:34:42.771010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8037242-c158-4430-9694-2f62cfa66d6b None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:34:42.777295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f6a6c-16af-4e48-960c-309aa6703fa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:34:42.779718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f6a6c-16af-4e48-960c-309aa6703fa3 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:34:42.779718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f6a6c-16af-4e48-960c-309aa6703fa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:34:42.779718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f6a6c-16af-4e48-960c-309aa6703fa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:34:42.791816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f6a6c-16af-4e48-960c-309aa6703fa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:34:42.793306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f6a6c-16af-4e48-960c-309aa6703fa3 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:34:42.808490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 782/1539] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:34:52.164476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=11 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:34:52.800513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:11.683033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f37f3-0e4d-45f2-aaef-9254c6048815 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:11.683694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f37f3-0e4d-45f2-aaef-9254c6048815 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:11.683694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f37f3-0e4d-45f2-aaef-9254c6048815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:11.715267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2d5f37f3-0e4d-45f2-aaef-9254c6048815 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:11.716579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2d5f37f3-0e4d-45f2-aaef-9254c6048815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:11.731487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 758/1540] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:11.740902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241f1b7-37cb-4036-a550-253ef4faa170 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:11.741863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241f1b7-37cb-4036-a550-253ef4faa170 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:11.741863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241f1b7-37cb-4036-a550-253ef4faa170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:11.775820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-4241f1b7-37cb-4036-a550-253ef4faa170 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:11.777048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4241f1b7-37cb-4036-a550-253ef4faa170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:11.792833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 783/1541] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:11.798413 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f37f3-0e4d-45f2-aaef-9254c6048815 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:11.812063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544fe29-1cca-4d54-bd8e-c94d5e7168c2 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:11.813125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544fe29-1cca-4d54-bd8e-c94d5e7168c2 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:11.813396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544fe29-1cca-4d54-bd8e-c94d5e7168c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:11.818078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f37f3-0e4d-45f2-aaef-9254c6048815 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:11.832825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2a5f2-1c38-4132-95ae-967872beb2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:11.833792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2a5f2-1c38-4132-95ae-967872beb2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:11.834223 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2a5f2-1c38-4132-95ae-967872beb2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:11.834636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2a5f2-1c38-4132-95ae-967872beb2c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:11.835673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2a5f2-1c38-4132-95ae-967872beb2c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:11.836132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2a5f2-1c38-4132-95ae-967872beb2c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:11.838164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2a5f2-1c38-4132-95ae-967872beb2c4 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:11.856855 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-a544fe29-1cca-4d54-bd8e-c94d5e7168c2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:11.858180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a544fe29-1cca-4d54-bd8e-c94d5e7168c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:11.865528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 759/1542] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:11.873842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 784/1543] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:36:11.881967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2a5f2-1c38-4132-95ae-967872beb2c4 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:11.894078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df491a81-9911-4097-9103-8eee99a7b95d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:11.894078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df491a81-9911-4097-9103-8eee99a7b95d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:11.894078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df491a81-9911-4097-9103-8eee99a7b95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:11.895963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2a5f2-1c38-4132-95ae-967872beb2c4 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:11.912504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e2615-014a-4568-b7e5-3e421148f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:11.913132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e2615-014a-4568-b7e5-3e421148f9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:11.913416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e2615-014a-4568-b7e5-3e421148f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:11.913736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e2615-014a-4568-b7e5-3e421148f9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:11.914384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e2615-014a-4568-b7e5-3e421148f9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:11.915405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: WARNING py.warnings [None req-fe8e2615-014a-4568-b7e5-3e421148f9d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:36:11.915405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: warnings.warn(msg) Aug 31 00:36:11.915405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: Aug 31 00:36:11.916603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e2615-014a-4568-b7e5-3e421148f9d0 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:11.938270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-df491a81-9911-4097-9103-8eee99a7b95d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:11.939526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-df491a81-9911-4097-9103-8eee99a7b95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:11.952286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 785/1544] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:36:11.953949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168932b-367e-4252-8143-6a78d79c4b86 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:11.954249 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168932b-367e-4252-8143-6a78d79c4b86 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:11.954530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168932b-367e-4252-8143-6a78d79c4b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:11.986065 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-d168932b-367e-4252-8143-6a78d79c4b86 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:11.987332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d168932b-367e-4252-8143-6a78d79c4b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:11.996115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 786/1545] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:11.996958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168932b-367e-4252-8143-6a78d79c4b86 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.010635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168932b-367e-4252-8143-6a78d79c4b86 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.016322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b2213-32f3-4e25-a5fd-47f5e9007a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.016956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2213-32f3-4e25-a5fd-47f5e9007a41 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.017239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2213-32f3-4e25-a5fd-47f5e9007a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.017516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b2213-32f3-4e25-a5fd-47f5e9007a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.018216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b2213-32f3-4e25-a5fd-47f5e9007a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:12.018520 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b2213-32f3-4e25-a5fd-47f5e9007a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.019565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: WARNING py.warnings [None req-936b2213-32f3-4e25-a5fd-47f5e9007a41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:36:12.019565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: warnings.warn(msg) Aug 31 00:36:12.019565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: Aug 31 00:36:12.020538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b2213-32f3-4e25-a5fd-47f5e9007a41 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.040088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 787/1546] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:12.041319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ba76f-0128-4978-8730-c18b273c3125 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.041631 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ba76f-0128-4978-8730-c18b273c3125 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.041915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ba76f-0128-4978-8730-c18b273c3125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.071220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 760/1547] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:11 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:12.072607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e36cb-1dbb-4179-82c2-932a1d4b7b82 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.072900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e36cb-1dbb-4179-82c2-932a1d4b7b82 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.073173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e36cb-1dbb-4179-82c2-932a1d4b7b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.073360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0c5ba76f-0128-4978-8730-c18b273c3125 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:12.074741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0c5ba76f-0128-4978-8730-c18b273c3125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:12.109473 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-c72e36cb-1dbb-4179-82c2-932a1d4b7b82 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:12.110795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c72e36cb-1dbb-4179-82c2-932a1d4b7b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:12.160001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 788/1548] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:12.160996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ba76f-0128-4978-8730-c18b273c3125 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.170894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ba76f-0128-4978-8730-c18b273c3125 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.176785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4640f9-0879-4fb3-90c1-273727a00f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.178535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4640f9-0879-4fb3-90c1-273727a00f90 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.178824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4640f9-0879-4fb3-90c1-273727a00f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.179099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4640f9-0879-4fb3-90c1-273727a00f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.179762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4640f9-0879-4fb3-90c1-273727a00f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.181751 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4640f9-0879-4fb3-90c1-273727a00f90 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.185810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 761/1549] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:12.186903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac01b31-a85c-4c6f-a614-f08b79aaf765 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.187778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac01b31-a85c-4c6f-a614-f08b79aaf765 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.188184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac01b31-a85c-4c6f-a614-f08b79aaf765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.212125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2ac01b31-a85c-4c6f-a614-f08b79aaf765 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:12.213782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2ac01b31-a85c-4c6f-a614-f08b79aaf765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:12.223939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 762/1550] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:12.225338 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac01b31-a85c-4c6f-a614-f08b79aaf765 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.237984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac01b31-a85c-4c6f-a614-f08b79aaf765 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.242672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f2587-a8de-4835-b3d0-be34ffbd9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.250275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f2587-a8de-4835-b3d0-be34ffbd9e8c admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.250275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f2587-a8de-4835-b3d0-be34ffbd9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.250275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f2587-a8de-4835-b3d0-be34ffbd9e8c admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.250275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f2587-a8de-4835-b3d0-be34ffbd9e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.250275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f2587-a8de-4835-b3d0-be34ffbd9e8c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.321744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 789/1551] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:12.323205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502addb-2db0-4410-a56e-b3618439c58e None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.323492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502addb-2db0-4410-a56e-b3618439c58e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.323776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502addb-2db0-4410-a56e-b3618439c58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.344820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0502addb-2db0-4410-a56e-b3618439c58e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:12.346077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0502addb-2db0-4410-a56e-b3618439c58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:12.356870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 763/1552] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:12.356870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cdbf3-f24c-42aa-9f1b-9feff350aa10 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.356870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cdbf3-f24c-42aa-9f1b-9feff350aa10 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.356870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cdbf3-f24c-42aa-9f1b-9feff350aa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.380058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-334cdbf3-f24c-42aa-9f1b-9feff350aa10 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:12.381293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-334cdbf3-f24c-42aa-9f1b-9feff350aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:12.419404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 790/1553] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:12.420673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac793aff-8628-41a7-b53a-57476e680308 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.420966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac793aff-8628-41a7-b53a-57476e680308 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.421389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac793aff-8628-41a7-b53a-57476e680308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.442740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-ac793aff-8628-41a7-b53a-57476e680308 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:12.450702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ac793aff-8628-41a7-b53a-57476e680308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:12.450827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 764/1554] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:12.450827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cdbf3-f24c-42aa-9f1b-9feff350aa10 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.462745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 791/1555] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:12.462953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cdbf3-f24c-42aa-9f1b-9feff350aa10 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.463052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7859-962c-4d80-afbe-4ab59c184301 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.463052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7859-962c-4d80-afbe-4ab59c184301 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.463052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b7859-962c-4d80-afbe-4ab59c184301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.467211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff37de-9182-4a2e-9d14-fa8a56517c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.467832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff37de-9182-4a2e-9d14-fa8a56517c6c admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.468113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff37de-9182-4a2e-9d14-fa8a56517c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.468434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff37de-9182-4a2e-9d14-fa8a56517c6c admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.469435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff37de-9182-4a2e-9d14-fa8a56517c6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:12.469834 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff37de-9182-4a2e-9d14-fa8a56517c6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.471466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff37de-9182-4a2e-9d14-fa8a56517c6c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.481072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-409b7859-962c-4d80-afbe-4ab59c184301 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:12.482317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-409b7859-962c-4d80-afbe-4ab59c184301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:12.491888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 765/1556] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:12.491888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cca2f-57ba-4df2-886c-b04765b38202 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.491888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cca2f-57ba-4df2-886c-b04765b38202 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.491888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cca2f-57ba-4df2-886c-b04765b38202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.492690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 792/1557] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:12.492690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b7859-962c-4d80-afbe-4ab59c184301 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.505279 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b7859-962c-4d80-afbe-4ab59c184301 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.510102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e22ef-1d58-4a68-8926-8f4ce7bfa77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.510715 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e22ef-1d58-4a68-8926-8f4ce7bfa77e admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.510999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e22ef-1d58-4a68-8926-8f4ce7bfa77e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.511115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-195cca2f-57ba-4df2-886c-b04765b38202 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:12.511275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e22ef-1d58-4a68-8926-8f4ce7bfa77e admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.511915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e22ef-1d58-4a68-8926-8f4ce7bfa77e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.513457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-195cca2f-57ba-4df2-886c-b04765b38202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:12.513599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: WARNING py.warnings [None req-3a0e22ef-1d58-4a68-8926-8f4ce7bfa77e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:36:12.513599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: warnings.warn(msg) Aug 31 00:36:12.513599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: Aug 31 00:36:12.514406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e22ef-1d58-4a68-8926-8f4ce7bfa77e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.522150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 766/1558] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:12.522150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cca2f-57ba-4df2-886c-b04765b38202 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.532986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cca2f-57ba-4df2-886c-b04765b38202 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.542481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088233b-249f-46e4-9417-6945bce90dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.542481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088233b-249f-46e4-9417-6945bce90dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.542481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088233b-249f-46e4-9417-6945bce90dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.542481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088233b-249f-46e4-9417-6945bce90dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.542888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088233b-249f-46e4-9417-6945bce90dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.542888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088233b-249f-46e4-9417-6945bce90dd3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.543867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:12.554499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 767/1559] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:12.555721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b6448-5c16-40e0-afc9-e235f97919aa None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.556012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b6448-5c16-40e0-afc9-e235f97919aa None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.556287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b6448-5c16-40e0-afc9-e235f97919aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.577268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-235b6448-5c16-40e0-afc9-e235f97919aa None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:12.582153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-235b6448-5c16-40e0-afc9-e235f97919aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:12.586764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 768/1560] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:12.590603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33208a-c515-421e-88a9-7031e2d96009 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.590603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33208a-c515-421e-88a9-7031e2d96009 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.590603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33208a-c515-421e-88a9-7031e2d96009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.608195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2c33208a-c515-421e-88a9-7031e2d96009 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:12.617218 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2c33208a-c515-421e-88a9-7031e2d96009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:12.619741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 769/1561] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:12.620545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33208a-c515-421e-88a9-7031e2d96009 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.630893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33208a-c515-421e-88a9-7031e2d96009 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.635501 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879e27e-ce17-43c7-8b75-68bb0d738f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.636240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879e27e-ce17-43c7-8b75-68bb0d738f6d admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.636394 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879e27e-ce17-43c7-8b75-68bb0d738f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.636672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879e27e-ce17-43c7-8b75-68bb0d738f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.637323 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879e27e-ce17-43c7-8b75-68bb0d738f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:12.637721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879e27e-ce17-43c7-8b75-68bb0d738f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.639343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879e27e-ce17-43c7-8b75-68bb0d738f6d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.642114 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 793/1562] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:12.646024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e22ef-1d58-4a68-8926-8f4ce7bfa77e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.653699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e22ef-1d58-4a68-8926-8f4ce7bfa77e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.654096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 770/1563] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:12.655361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ed37-7a05-4da2-84f6-8d6e5ba215fd None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.655656 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ed37-7a05-4da2-84f6-8d6e5ba215fd None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.656024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885ed37-7a05-4da2-84f6-8d6e5ba215fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.666612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6417b-bebf-4a8d-918f-f6847f2115cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.667229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6417b-bebf-4a8d-918f-f6847f2115cc admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.667505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6417b-bebf-4a8d-918f-f6847f2115cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.667776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6417b-bebf-4a8d-918f-f6847f2115cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.668456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6417b-bebf-4a8d-918f-f6847f2115cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.670510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6417b-bebf-4a8d-918f-f6847f2115cc admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.676621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2885ed37-7a05-4da2-84f6-8d6e5ba215fd None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:12.677373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:12.677880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2885ed37-7a05-4da2-84f6-8d6e5ba215fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:12.685934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 771/1564] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:12.686863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885ed37-7a05-4da2-84f6-8d6e5ba215fd None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.697724 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885ed37-7a05-4da2-84f6-8d6e5ba215fd None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.702930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c66d-509f-4ee3-9476-1a84e41c8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.703639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c66d-509f-4ee3-9476-1a84e41c8b13 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.703920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c66d-509f-4ee3-9476-1a84e41c8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.704194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575c66d-509f-4ee3-9476-1a84e41c8b13 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.704843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575c66d-509f-4ee3-9476-1a84e41c8b13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:12.705150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575c66d-509f-4ee3-9476-1a84e41c8b13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.706853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575c66d-509f-4ee3-9476-1a84e41c8b13 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.721125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 772/1565] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:12.721919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c66d-509f-4ee3-9476-1a84e41c8b13 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.731699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575c66d-509f-4ee3-9476-1a84e41c8b13 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.737009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324b2dc-1394-463b-b57f-eb4a39a33201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.737684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324b2dc-1394-463b-b57f-eb4a39a33201 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.737969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324b2dc-1394-463b-b57f-eb4a39a33201 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.738244 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324b2dc-1394-463b-b57f-eb4a39a33201 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.738884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324b2dc-1394-463b-b57f-eb4a39a33201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.740484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324b2dc-1394-463b-b57f-eb4a39a33201 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.752111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 773/1566] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:12.753192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324b2dc-1394-463b-b57f-eb4a39a33201 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.763532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324b2dc-1394-463b-b57f-eb4a39a33201 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.768398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f89b08-04f0-4db8-8c12-88f546afb0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.768989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f89b08-04f0-4db8-8c12-88f546afb0fd admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.769271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f89b08-04f0-4db8-8c12-88f546afb0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.769545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f89b08-04f0-4db8-8c12-88f546afb0fd admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.770219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f89b08-04f0-4db8-8c12-88f546afb0fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:12.770520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f89b08-04f0-4db8-8c12-88f546afb0fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.772104 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f89b08-04f0-4db8-8c12-88f546afb0fd admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.784252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 774/1567] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:12.785064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f89b08-04f0-4db8-8c12-88f546afb0fd admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.795071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f89b08-04f0-4db8-8c12-88f546afb0fd admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.799465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 794/1568] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:12.801046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6417b-bebf-4a8d-918f-f6847f2115cc admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.801539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e4ccc-7ac7-4dfa-81cc-86e943c5e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.802284 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e4ccc-7ac7-4dfa-81cc-86e943c5e907 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.802579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e4ccc-7ac7-4dfa-81cc-86e943c5e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.802877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e4ccc-7ac7-4dfa-81cc-86e943c5e907 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.803619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e4ccc-7ac7-4dfa-81cc-86e943c5e907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:12.803928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e4ccc-7ac7-4dfa-81cc-86e943c5e907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.806362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e4ccc-7ac7-4dfa-81cc-86e943c5e907 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.820312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 775/1569] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:12.821203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e4ccc-7ac7-4dfa-81cc-86e943c5e907 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.835921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e4ccc-7ac7-4dfa-81cc-86e943c5e907 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.876301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6417b-bebf-4a8d-918f-f6847f2115cc admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.881652 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65362a48-9fb5-4877-95a1-f11f70840d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.882284 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65362a48-9fb5-4877-95a1-f11f70840d2b admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.882562 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65362a48-9fb5-4877-95a1-f11f70840d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.882833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65362a48-9fb5-4877-95a1-f11f70840d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.883490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65362a48-9fb5-4877-95a1-f11f70840d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.885907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65362a48-9fb5-4877-95a1-f11f70840d2b admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.896449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 795/1570] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:12.897297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65362a48-9fb5-4877-95a1-f11f70840d2b admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.906608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ece30f-cac8-4606-b6d7-0f5569bc83de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.907819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ece30f-cac8-4606-b6d7-0f5569bc83de admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.907819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ece30f-cac8-4606-b6d7-0f5569bc83de admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.907819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ece30f-cac8-4606-b6d7-0f5569bc83de admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.908550 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65362a48-9fb5-4877-95a1-f11f70840d2b admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.908815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ece30f-cac8-4606-b6d7-0f5569bc83de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.910699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ece30f-cac8-4606-b6d7-0f5569bc83de admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.915220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f618d-4fec-4bd4-8802-76292ed98a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.915220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f618d-4fec-4bd4-8802-76292ed98a9e admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.915220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f618d-4fec-4bd4-8802-76292ed98a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.915220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f618d-4fec-4bd4-8802-76292ed98a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.915636 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f618d-4fec-4bd4-8802-76292ed98a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:12.915755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f618d-4fec-4bd4-8802-76292ed98a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.917269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f618d-4fec-4bd4-8802-76292ed98a9e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:12.930474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 796/1571] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:12.934525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f618d-4fec-4bd4-8802-76292ed98a9e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:12.945473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f618d-4fec-4bd4-8802-76292ed98a9e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:12.950219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f98de5-bf1c-435c-a2d7-f648dc114cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:12.950828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f98de5-bf1c-435c-a2d7-f648dc114cdf admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:12.951116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f98de5-bf1c-435c-a2d7-f648dc114cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:12.951394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f98de5-bf1c-435c-a2d7-f648dc114cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:12.952058 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f98de5-bf1c-435c-a2d7-f648dc114cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:12.954354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f98de5-bf1c-435c-a2d7-f648dc114cdf admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.011775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 776/1572] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:13.012599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ece30f-cac8-4606-b6d7-0f5569bc83de admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.073814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:13.078076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ece30f-cac8-4606-b6d7-0f5569bc83de admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.080103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 797/1573] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:12 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:13.080103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f98de5-bf1c-435c-a2d7-f648dc114cdf admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.142538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15a8fd-883a-4c76-94ea-258920519f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.143166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15a8fd-883a-4c76-94ea-258920519f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.143448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15a8fd-883a-4c76-94ea-258920519f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.143730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15a8fd-883a-4c76-94ea-258920519f02 admin admin] PATH_INFO: `/v3/projects/49bf5dab81874fc5a8600942737db564/users/bde6c57c079d4b26ae4d9462df629bab/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.146391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f98de5-bf1c-435c-a2d7-f648dc114cdf admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.151027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aab7e-cfd9-47fd-96bb-50045d9bf200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.151665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aab7e-cfd9-47fd-96bb-50045d9bf200 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.151912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aab7e-cfd9-47fd-96bb-50045d9bf200 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.152180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aab7e-cfd9-47fd-96bb-50045d9bf200 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.152820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7aab7e-cfd9-47fd-96bb-50045d9bf200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.154766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7aab7e-cfd9-47fd-96bb-50045d9bf200 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.160743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15a8fd-883a-4c76-94ea-258920519f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bf5dab81874fc5a8600942737db564, user_id=bde6c57c079d4b26ae4d9462df629bab, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.161813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: WARNING py.warnings [None req-ac15a8fd-883a-4c76-94ea-258920519f02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:36:13.161813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: warnings.warn(msg) Aug 31 00:36:13.161813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: Aug 31 00:36:13.163779 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15a8fd-883a-4c76-94ea-258920519f02 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.267280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 777/1574] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:13 2022] PUT /identity/v3/projects/49bf5dab81874fc5a8600942737db564/users/bde6c57c079d4b26ae4d9462df629bab/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:13.268038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15a8fd-883a-4c76-94ea-258920519f02 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.278580 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 798/1575] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:13 2022] POST /identity/v3/projects => generated 389 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:13.281684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aab7e-cfd9-47fd-96bb-50045d9bf200 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.316866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:13.344980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15a8fd-883a-4c76-94ea-258920519f02 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.348040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aab7e-cfd9-47fd-96bb-50045d9bf200 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.349884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4f695-b0a9-44aa-a825-575c878f4344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.350489 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4f695-b0a9-44aa-a825-575c878f4344 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.350772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4f695-b0a9-44aa-a825-575c878f4344 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.351109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4f695-b0a9-44aa-a825-575c878f4344 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.351749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4f695-b0a9-44aa-a825-575c878f4344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.353750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4f695-b0a9-44aa-a825-575c878f4344 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.354432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ec30e-3f14-48dd-a13b-ee2d848d05a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.355113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ec30e-3f14-48dd-a13b-ee2d848d05a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.355336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ec30e-3f14-48dd-a13b-ee2d848d05a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.355618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ec30e-3f14-48dd-a13b-ee2d848d05a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.356262 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ec30e-3f14-48dd-a13b-ee2d848d05a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.358224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ec30e-3f14-48dd-a13b-ee2d848d05a2 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.465235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 778/1576] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:13 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:13.466121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4f695-b0a9-44aa-a825-575c878f4344 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.476848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4f695-b0a9-44aa-a825-575c878f4344 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.478780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 799/1577] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:13 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:13.479592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ec30e-3f14-48dd-a13b-ee2d848d05a2 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.543802 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb46b-824f-4bbb-8172-fa1615d6573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.544327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb46b-824f-4bbb-8172-fa1615d6573d admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.544612 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb46b-824f-4bbb-8172-fa1615d6573d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.544885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fb46b-824f-4bbb-8172-fa1615d6573d admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.545525 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fb46b-824f-4bbb-8172-fa1615d6573d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.547446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fb46b-824f-4bbb-8172-fa1615d6573d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.553635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ec30e-3f14-48dd-a13b-ee2d848d05a2 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.557938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 779/1578] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:13.558702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb46b-824f-4bbb-8172-fa1615d6573d admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.562003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f8762-3c9c-408f-aaf0-c494120588f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.563529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f8762-3c9c-408f-aaf0-c494120588f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.563529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f8762-3c9c-408f-aaf0-c494120588f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.564031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f8762-3c9c-408f-aaf0-c494120588f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.564685 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f8762-3c9c-408f-aaf0-c494120588f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.566816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f8762-3c9c-408f-aaf0-c494120588f6 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.570180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fb46b-824f-4bbb-8172-fa1615d6573d admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.574880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621363b-e46c-4898-96b3-bc2ede616ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.575632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621363b-e46c-4898-96b3-bc2ede616ebe admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.575921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621363b-e46c-4898-96b3-bc2ede616ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.576207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621363b-e46c-4898-96b3-bc2ede616ebe admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.576840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621363b-e46c-4898-96b3-bc2ede616ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.579927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621363b-e46c-4898-96b3-bc2ede616ebe admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.591119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:13.662397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 800/1579] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:13 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:13.663218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f8762-3c9c-408f-aaf0-c494120588f6 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.706207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 780/1580] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:13 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:13.707487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ace1f-7009-4aeb-8a1c-ea176553c5d5 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.707784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ace1f-7009-4aeb-8a1c-ea176553c5d5 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.709072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ace1f-7009-4aeb-8a1c-ea176553c5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.731293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f8762-3c9c-408f-aaf0-c494120588f6 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.736581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ab059-fab4-46c7-95a8-bcc58bbcc63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.737240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ab059-fab4-46c7-95a8-bcc58bbcc63f admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.737363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-083ace1f-7009-4aeb-8a1c-ea176553c5d5 None None] MFA Rules not processed for user `bde6c57c079d4b26ae4d9462df629bab`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:13.737586 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ab059-fab4-46c7-95a8-bcc58bbcc63f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.737889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ab059-fab4-46c7-95a8-bcc58bbcc63f admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.738581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ab059-fab4-46c7-95a8-bcc58bbcc63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.738691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-083ace1f-7009-4aeb-8a1c-ea176553c5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:13.740623 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ab059-fab4-46c7-95a8-bcc58bbcc63f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.809373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 781/1581] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:13.810311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ace1f-7009-4aeb-8a1c-ea176553c5d5 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.822337 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ace1f-7009-4aeb-8a1c-ea176553c5d5 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.826902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40074d-90a6-4c72-bbd4-828174c7c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.827505 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40074d-90a6-4c72-bbd4-828174c7c39e admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.828369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40074d-90a6-4c72-bbd4-828174c7c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.828856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40074d-90a6-4c72-bbd4-828174c7c39e admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.829504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40074d-90a6-4c72-bbd4-828174c7c39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.831452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40074d-90a6-4c72-bbd4-828174c7c39e admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.883628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 801/1582] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:13 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:13.884417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ab059-fab4-46c7-95a8-bcc58bbcc63f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.897593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ab059-fab4-46c7-95a8-bcc58bbcc63f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.902401 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96af6e-ba09-4a11-ab31-830c1a75dcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.903121 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96af6e-ba09-4a11-ab31-830c1a75dcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.903407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96af6e-ba09-4a11-ab31-830c1a75dcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.903682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96af6e-ba09-4a11-ab31-830c1a75dcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.904331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96af6e-ba09-4a11-ab31-830c1a75dcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.906251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96af6e-ba09-4a11-ab31-830c1a75dcc4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.917222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 802/1583] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:13.918052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96af6e-ba09-4a11-ab31-830c1a75dcc4 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.928351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96af6e-ba09-4a11-ab31-830c1a75dcc4 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.933251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f69c0-66b4-4288-9b64-66210e4072ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.933872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f69c0-66b4-4288-9b64-66210e4072ff admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.934154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f69c0-66b4-4288-9b64-66210e4072ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.934429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f69c0-66b4-4288-9b64-66210e4072ff admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.935054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f69c0-66b4-4288-9b64-66210e4072ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.936968 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f69c0-66b4-4288-9b64-66210e4072ff admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:13.962246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 782/1584] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:13 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:13.963112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40074d-90a6-4c72-bbd4-828174c7c39e admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:13.973324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40074d-90a6-4c72-bbd4-828174c7c39e admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:13.978041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1de6c3-a7d4-4ca2-bb5e-5b235c274c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:13.978683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1de6c3-a7d4-4ca2-bb5e-5b235c274c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:13.978964 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1de6c3-a7d4-4ca2-bb5e-5b235c274c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:13.979239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1de6c3-a7d4-4ca2-bb5e-5b235c274c08 admin admin] PATH_INFO: `/v3/projects/6f773bd4965e49d380c77db1742c7d94/users/7b2f116fd01d46ddab8096d0f3214307/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:13.995153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1de6c3-a7d4-4ca2-bb5e-5b235c274c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f773bd4965e49d380c77db1742c7d94, user_id=7b2f116fd01d46ddab8096d0f3214307, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:13.997889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1de6c3-a7d4-4ca2-bb5e-5b235c274c08 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.082824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 803/1585] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:13 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:14.082824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f69c0-66b4-4288-9b64-66210e4072ff admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.086478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:14.090411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f69c0-66b4-4288-9b64-66210e4072ff admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.095488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe19a2-0fe8-4284-b224-93d60b2ee056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.096091 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe19a2-0fe8-4284-b224-93d60b2ee056 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.096366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe19a2-0fe8-4284-b224-93d60b2ee056 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.096639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe19a2-0fe8-4284-b224-93d60b2ee056 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.097265 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe19a2-0fe8-4284-b224-93d60b2ee056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.099319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe19a2-0fe8-4284-b224-93d60b2ee056 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.118071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 783/1586] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:13 2022] PUT /identity/v3/projects/6f773bd4965e49d380c77db1742c7d94/users/7b2f116fd01d46ddab8096d0f3214307/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:14.118941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1de6c3-a7d4-4ca2-bb5e-5b235c274c08 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.182966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1de6c3-a7d4-4ca2-bb5e-5b235c274c08 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.188551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd210b-5ea7-4f4e-873b-a56478d8ae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.189206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd210b-5ea7-4f4e-873b-a56478d8ae90 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.189486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd210b-5ea7-4f4e-873b-a56478d8ae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.189801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd210b-5ea7-4f4e-873b-a56478d8ae90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.190467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd210b-5ea7-4f4e-873b-a56478d8ae90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.192198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd210b-5ea7-4f4e-873b-a56478d8ae90 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.202862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 784/1587] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:14.203729 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd210b-5ea7-4f4e-873b-a56478d8ae90 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.206786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 804/1588] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:14 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:14.206786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe19a2-0fe8-4284-b224-93d60b2ee056 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.219737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe19a2-0fe8-4284-b224-93d60b2ee056 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.224250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce789d-857f-482e-9968-cf767dcd3b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.224862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce789d-857f-482e-9968-cf767dcd3b28 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.225141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce789d-857f-482e-9968-cf767dcd3b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.225416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce789d-857f-482e-9968-cf767dcd3b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.226149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce789d-857f-482e-9968-cf767dcd3b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.227840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce789d-857f-482e-9968-cf767dcd3b28 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.242903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 805/1589] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:14.244146 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce789d-857f-482e-9968-cf767dcd3b28 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.254322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:14.255074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce789d-857f-482e-9968-cf767dcd3b28 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.261107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe0fd7-7c79-435f-a0c6-71fdcbbf095a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.261784 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0fd7-7c79-435f-a0c6-71fdcbbf095a admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.262064 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0fd7-7c79-435f-a0c6-71fdcbbf095a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.266131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe0fd7-7c79-435f-a0c6-71fdcbbf095a admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.266131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe0fd7-7c79-435f-a0c6-71fdcbbf095a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.266131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe0fd7-7c79-435f-a0c6-71fdcbbf095a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.267434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd210b-5ea7-4f4e-873b-a56478d8ae90 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.271601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acedff5-5d02-4624-b6be-34f9b8e233de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.272207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acedff5-5d02-4624-b6be-34f9b8e233de service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.272484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acedff5-5d02-4624-b6be-34f9b8e233de service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.272753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acedff5-5d02-4624-b6be-34f9b8e233de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.275965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 806/1590] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:14.276919 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe0fd7-7c79-435f-a0c6-71fdcbbf095a admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.287393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe0fd7-7c79-435f-a0c6-71fdcbbf095a admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.292194 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e39e6-5b09-40b9-a859-be1659363f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.292790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e39e6-5b09-40b9-a859-be1659363f6a admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.293072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e39e6-5b09-40b9-a859-be1659363f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.293347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e39e6-5b09-40b9-a859-be1659363f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.294117 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e39e6-5b09-40b9-a859-be1659363f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.295712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e39e6-5b09-40b9-a859-be1659363f6a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.306212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 807/1591] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:14.310710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e39e6-5b09-40b9-a859-be1659363f6a admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.318368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e39e6-5b09-40b9-a859-be1659363f6a admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.323365 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393a22b-7912-4ca6-91a1-c24ec430e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.323974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a22b-7912-4ca6-91a1-c24ec430e3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.324258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a22b-7912-4ca6-91a1-c24ec430e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.324533 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a22b-7912-4ca6-91a1-c24ec430e3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.325207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393a22b-7912-4ca6-91a1-c24ec430e3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.326809 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393a22b-7912-4ca6-91a1-c24ec430e3c8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.338856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 808/1592] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:14.340067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9cf7d-c0f6-4705-8b4b-a0cc856b6d47 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.340515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9cf7d-c0f6-4705-8b4b-a0cc856b6d47 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.340854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9cf7d-c0f6-4705-8b4b-a0cc856b6d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.346029 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acedff5-5d02-4624-b6be-34f9b8e233de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.347505 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acedff5-5d02-4624-b6be-34f9b8e233de service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.357674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 785/1593] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:14.358647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acedff5-5d02-4624-b6be-34f9b8e233de service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.361549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-a6e9cf7d-c0f6-4705-8b4b-a0cc856b6d47 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:14.362814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a6e9cf7d-c0f6-4705-8b4b-a0cc856b6d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:14.369851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acedff5-5d02-4624-b6be-34f9b8e233de service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.375261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 809/1594] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:14.375261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9cf7d-c0f6-4705-8b4b-a0cc856b6d47 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.382444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cfabd-ed85-458a-b5ab-84a654aff7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.383107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cfabd-ed85-458a-b5ab-84a654aff7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.383414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cfabd-ed85-458a-b5ab-84a654aff7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.383662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cfabd-ed85-458a-b5ab-84a654aff7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.384312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cfabd-ed85-458a-b5ab-84a654aff7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.388369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9cf7d-c0f6-4705-8b4b-a0cc856b6d47 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.388570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cfabd-ed85-458a-b5ab-84a654aff7a6 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.392868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c30a7-983e-4e34-9de6-e41af19e805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.393663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c30a7-983e-4e34-9de6-e41af19e805e admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.393938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c30a7-983e-4e34-9de6-e41af19e805e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.394212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c30a7-983e-4e34-9de6-e41af19e805e admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.394900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c30a7-983e-4e34-9de6-e41af19e805e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.396529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c30a7-983e-4e34-9de6-e41af19e805e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.398838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 786/1595] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:14.399882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cfabd-ed85-458a-b5ab-84a654aff7a6 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.410864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 810/1596] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:14.410864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c30a7-983e-4e34-9de6-e41af19e805e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.411154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cfabd-ed85-458a-b5ab-84a654aff7a6 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.416646 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6238b9-577e-404a-8195-30bc495196ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.417343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6238b9-577e-404a-8195-30bc495196ba admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.417718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6238b9-577e-404a-8195-30bc495196ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.418064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6238b9-577e-404a-8195-30bc495196ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.418813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6238b9-577e-404a-8195-30bc495196ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.419358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c30a7-983e-4e34-9de6-e41af19e805e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.420418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6238b9-577e-404a-8195-30bc495196ba admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.424293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eac183-2e51-4ae1-839b-afb28b068490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.424946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eac183-2e51-4ae1-839b-afb28b068490 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.425416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eac183-2e51-4ae1-839b-afb28b068490 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.425745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eac183-2e51-4ae1-839b-afb28b068490 admin admin] PATH_INFO: `/v3/projects/5f07d861390c41db9b162316077c9a21/users/5690f10ea754446dbe7a6170c6de8a7f/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.433197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 787/1597] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:14.434531 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6238b9-577e-404a-8195-30bc495196ba admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.445760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eac183-2e51-4ae1-839b-afb28b068490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f07d861390c41db9b162316077c9a21, user_id=5690f10ea754446dbe7a6170c6de8a7f, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.446474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6238b9-577e-404a-8195-30bc495196ba admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.448523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eac183-2e51-4ae1-839b-afb28b068490 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.451998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241f12-b48a-45c1-a4f7-7cf08d30ebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.452371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241f12-b48a-45c1-a4f7-7cf08d30ebc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.453286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241f12-b48a-45c1-a4f7-7cf08d30ebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.453689 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf241f12-b48a-45c1-a4f7-7cf08d30ebc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.454423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf241f12-b48a-45c1-a4f7-7cf08d30ebc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.455908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf241f12-b48a-45c1-a4f7-7cf08d30ebc7 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.472919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 788/1598] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:14.472919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241f12-b48a-45c1-a4f7-7cf08d30ebc7 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.478389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf241f12-b48a-45c1-a4f7-7cf08d30ebc7 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.483787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aa83f-c65b-436b-b215-1692ab61ae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.484613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aa83f-c65b-436b-b215-1692ab61ae81 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.485113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aa83f-c65b-436b-b215-1692ab61ae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.485399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aa83f-c65b-436b-b215-1692ab61ae81 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.486084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0aa83f-c65b-436b-b215-1692ab61ae81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.487691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0aa83f-c65b-436b-b215-1692ab61ae81 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.498652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 789/1599] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:14.505781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aa83f-c65b-436b-b215-1692ab61ae81 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.505781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3f0aa83f-c65b-436b-b215-1692ab61ae81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:14.566668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aa83f-c65b-436b-b215-1692ab61ae81 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.571166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69463a0-7ece-46b0-859f-70f75f7f9b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.571793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69463a0-7ece-46b0-859f-70f75f7f9b67 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.572073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69463a0-7ece-46b0-859f-70f75f7f9b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.572344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69463a0-7ece-46b0-859f-70f75f7f9b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.582553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69463a0-7ece-46b0-859f-70f75f7f9b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.584115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69463a0-7ece-46b0-859f-70f75f7f9b67 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.595312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 790/1600] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:14.596747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69463a0-7ece-46b0-859f-70f75f7f9b67 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.612297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 811/1601] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:14 2022] PUT /identity/v3/projects/5f07d861390c41db9b162316077c9a21/users/5690f10ea754446dbe7a6170c6de8a7f/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:14.615936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eac183-2e51-4ae1-839b-afb28b068490 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.617469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69463a0-7ece-46b0-859f-70f75f7f9b67 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.687077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eac183-2e51-4ae1-839b-afb28b068490 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.690885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:14.694849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae22eee-d1e8-43ae-a735-2535b5dd2970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.695406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae22eee-d1e8-43ae-a735-2535b5dd2970 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.695714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae22eee-d1e8-43ae-a735-2535b5dd2970 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.696022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae22eee-d1e8-43ae-a735-2535b5dd2970 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.696674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae22eee-d1e8-43ae-a735-2535b5dd2970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.698368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae22eee-d1e8-43ae-a735-2535b5dd2970 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.700815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199daf8-002a-4dad-9593-8281346d33c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.701479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199daf8-002a-4dad-9593-8281346d33c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.701792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199daf8-002a-4dad-9593-8281346d33c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.702065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199daf8-002a-4dad-9593-8281346d33c2 admin admin] PATH_INFO: `/v3/projects/e0cdc570388743b1b4fb21236d0eff66/users/2f00824ca967485486300998e3203fa9/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.712940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 812/1602] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:14.712940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae22eee-d1e8-43ae-a735-2535b5dd2970 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.718353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199daf8-002a-4dad-9593-8281346d33c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0cdc570388743b1b4fb21236d0eff66, user_id=2f00824ca967485486300998e3203fa9, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.721307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae22eee-d1e8-43ae-a735-2535b5dd2970 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.721807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199daf8-002a-4dad-9593-8281346d33c2 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.727036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ff987-93b5-4011-bd9b-23dc80e630a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.727036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff987-93b5-4011-bd9b-23dc80e630a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.727267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff987-93b5-4011-bd9b-23dc80e630a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.727453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff987-93b5-4011-bd9b-23dc80e630a5 admin admin] PATH_INFO: `/v3/projects/ab774f704fe2495b8124eee291341628/users/e775b9e1dfde44a0bfe23523399f8f22/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.742464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ff987-93b5-4011-bd9b-23dc80e630a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab774f704fe2495b8124eee291341628, user_id=e775b9e1dfde44a0bfe23523399f8f22, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.745301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ff987-93b5-4011-bd9b-23dc80e630a5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.825658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 791/1603] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:14 2022] PUT /identity/v3/projects/e0cdc570388743b1b4fb21236d0eff66/users/2f00824ca967485486300998e3203fa9/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:14.826497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199daf8-002a-4dad-9593-8281346d33c2 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.902613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199daf8-002a-4dad-9593-8281346d33c2 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.904168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 813/1604] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:14 2022] PUT /identity/v3/projects/ab774f704fe2495b8124eee291341628/users/e775b9e1dfde44a0bfe23523399f8f22/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:14.904168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ff987-93b5-4011-bd9b-23dc80e630a5 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:14.942066 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:14.963456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052071a-4c53-4639-b389-b03e4a8a7e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.964115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052071a-4c53-4639-b389-b03e4a8a7e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.964391 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052071a-4c53-4639-b389-b03e4a8a7e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.964660 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052071a-4c53-4639-b389-b03e4a8a7e95 admin admin] PATH_INFO: `/v3/projects/2fed9993a3e74c428d9fbdc58e81cb65/users/b049ee00b6404a678a010587074aba66/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.970917 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ff987-93b5-4011-bd9b-23dc80e630a5 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:14.976427 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6315de-ae9a-49e4-953f-6a16afdddc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:14.976609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6315de-ae9a-49e4-953f-6a16afdddc6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:14.976867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6315de-ae9a-49e4-953f-6a16afdddc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:14.977143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6315de-ae9a-49e4-953f-6a16afdddc6e admin admin] PATH_INFO: `/v3/projects/c45373e989574482a111802f21eea385/users/8f89b775d9eb473c875ec54c6ccebf46/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:14.989960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052071a-4c53-4639-b389-b03e4a8a7e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fed9993a3e74c428d9fbdc58e81cb65, user_id=b049ee00b6404a678a010587074aba66, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:14.992899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052071a-4c53-4639-b389-b03e4a8a7e95 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:14.998448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6315de-ae9a-49e4-953f-6a16afdddc6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45373e989574482a111802f21eea385, user_id=8f89b775d9eb473c875ec54c6ccebf46, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:15.002403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6315de-ae9a-49e4-953f-6a16afdddc6e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:15.144056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 792/1605] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:14 2022] PUT /identity/v3/projects/2fed9993a3e74c428d9fbdc58e81cb65/users/b049ee00b6404a678a010587074aba66/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:15.144056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14e29d-96b7-48fa-a94b-a57df04f6862 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.144056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14e29d-96b7-48fa-a94b-a57df04f6862 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.144056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14e29d-96b7-48fa-a94b-a57df04f6862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.171046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0a14e29d-96b7-48fa-a94b-a57df04f6862 None None] MFA Rules not processed for user `5690f10ea754446dbe7a6170c6de8a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:15.172458 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0a14e29d-96b7-48fa-a94b-a57df04f6862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:15.224519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 814/1606] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:14 2022] PUT /identity/v3/projects/c45373e989574482a111802f21eea385/users/8f89b775d9eb473c875ec54c6ccebf46/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:15.224519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6315de-ae9a-49e4-953f-6a16afdddc6e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:15.253895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:15.270948 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 793/1607] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:15.272753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61788378-a1a8-46c1-89af-2d82132ce983 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.273107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61788378-a1a8-46c1-89af-2d82132ce983 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.273689 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61788378-a1a8-46c1-89af-2d82132ce983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.323065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-61788378-a1a8-46c1-89af-2d82132ce983 None None] MFA Rules not processed for user `2f00824ca967485486300998e3203fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:15.323217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6315de-ae9a-49e4-953f-6a16afdddc6e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:15.323319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-61788378-a1a8-46c1-89af-2d82132ce983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:15.332531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488643b-c940-40e0-bf7d-d1c668b96963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:15.333217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488643b-c940-40e0-bf7d-d1c668b96963 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.333688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488643b-c940-40e0-bf7d-d1c668b96963 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.333952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488643b-c940-40e0-bf7d-d1c668b96963 admin admin] PATH_INFO: `/v3/projects/1c5beb77685e4581a68367dbb599b385/users/8911babcd58647fdb6c861cc4e42b020/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.353227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488643b-c940-40e0-bf7d-d1c668b96963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5beb77685e4581a68367dbb599b385, user_id=8911babcd58647fdb6c861cc4e42b020, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:15.356269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488643b-c940-40e0-bf7d-d1c668b96963 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:15.397452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 794/1608] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:15.398825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757740c-5686-4a25-a5cf-b60996a2e3dc None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.399115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757740c-5686-4a25-a5cf-b60996a2e3dc None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.399394 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757740c-5686-4a25-a5cf-b60996a2e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.422242 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-5757740c-5686-4a25-a5cf-b60996a2e3dc None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:15.422242 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5757740c-5686-4a25-a5cf-b60996a2e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:15.430544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 795/1609] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:15.432039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7663d66-3955-4405-bb3d-7ee6efcc0fa0 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.432396 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7663d66-3955-4405-bb3d-7ee6efcc0fa0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.432737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7663d66-3955-4405-bb3d-7ee6efcc0fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.454913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 815/1610] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:15 2022] PUT /identity/v3/projects/1c5beb77685e4581a68367dbb599b385/users/8911babcd58647fdb6c861cc4e42b020/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:15.456392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e594d3-73b7-47fe-9487-cc18aa579937 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.456842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e594d3-73b7-47fe-9487-cc18aa579937 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.457188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e594d3-73b7-47fe-9487-cc18aa579937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.457630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a7663d66-3955-4405-bb3d-7ee6efcc0fa0 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:15.458938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a7663d66-3955-4405-bb3d-7ee6efcc0fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:15.488665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-c4e594d3-73b7-47fe-9487-cc18aa579937 None None] MFA Rules not processed for user `8f89b775d9eb473c875ec54c6ccebf46`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:15.493975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c4e594d3-73b7-47fe-9487-cc18aa579937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:15.527295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 796/1611] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:15.531693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dd613-1179-4fc3-afa8-10515449ebfa None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.532013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dd613-1179-4fc3-afa8-10515449ebfa None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.534094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14dd613-1179-4fc3-afa8-10515449ebfa None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.536651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 797/1612] 10.222.0.74 () {54 vars in 962 bytes} [Wed Aug 31 00:36:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:36:15.538031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dd613-1179-4fc3-afa8-10515449ebfa None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:15.568609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 816/1613] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:15.569366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e594d3-73b7-47fe-9487-cc18aa579937 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:15.580121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14dd613-1179-4fc3-afa8-10515449ebfa None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:15.586504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55396-b919-4d88-932a-0569a7374d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:15.587258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55396-b919-4d88-932a-0569a7374d84 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.587647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55396-b919-4d88-932a-0569a7374d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.588028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55396-b919-4d88-932a-0569a7374d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.588956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55396-b919-4d88-932a-0569a7374d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:15.591613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55396-b919-4d88-932a-0569a7374d84 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:15.616378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:15.647060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e594d3-73b7-47fe-9487-cc18aa579937 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:15.651678 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b4153-3c62-4393-a3af-6d842c8bd293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:15.652217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b4153-3c62-4393-a3af-6d842c8bd293 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.652503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b4153-3c62-4393-a3af-6d842c8bd293 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.652773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b4153-3c62-4393-a3af-6d842c8bd293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.665826 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b4153-3c62-4393-a3af-6d842c8bd293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:15.670119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b4153-3c62-4393-a3af-6d842c8bd293 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:15.695092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 817/1614] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:15.696417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c0d0c-2e55-47d7-a16b-8d12c66d65de None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.696840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c0d0c-2e55-47d7-a16b-8d12c66d65de None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.697600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c0d0c-2e55-47d7-a16b-8d12c66d65de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.720535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 798/1615] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:15 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:15.720535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55396-b919-4d88-932a-0569a7374d84 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:15.734030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b58c0d0c-2e55-47d7-a16b-8d12c66d65de None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:15.735744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b58c0d0c-2e55-47d7-a16b-8d12c66d65de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:15.805249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55396-b919-4d88-932a-0569a7374d84 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:15.807521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 818/1616] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:15.809326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6583d07-41de-4c54-9801-faa380dda73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:15.810066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6583d07-41de-4c54-9801-faa380dda73b service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.810347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6583d07-41de-4c54-9801-faa380dda73b service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.815256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4fb0c-2d87-43b5-9cca-4e1857bff4ac None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.815577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4fb0c-2d87-43b5-9cca-4e1857bff4ac None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.816037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4fb0c-2d87-43b5-9cca-4e1857bff4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.817777 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6583d07-41de-4c54-9801-faa380dda73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.830770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6583d07-41de-4c54-9801-faa380dda73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:15.833945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6583d07-41de-4c54-9801-faa380dda73b service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:15.840221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:15.846357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 799/1617] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:15.847319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6583d07-41de-4c54-9801-faa380dda73b service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:15.858521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6583d07-41de-4c54-9801-faa380dda73b service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:15.865260 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-76e4fb0c-2d87-43b5-9cca-4e1857bff4ac None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:15.867132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-76e4fb0c-2d87-43b5-9cca-4e1857bff4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:15.867327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5aea8-4f5b-42bd-bd8d-e35037811a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:15.867942 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5aea8-4f5b-42bd-bd8d-e35037811a64 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.868304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5aea8-4f5b-42bd-bd8d-e35037811a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.868725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5aea8-4f5b-42bd-bd8d-e35037811a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.869726 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5aea8-4f5b-42bd-bd8d-e35037811a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:15.872345 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5aea8-4f5b-42bd-bd8d-e35037811a64 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:15.951486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 819/1618] 10.222.0.74 () {58 vars in 1059 bytes} [Wed Aug 31 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:15.954436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4fb0c-2d87-43b5-9cca-4e1857bff4ac None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:15.964961 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4fb0c-2d87-43b5-9cca-4e1857bff4ac None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:15.970813 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efa10b-deab-435c-b9a2-48f32910a1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:15.971553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efa10b-deab-435c-b9a2-48f32910a1dd admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:15.971836 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efa10b-deab-435c-b9a2-48f32910a1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:15.972394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efa10b-deab-435c-b9a2-48f32910a1dd admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:15.973181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efa10b-deab-435c-b9a2-48f32910a1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:15.975990 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efa10b-deab-435c-b9a2-48f32910a1dd admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:15.991012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 800/1619] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:15 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:15.991932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5aea8-4f5b-42bd-bd8d-e35037811a64 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:16.054788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5aea8-4f5b-42bd-bd8d-e35037811a64 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:16.058477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e20de5-053a-4293-b5ab-83e18672654e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:16.059084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e20de5-053a-4293-b5ab-83e18672654e service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.059369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e20de5-053a-4293-b5ab-83e18672654e service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.059647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e20de5-053a-4293-b5ab-83e18672654e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.105159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 820/1620] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:15 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:16.106831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efa10b-deab-435c-b9a2-48f32910a1dd admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:16.123895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efa10b-deab-435c-b9a2-48f32910a1dd admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:16.136489 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e20de5-053a-4293-b5ab-83e18672654e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:16.139533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e20de5-053a-4293-b5ab-83e18672654e service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:16.150471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 801/1621] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:16.151427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e20de5-053a-4293-b5ab-83e18672654e service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:16.162040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e20de5-053a-4293-b5ab-83e18672654e service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:16.167312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfdb4a-2665-4158-ba79-7f6034364b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:16.168052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfdb4a-2665-4158-ba79-7f6034364b12 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.168391 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfdb4a-2665-4158-ba79-7f6034364b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.169430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfdb4a-2665-4158-ba79-7f6034364b12 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.169430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfdb4a-2665-4158-ba79-7f6034364b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:16.172200 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfdb4a-2665-4158-ba79-7f6034364b12 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:16.203242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd079d2-21d7-43fa-86a7-4b541aecc8c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:16.204200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd079d2-21d7-43fa-86a7-4b541aecc8c5 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.204512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd079d2-21d7-43fa-86a7-4b541aecc8c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.204935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd079d2-21d7-43fa-86a7-4b541aecc8c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.300743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd079d2-21d7-43fa-86a7-4b541aecc8c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:16.304113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd079d2-21d7-43fa-86a7-4b541aecc8c5 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:16.319789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 821/1622] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:16.329478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 802/1623] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:16 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:16.332890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfdb4a-2665-4158-ba79-7f6034364b12 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:16.334609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd079d2-21d7-43fa-86a7-4b541aecc8c5 service nova] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:16.351764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfdb4a-2665-4158-ba79-7f6034364b12 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:16.366222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd079d2-21d7-43fa-86a7-4b541aecc8c5 service nova] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:16.367860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03bdb-9cf6-47fd-8146-7164ac380387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:16.370112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03bdb-9cf6-47fd-8146-7164ac380387 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.370473 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03bdb-9cf6-47fd-8146-7164ac380387 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.370754 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef03bdb-9cf6-47fd-8146-7164ac380387 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.371629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef03bdb-9cf6-47fd-8146-7164ac380387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:16.389377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef03bdb-9cf6-47fd-8146-7164ac380387 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:16.389798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d7fc3-9d5d-463b-9d90-6bd955730c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:16.395893 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d7fc3-9d5d-463b-9d90-6bd955730c6d admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.396157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d7fc3-9d5d-463b-9d90-6bd955730c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.396424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d7fc3-9d5d-463b-9d90-6bd955730c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.398259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d7fc3-9d5d-463b-9d90-6bd955730c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:16.402320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d7fc3-9d5d-463b-9d90-6bd955730c6d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:16.417642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 803/1624] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:16.422549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03bdb-9cf6-47fd-8146-7164ac380387 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:16.431099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 822/1625] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:16.432858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d7fc3-9d5d-463b-9d90-6bd955730c6d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:16.447601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef03bdb-9cf6-47fd-8146-7164ac380387 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:16.450278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d7fc3-9d5d-463b-9d90-6bd955730c6d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:16.455758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0420-0023-4d7f-a030-e538c258e470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:16.457490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0420-0023-4d7f-a030-e538c258e470 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.457490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0420-0023-4d7f-a030-e538c258e470 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.457490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf0420-0023-4d7f-a030-e538c258e470 admin admin] PATH_INFO: `/v3/projects/a58a9b356a3d410c874c873629d0990d/users/566fcf4cd9de44ba94c87f7a8fba231d/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.458235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bbc18-7c90-4b5d-bc23-ad24101c4e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:16.459180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bbc18-7c90-4b5d-bc23-ad24101c4e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.459668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bbc18-7c90-4b5d-bc23-ad24101c4e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.460120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bbc18-7c90-4b5d-bc23-ad24101c4e9a admin admin] PATH_INFO: `/v3/projects/86f319dc39ba4446b57076a35adfe805/users/9167b391e82342bbbbaeebf282c379c1/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.481234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bbc18-7c90-4b5d-bc23-ad24101c4e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f319dc39ba4446b57076a35adfe805, user_id=9167b391e82342bbbbaeebf282c379c1, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:16.486397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bbc18-7c90-4b5d-bc23-ad24101c4e9a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:16.507073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:16.509885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf0420-0023-4d7f-a030-e538c258e470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58a9b356a3d410c874c873629d0990d, user_id=566fcf4cd9de44ba94c87f7a8fba231d, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:16.519702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf0420-0023-4d7f-a030-e538c258e470 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:16.617624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 823/1626] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:16 2022] PUT /identity/v3/projects/86f319dc39ba4446b57076a35adfe805/users/9167b391e82342bbbbaeebf282c379c1/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:16.626236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bbc18-7c90-4b5d-bc23-ad24101c4e9a admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:16.651456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 804/1627] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:16 2022] PUT /identity/v3/projects/a58a9b356a3d410c874c873629d0990d/users/566fcf4cd9de44ba94c87f7a8fba231d/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:16.655309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0420-0023-4d7f-a030-e538c258e470 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:16.742099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:16.786267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf0420-0023-4d7f-a030-e538c258e470 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:16.813103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bbc18-7c90-4b5d-bc23-ad24101c4e9a admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:16.819965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63d27b-5779-4796-b009-1d8ff2eb8f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:16.820248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0a1d1-63dd-4296-9b4f-ca72e650248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:16.820603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63d27b-5779-4796-b009-1d8ff2eb8f59 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.820854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0a1d1-63dd-4296-9b4f-ca72e650248f admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.820979 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63d27b-5779-4796-b009-1d8ff2eb8f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.821138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63d27b-5779-4796-b009-1d8ff2eb8f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.821240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0a1d1-63dd-4296-9b4f-ca72e650248f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.821441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0a1d1-63dd-4296-9b4f-ca72e650248f admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.822392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63d27b-5779-4796-b009-1d8ff2eb8f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:16.822542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0a1d1-63dd-4296-9b4f-ca72e650248f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:16.823469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63d27b-5779-4796-b009-1d8ff2eb8f59 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:16.823959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0a1d1-63dd-4296-9b4f-ca72e650248f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:16.842992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 824/1628] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:16.845172 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4039fd-5b88-42ee-9cbd-d22903054af9 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.845459 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4039fd-5b88-42ee-9cbd-d22903054af9 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.845764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4039fd-5b88-42ee-9cbd-d22903054af9 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.847775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 825/1629] 10.222.0.74 () {54 vars in 912 bytes} [Wed Aug 31 00:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:36:16.849006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4039fd-5b88-42ee-9cbd-d22903054af9 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:16.855096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 805/1630] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:16.856441 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec6899-b733-48d3-bfde-5cec401ba74e None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.856736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec6899-b733-48d3-bfde-5cec401ba74e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.857018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec6899-b733-48d3-bfde-5cec401ba74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.875268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4039fd-5b88-42ee-9cbd-d22903054af9 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:16.884545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61822d-a160-46e4-a20e-725e95c72ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:16.885546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61822d-a160-46e4-a20e-725e95c72ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.886314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61822d-a160-46e4-a20e-725e95c72ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.886694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61822d-a160-46e4-a20e-725e95c72ccf admin admin] PATH_INFO: `/v3/projects/86f319dc39ba4446b57076a35adfe805/users/9167b391e82342bbbbaeebf282c379c1/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:16.887897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a1ec6899-b733-48d3-bfde-5cec401ba74e None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:16.889033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61822d-a160-46e4-a20e-725e95c72ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=86f319dc39ba4446b57076a35adfe805, user_id=9167b391e82342bbbbaeebf282c379c1, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:16.889190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a1ec6899-b733-48d3-bfde-5cec401ba74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:16.895394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61822d-a160-46e4-a20e-725e95c72ccf admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:16.913446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 826/1631] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:16 2022] PUT /identity/v3/projects/86f319dc39ba4446b57076a35adfe805/users/9167b391e82342bbbbaeebf282c379c1/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:16.914906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61822d-a160-46e4-a20e-725e95c72ccf admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:16.991625 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 806/1632] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:36:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:16.995809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65e7e-22ce-4d6a-b10e-be6d02d1a7ca None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:16.995809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65e7e-22ce-4d6a-b10e-be6d02d1a7ca None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:16.995809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a65e7e-22ce-4d6a-b10e-be6d02d1a7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:17.009055 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61822d-a160-46e4-a20e-725e95c72ccf admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:17.028164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-49a65e7e-22ce-4d6a-b10e-be6d02d1a7ca None None] MFA Rules not processed for user `9167b391e82342bbbbaeebf282c379c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:17.029404 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-49a65e7e-22ce-4d6a-b10e-be6d02d1a7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:17.035643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebc5b7-8490-41c2-a619-35370e948cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:17.036628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebc5b7-8490-41c2-a619-35370e948cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:17.038390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebc5b7-8490-41c2-a619-35370e948cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:17.042416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebc5b7-8490-41c2-a619-35370e948cfa admin admin] PATH_INFO: `/v3/projects/a58a9b356a3d410c874c873629d0990d/users/566fcf4cd9de44ba94c87f7a8fba231d/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:17.045288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebc5b7-8490-41c2-a619-35370e948cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58a9b356a3d410c874c873629d0990d, user_id=566fcf4cd9de44ba94c87f7a8fba231d, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:17.051548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebc5b7-8490-41c2-a619-35370e948cfa admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:17.066831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 827/1633] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:16 2022] PUT /identity/v3/projects/a58a9b356a3d410c874c873629d0990d/users/566fcf4cd9de44ba94c87f7a8fba231d/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:17.068239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebc5b7-8490-41c2-a619-35370e948cfa admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:17.136956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:17.155888 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebc5b7-8490-41c2-a619-35370e948cfa admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:17.168618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da500f27-b594-4186-afdb-1dfe6a20068e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:17.169248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da500f27-b594-4186-afdb-1dfe6a20068e service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:17.169528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da500f27-b594-4186-afdb-1dfe6a20068e service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:17.169842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da500f27-b594-4186-afdb-1dfe6a20068e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:17.183201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 807/1634] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:17.183201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a9815-2e6a-4954-84d2-8a158782e0fd None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:17.183201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a9815-2e6a-4954-84d2-8a158782e0fd None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:17.183201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a9815-2e6a-4954-84d2-8a158782e0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:17.227575 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-744a9815-2e6a-4954-84d2-8a158782e0fd None None] MFA Rules not processed for user `566fcf4cd9de44ba94c87f7a8fba231d`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:17.228980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-744a9815-2e6a-4954-84d2-8a158782e0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:17.259651 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da500f27-b594-4186-afdb-1dfe6a20068e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:17.260442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da500f27-b594-4186-afdb-1dfe6a20068e service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:17.272796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 828/1635] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:17.273803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da500f27-b594-4186-afdb-1dfe6a20068e service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:17.284455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da500f27-b594-4186-afdb-1dfe6a20068e service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:17.288744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb73cd-3c10-487f-861e-e3a2ee134ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:17.289410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb73cd-3c10-487f-861e-e3a2ee134ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:17.289725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb73cd-3c10-487f-861e-e3a2ee134ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:17.290001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb73cd-3c10-487f-861e-e3a2ee134ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:17.357772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 808/1636] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:17.989386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb73cd-3c10-487f-861e-e3a2ee134ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:17.989386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb73cd-3c10-487f-861e-e3a2ee134ee4 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:17.989386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 829/1637] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:17.993134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:17.993134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a9815-2e6a-4954-84d2-8a158782e0fd None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:17.993134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a9815-2e6a-4954-84d2-8a158782e0fd None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:17.993134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67629bf-bf28-42b0-b08b-f71a929753c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:17.995434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67629bf-bf28-42b0-b08b-f71a929753c2 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:17.995434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67629bf-bf28-42b0-b08b-f71a929753c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:17.995434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67629bf-bf28-42b0-b08b-f71a929753c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:17.995434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67629bf-bf28-42b0-b08b-f71a929753c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:17.995434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67629bf-bf28-42b0-b08b-f71a929753c2 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:17.995434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 809/1638] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:18.641740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d7a88-c403-413f-a151-7f02a7dde1fd None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:18.642252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d7a88-c403-413f-a151-7f02a7dde1fd None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:18.642410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d7a88-c403-413f-a151-7f02a7dde1fd None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:18.646262 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 830/1639] 10.222.0.74 () {54 vars in 962 bytes} [Wed Aug 31 00:36:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:36:18.651436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4cf36-80d2-484d-aa02-21e7fca8c15d None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:18.651944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4cf36-80d2-484d-aa02-21e7fca8c15d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:18.652354 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4cf36-80d2-484d-aa02-21e7fca8c15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:18.692920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-7ac4cf36-80d2-484d-aa02-21e7fca8c15d None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:18.694270 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7ac4cf36-80d2-484d-aa02-21e7fca8c15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:18.717803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 810/1640] 10.222.0.74 () {58 vars in 1059 bytes} [Wed Aug 31 00:36:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:18.719340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a312952-ba3a-4b5e-983f-e39a49ae695a None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:18.719630 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a312952-ba3a-4b5e-983f-e39a49ae695a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:18.719910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a312952-ba3a-4b5e-983f-e39a49ae695a None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:18.721568 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 831/1641] 10.222.0.74 () {54 vars in 912 bytes} [Wed Aug 31 00:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:36:18.727330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764449-4962-4504-bd9d-79172dbfc147 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:18.734953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764449-4962-4504-bd9d-79172dbfc147 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:18.734953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6764449-4962-4504-bd9d-79172dbfc147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:18.746941 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a312952-ba3a-4b5e-983f-e39a49ae695a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:18.761638 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a312952-ba3a-4b5e-983f-e39a49ae695a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:18.770256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396369b-3092-4d78-8d02-311ba3963822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:18.771129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396369b-3092-4d78-8d02-311ba3963822 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:18.771413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396369b-3092-4d78-8d02-311ba3963822 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:18.771689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396369b-3092-4d78-8d02-311ba3963822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:18.783384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f6764449-4962-4504-bd9d-79172dbfc147 None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:18.786495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f6764449-4962-4504-bd9d-79172dbfc147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:18.810540 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 811/1642] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:36:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:18.892128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:18.936714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396369b-3092-4d78-8d02-311ba3963822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:18.941181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396369b-3092-4d78-8d02-311ba3963822 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:18.958713 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 832/1643] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:36:19.005973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6764449-4962-4504-bd9d-79172dbfc147 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:19.030324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6764449-4962-4504-bd9d-79172dbfc147 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:19.040734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833033aa-1fec-44be-8704-8f87fb62892e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:19.041772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833033aa-1fec-44be-8704-8f87fb62892e service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:19.042257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833033aa-1fec-44be-8704-8f87fb62892e service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:19.042722 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833033aa-1fec-44be-8704-8f87fb62892e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:19.057764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833033aa-1fec-44be-8704-8f87fb62892e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:19.059651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833033aa-1fec-44be-8704-8f87fb62892e service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:19.076544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 812/1644] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:22.617528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396369b-3092-4d78-8d02-311ba3963822 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:22.822005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396369b-3092-4d78-8d02-311ba3963822 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:22.839659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:22.839659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:22.839659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:22.839659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] PATH_INFO: `/v3/users/8f89b775d9eb473c875ec54c6ccebf46` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:22.840110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f89b775d9eb473c875ec54c6ccebf46)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:22.861182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:23.226877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f89b775d9eb473c875ec54c6ccebf46'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:23.325721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f89b775d9eb473c875ec54c6ccebf46'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:23.373900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f89b775d9eb473c875ec54c6ccebf46'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:23.395584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f89b775d9eb473c875ec54c6ccebf46'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:23.401157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f89b775d9eb473c875ec54c6ccebf46'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:23.448686 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 833/1645] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:22 2022] DELETE /identity/v3/users/8f89b775d9eb473c875ec54c6ccebf46 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:23.451004 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af698ce-776b-416d-b5a8-9c0f97d65bfd None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:23.461192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af698ce-776b-416d-b5a8-9c0f97d65bfd None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:23.461192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af698ce-776b-416d-b5a8-9c0f97d65bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:23.512866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-5af698ce-776b-416d-b5a8-9c0f97d65bfd None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:23.517291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5af698ce-776b-416d-b5a8-9c0f97d65bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:23.779260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 813/1646] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:23.798616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:23.801632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:23.811564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:23.944829 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756ee79-e8ad-45f9-874c-13741ec821ce admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:23.957119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e63580-129a-4ed3-975d-0371940dc00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:23.958556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e63580-129a-4ed3-975d-0371940dc00d service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:23.960426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e63580-129a-4ed3-975d-0371940dc00d service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:23.960717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e63580-129a-4ed3-975d-0371940dc00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:23.980878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e63580-129a-4ed3-975d-0371940dc00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:23.982483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e63580-129a-4ed3-975d-0371940dc00d service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:24.023729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 834/1647] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:26.023537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af698ce-776b-416d-b5a8-9c0f97d65bfd None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:26.023537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5af698ce-776b-416d-b5a8-9c0f97d65bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:26.045784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af698ce-776b-416d-b5a8-9c0f97d65bfd None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:26.073603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:26.074573 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:26.074993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:26.075411 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] PATH_INFO: `/v3/projects/c45373e989574482a111802f21eea385` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:26.076751 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45373e989574482a111802f21eea385)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:26.080355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:26.322836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45373e989574482a111802f21eea385', 'request_id': 'req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:26.433169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45373e989574482a111802f21eea385', 'request_id': 'req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:26.450256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e63580-129a-4ed3-975d-0371940dc00d service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:26.451711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-69e63580-129a-4ed3-975d-0371940dc00d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:26.454434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45373e989574482a111802f21eea385', 'request_id': 'req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:26.492817 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e63580-129a-4ed3-975d-0371940dc00d service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:26.498364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] The token cache is being invalidate because project c45373e989574482a111802f21eea385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:26.512131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:26.515589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:26.518224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 814/1648] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:26 2022] DELETE /identity/v3/projects/c45373e989574482a111802f21eea385 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:26.522418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:26.537136 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:26.622301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:26.762973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282d09f-57bd-4bfd-8268-cd200070f55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:26.763880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282d09f-57bd-4bfd-8268-cd200070f55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:26.766024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282d09f-57bd-4bfd-8268-cd200070f55f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:26.766501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282d09f-57bd-4bfd-8268-cd200070f55f admin admin] PATH_INFO: `/v3/users/5690f10ea754446dbe7a6170c6de8a7f` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:26.771683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282d09f-57bd-4bfd-8268-cd200070f55f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5690f10ea754446dbe7a6170c6de8a7f)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:26.784336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282d09f-57bd-4bfd-8268-cd200070f55f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:26.811430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ec42c-6bfe-45e6-ab43-de7bcfee5cb7 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:26.838125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:26.842639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:26.842739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:26.843363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] PATH_INFO: `/v3/users/9167b391e82342bbbbaeebf282c379c1` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:26.847895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9167b391e82342bbbbaeebf282c379c1)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:26.848993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: WARNING py.warnings [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:36:26.848993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: warnings.warn(msg) Aug 31 00:36:26.848993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: Aug 31 00:36:26.857815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:27.195627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0282d09f-57bd-4bfd-8268-cd200070f55f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5690f10ea754446dbe7a6170c6de8a7f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:27.353441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0282d09f-57bd-4bfd-8268-cd200070f55f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5690f10ea754446dbe7a6170c6de8a7f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:27.399923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9167b391e82342bbbbaeebf282c379c1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:27.418010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0282d09f-57bd-4bfd-8268-cd200070f55f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5690f10ea754446dbe7a6170c6de8a7f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:27.438892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0282d09f-57bd-4bfd-8268-cd200070f55f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5690f10ea754446dbe7a6170c6de8a7f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:27.440412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0282d09f-57bd-4bfd-8268-cd200070f55f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5690f10ea754446dbe7a6170c6de8a7f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:27.452860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 835/1649] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:26 2022] DELETE /identity/v3/users/5690f10ea754446dbe7a6170c6de8a7f => generated 0 bytes in 1001 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:36:27.459995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb6a1e-28a7-47f8-812c-f04e7afd172c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:27.459995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb6a1e-28a7-47f8-812c-f04e7afd172c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:27.462235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb6a1e-28a7-47f8-812c-f04e7afd172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:27.463824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9167b391e82342bbbbaeebf282c379c1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:27.492006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9167b391e82342bbbbaeebf282c379c1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:27.537756 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2cbb6a1e-28a7-47f8-812c-f04e7afd172c None None] MFA Rules not processed for user `7b2f116fd01d46ddab8096d0f3214307`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:27.539306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2cbb6a1e-28a7-47f8-812c-f04e7afd172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:27.556901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:27.647647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9167b391e82342bbbbaeebf282c379c1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:27.648377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9167b391e82342bbbbaeebf282c379c1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:27.654483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 836/1650] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:27.657092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97f54-adc0-45d5-9020-2dbb40df6449 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:27.657548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97f54-adc0-45d5-9020-2dbb40df6449 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:27.658540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e97f54-adc0-45d5-9020-2dbb40df6449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:27.679274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 815/1651] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:26 2022] DELETE /identity/v3/users/9167b391e82342bbbbaeebf282c379c1 => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:27.680221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:27.681734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:27.686908 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b1e97f54-adc0-45d5-9020-2dbb40df6449 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:27.688998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b1e97f54-adc0-45d5-9020-2dbb40df6449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:27.810810 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 837/1652] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:27.845899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca500-57a0-4ac9-be59-f0750402732b admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:27.861431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056ff9d-1b50-4315-8120-79846e99824a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:27.862375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056ff9d-1b50-4315-8120-79846e99824a service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:27.862842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056ff9d-1b50-4315-8120-79846e99824a service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:27.863295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056ff9d-1b50-4315-8120-79846e99824a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:27.866405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c056ff9d-1b50-4315-8120-79846e99824a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:27.903396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e97f54-adc0-45d5-9020-2dbb40df6449 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:27.906696 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b1e97f54-adc0-45d5-9020-2dbb40df6449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:28.004104 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056ff9d-1b50-4315-8120-79846e99824a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:28.006076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056ff9d-1b50-4315-8120-79846e99824a service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:28.024827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 816/1653] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:28.093959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e97f54-adc0-45d5-9020-2dbb40df6449 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:28.101314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73e3d0-c16b-45af-be07-32606bce2f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:28.102116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73e3d0-c16b-45af-be07-32606bce2f7b service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:28.102407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73e3d0-c16b-45af-be07-32606bce2f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:28.103169 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73e3d0-c16b-45af-be07-32606bce2f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:28.120007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73e3d0-c16b-45af-be07-32606bce2f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:28.122040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73e3d0-c16b-45af-be07-32606bce2f7b service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:28.135732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 838/1654] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:29.544895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056ff9d-1b50-4315-8120-79846e99824a service nova] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:29.546514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c056ff9d-1b50-4315-8120-79846e99824a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:29.570840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056ff9d-1b50-4315-8120-79846e99824a service nova] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:29.580290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:29.582422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:29.583283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:29.584705 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] PATH_INFO: `/v3/projects/5f07d861390c41db9b162316077c9a21` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:29.587535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f07d861390c41db9b162316077c9a21)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:29.597743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:29.871211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f07d861390c41db9b162316077c9a21', 'request_id': 'req-b8eb1700-8a66-4144-8fb3-60482c715cda'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:30.004542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f07d861390c41db9b162316077c9a21', 'request_id': 'req-b8eb1700-8a66-4144-8fb3-60482c715cda'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:30.011832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f07d861390c41db9b162316077c9a21', 'request_id': 'req-b8eb1700-8a66-4144-8fb3-60482c715cda'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:30.060073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] The token cache is being invalidate because project 5f07d861390c41db9b162316077c9a21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:30.060378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:30.062373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:30.074775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 817/1655] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:29 2022] DELETE /identity/v3/projects/5f07d861390c41db9b162316077c9a21 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:30.080060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908421-8975-4ed9-9b15-2dde32275b5c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:30.080614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908421-8975-4ed9-9b15-2dde32275b5c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:30.080614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d908421-8975-4ed9-9b15-2dde32275b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:30.122540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-4d908421-8975-4ed9-9b15-2dde32275b5c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:30.123740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4d908421-8975-4ed9-9b15-2dde32275b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:30.185769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:30.188628 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:30.293651 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 839/1656] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:30.302134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a8d93-8f9b-4e98-a5bf-74560ba7b26a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:30.302647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a8d93-8f9b-4e98-a5bf-74560ba7b26a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:30.303070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a8d93-8f9b-4e98-a5bf-74560ba7b26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:30.353864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-f78a8d93-8f9b-4e98-a5bf-74560ba7b26a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:30.355348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f78a8d93-8f9b-4e98-a5bf-74560ba7b26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:30.363737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb1700-8a66-4144-8fb3-60482c715cda admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:30.370658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 840/1657] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:30.375426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:30.382651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:30.383163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:30.383607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] PATH_INFO: `/v3/projects/86f319dc39ba4446b57076a35adfe805` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:30.385158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86f319dc39ba4446b57076a35adfe805)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:30.387887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:30.388145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a8d93-8f9b-4e98-a5bf-74560ba7b26a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:30.441134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a8d93-8f9b-4e98-a5bf-74560ba7b26a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:30.461008 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94473880-9722-43e8-adbf-637e7ea9769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:30.462980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473880-9722-43e8-adbf-637e7ea9769b admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:30.464462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473880-9722-43e8-adbf-637e7ea9769b admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:30.466526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473880-9722-43e8-adbf-637e7ea9769b admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:30.469089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94473880-9722-43e8-adbf-637e7ea9769b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:30.469452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94473880-9722-43e8-adbf-637e7ea9769b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:30.473186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94473880-9722-43e8-adbf-637e7ea9769b admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:30.525899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 841/1658] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:30.530659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94473880-9722-43e8-adbf-637e7ea9769b admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:30.552957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94473880-9722-43e8-adbf-637e7ea9769b admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:30.556655 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:30.572503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad08462-24df-4d03-9fe9-73c241d9e7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:30.573156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad08462-24df-4d03-9fe9-73c241d9e7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:30.573510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad08462-24df-4d03-9fe9-73c241d9e7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:30.573881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad08462-24df-4d03-9fe9-73c241d9e7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:30.574605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad08462-24df-4d03-9fe9-73c241d9e7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:30.576611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad08462-24df-4d03-9fe9-73c241d9e7d9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:30.658754 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86f319dc39ba4446b57076a35adfe805', 'request_id': 'req-5238f6d3-bc46-4ee0-811e-9f870c77cd29'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:30.712303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 842/1659] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:30 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:36:30.713860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad08462-24df-4d03-9fe9-73c241d9e7d9 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:30.750428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86f319dc39ba4446b57076a35adfe805', 'request_id': 'req-5238f6d3-bc46-4ee0-811e-9f870c77cd29'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:30.760887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86f319dc39ba4446b57076a35adfe805', 'request_id': 'req-5238f6d3-bc46-4ee0-811e-9f870c77cd29'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:30.807542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] The token cache is being invalidate because project 86f319dc39ba4446b57076a35adfe805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:30.809425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:30.816574 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5238f6d3-bc46-4ee0-811e-9f870c77cd29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:30.820990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 818/1660] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:30 2022] DELETE /identity/v3/projects/86f319dc39ba4446b57076a35adfe805 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:36:30.835859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6ae6e-11c9-4cdd-bdfe-01df922d04fb None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:30.837627 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6ae6e-11c9-4cdd-bdfe-01df922d04fb None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:30.839852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6ae6e-11c9-4cdd-bdfe-01df922d04fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:30.881679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-1eb6ae6e-11c9-4cdd-bdfe-01df922d04fb None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:30.883450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1eb6ae6e-11c9-4cdd-bdfe-01df922d04fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:30.891955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad08462-24df-4d03-9fe9-73c241d9e7d9 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:30.900749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822d9c0-4af6-432d-bee9-17e0a1040c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:30.901391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822d9c0-4af6-432d-bee9-17e0a1040c74 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:30.901708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822d9c0-4af6-432d-bee9-17e0a1040c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:30.901986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822d9c0-4af6-432d-bee9-17e0a1040c74 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:30.902689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822d9c0-4af6-432d-bee9-17e0a1040c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:30.904836 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822d9c0-4af6-432d-bee9-17e0a1040c74 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:30.913786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 819/1661] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:30.922849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e18e8-90e5-4275-8d82-9cd8dd818f3f None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:30.923554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e18e8-90e5-4275-8d82-9cd8dd818f3f None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:30.925364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e18e8-90e5-4275-8d82-9cd8dd818f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:31.002805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-dd4e18e8-90e5-4275-8d82-9cd8dd818f3f None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:31.004072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-dd4e18e8-90e5-4275-8d82-9cd8dd818f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:31.030626 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 820/1662] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:31.036164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e18e8-90e5-4275-8d82-9cd8dd818f3f None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:31.058602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e18e8-90e5-4275-8d82-9cd8dd818f3f None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:31.058775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 843/1663] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:30 2022] POST /identity/v3/users => generated 294 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:31.063055 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822d9c0-4af6-432d-bee9-17e0a1040c74 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:31.065057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7822d9c0-4af6-432d-bee9-17e0a1040c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:31.068925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6450e5-82e5-483e-b5ae-c458265645c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:31.069596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6450e5-82e5-483e-b5ae-c458265645c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:31.069883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6450e5-82e5-483e-b5ae-c458265645c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:31.070162 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6450e5-82e5-483e-b5ae-c458265645c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:31.072642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6450e5-82e5-483e-b5ae-c458265645c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:31.072988 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6450e5-82e5-483e-b5ae-c458265645c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:31.075573 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6450e5-82e5-483e-b5ae-c458265645c8 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:31.095916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822d9c0-4af6-432d-bee9-17e0a1040c74 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:31.112317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d5fae-e3c2-4269-be61-4fb36ab953ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:31.112951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d5fae-e3c2-4269-be61-4fb36ab953ff admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:31.113236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d5fae-e3c2-4269-be61-4fb36ab953ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:31.113516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d5fae-e3c2-4269-be61-4fb36ab953ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:31.114212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d5fae-e3c2-4269-be61-4fb36ab953ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:31.115849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d5fae-e3c2-4269-be61-4fb36ab953ff admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:31.135701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 821/1664] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:31.137369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6450e5-82e5-483e-b5ae-c458265645c8 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:31.150461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 844/1665] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:31.151485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d5fae-e3c2-4269-be61-4fb36ab953ff admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:31.170074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d5fae-e3c2-4269-be61-4fb36ab953ff admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:31.177938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6450e5-82e5-483e-b5ae-c458265645c8 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:31.179222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabbfed-ddd0-4390-bcaf-56637f7d01fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:31.187902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabbfed-ddd0-4390-bcaf-56637f7d01fc admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:31.188203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabbfed-ddd0-4390-bcaf-56637f7d01fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:31.188539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabbfed-ddd0-4390-bcaf-56637f7d01fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:31.189536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabbfed-ddd0-4390-bcaf-56637f7d01fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:31.191381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabbfed-ddd0-4390-bcaf-56637f7d01fc admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:31.200442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9f78a-7e0f-4eae-be12-7de63dbf2fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:31.201786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9f78a-7e0f-4eae-be12-7de63dbf2fcd admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:31.202078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9f78a-7e0f-4eae-be12-7de63dbf2fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:31.202965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9f78a-7e0f-4eae-be12-7de63dbf2fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:31.207104 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9f78a-7e0f-4eae-be12-7de63dbf2fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:31.212212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 845/1666] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:31.212661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9f78a-7e0f-4eae-be12-7de63dbf2fcd admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:31.213133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabbfed-ddd0-4390-bcaf-56637f7d01fc admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:31.225831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabbfed-ddd0-4390-bcaf-56637f7d01fc admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:31.231284 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2cc92-e3a2-4ff2-8b0b-46c55a3247a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:31.231953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2cc92-e3a2-4ff2-8b0b-46c55a3247a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:31.232391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2cc92-e3a2-4ff2-8b0b-46c55a3247a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:31.232830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2cc92-e3a2-4ff2-8b0b-46c55a3247a5 admin admin] PATH_INFO: `/v3/projects/c9f1e8bfa4d048bbbde5e585e21ff8f7/users/f893402bab2e488c873d2103be5a325e/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:31.270777 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2cc92-e3a2-4ff2-8b0b-46c55a3247a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f1e8bfa4d048bbbde5e585e21ff8f7, user_id=f893402bab2e488c873d2103be5a325e, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:31.273958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2cc92-e3a2-4ff2-8b0b-46c55a3247a5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:31.436107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:31.449722 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 822/1667] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:31 2022] POST /identity/v3/projects => generated 369 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:31.451377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9f78a-7e0f-4eae-be12-7de63dbf2fcd admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:31.456482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 846/1668] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:31 2022] PUT /identity/v3/projects/c9f1e8bfa4d048bbbde5e585e21ff8f7/users/f893402bab2e488c873d2103be5a325e/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:31.480086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc7edf-dba8-4bb4-9169-d8ad32954682 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:31.480380 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc7edf-dba8-4bb4-9169-d8ad32954682 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:31.480654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc7edf-dba8-4bb4-9169-d8ad32954682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:31.574575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-dacc7edf-dba8-4bb4-9169-d8ad32954682 None None] MFA Rules not processed for user `f893402bab2e488c873d2103be5a325e`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:31.578747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-dacc7edf-dba8-4bb4-9169-d8ad32954682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:31.718712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 847/1669] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:36:31.721334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9f78a-7e0f-4eae-be12-7de63dbf2fcd admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:31.722110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc7edf-dba8-4bb4-9169-d8ad32954682 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:31.729441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-dacc7edf-dba8-4bb4-9169-d8ad32954682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:31.742102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6019b-18f5-47c1-ad17-0fda088a9342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:31.747519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6019b-18f5-47c1-ad17-0fda088a9342 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:31.747808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6019b-18f5-47c1-ad17-0fda088a9342 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:31.749626 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6019b-18f5-47c1-ad17-0fda088a9342 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:31.750823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6019b-18f5-47c1-ad17-0fda088a9342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:31.755875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6019b-18f5-47c1-ad17-0fda088a9342 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:31.772690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc7edf-dba8-4bb4-9169-d8ad32954682 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:31.795375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3621b-d12c-4c08-9662-51312cc615e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:31.796752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3621b-d12c-4c08-9662-51312cc615e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:31.797166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3621b-d12c-4c08-9662-51312cc615e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:31.800113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3621b-d12c-4c08-9662-51312cc615e9 admin admin] PATH_INFO: `/v3/users/bde6c57c079d4b26ae4d9462df629bab` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:31.803954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3621b-d12c-4c08-9662-51312cc615e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde6c57c079d4b26ae4d9462df629bab)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:31.806798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c3621b-d12c-4c08-9662-51312cc615e9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:31.918533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 823/1670] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:31 2022] POST /identity/v3/users => generated 285 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:31.920194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6019b-18f5-47c1-ad17-0fda088a9342 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:31.956888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6019b-18f5-47c1-ad17-0fda088a9342 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:31.973215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c8f0a-3287-4d9c-b18a-7b834fb4bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:31.974129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8f0a-3287-4d9c-b18a-7b834fb4bf3c admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:31.974625 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8f0a-3287-4d9c-b18a-7b834fb4bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:31.975289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8f0a-3287-4d9c-b18a-7b834fb4bf3c admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:31.976161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c8f0a-3287-4d9c-b18a-7b834fb4bf3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:31.980466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c8f0a-3287-4d9c-b18a-7b834fb4bf3c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:32.155254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 824/1671] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:31 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:32.156572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c8f0a-3287-4d9c-b18a-7b834fb4bf3c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:32.156861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-62c3621b-d12c-4c08-9662-51312cc615e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde6c57c079d4b26ae4d9462df629bab'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:32.273651 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-62c3621b-d12c-4c08-9662-51312cc615e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde6c57c079d4b26ae4d9462df629bab'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:32.283295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c8f0a-3287-4d9c-b18a-7b834fb4bf3c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:32.299781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-62c3621b-d12c-4c08-9662-51312cc615e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde6c57c079d4b26ae4d9462df629bab'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:32.300827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ae5d7-9993-4be8-a8d3-3978778c1a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:32.303063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae5d7-9993-4be8-a8d3-3978778c1a37 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:32.303063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae5d7-9993-4be8-a8d3-3978778c1a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:32.303063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae5d7-9993-4be8-a8d3-3978778c1a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:32.303063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ae5d7-9993-4be8-a8d3-3978778c1a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:32.304326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ae5d7-9993-4be8-a8d3-3978778c1a37 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:32.314122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-62c3621b-d12c-4c08-9662-51312cc615e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde6c57c079d4b26ae4d9462df629bab'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:32.317107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-62c3621b-d12c-4c08-9662-51312cc615e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde6c57c079d4b26ae4d9462df629bab'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:32.329099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 848/1672] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:31 2022] DELETE /identity/v3/users/bde6c57c079d4b26ae4d9462df629bab => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:32.331385 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ee6c7-243f-49de-997f-68f07e0ed223 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:32.331985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ee6c7-243f-49de-997f-68f07e0ed223 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:32.332600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ee6c7-243f-49de-997f-68f07e0ed223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:32.340936 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 825/1673] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:32.343594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28406319-6d63-416d-950d-943fb05a33f9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:32.344393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28406319-6d63-416d-950d-943fb05a33f9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:32.344732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28406319-6d63-416d-950d-943fb05a33f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:32.372735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-940ee6c7-243f-49de-997f-68f07e0ed223 None None] MFA Rules not processed for user `e775b9e1dfde44a0bfe23523399f8f22`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:32.375039 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-940ee6c7-243f-49de-997f-68f07e0ed223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:32.438848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-28406319-6d63-416d-950d-943fb05a33f9 None None] MFA Rules not processed for user `8911babcd58647fdb6c861cc4e42b020`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:32.440684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-28406319-6d63-416d-950d-943fb05a33f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:32.595381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 849/1674] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:32.605821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ee6c7-243f-49de-997f-68f07e0ed223 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:32.608213 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-940ee6c7-243f-49de-997f-68f07e0ed223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:32.648964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:32.673547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 826/1675] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:32.675467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e244455-119b-4b7b-8f03-a9bcc4ee3ab1 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:32.677254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e244455-119b-4b7b-8f03-a9bcc4ee3ab1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:32.677908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e244455-119b-4b7b-8f03-a9bcc4ee3ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:32.720433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-4e244455-119b-4b7b-8f03-a9bcc4ee3ab1 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:32.722757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4e244455-119b-4b7b-8f03-a9bcc4ee3ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:32.756363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ee6c7-243f-49de-997f-68f07e0ed223 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:32.769473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9208e28-25a8-499b-b1bf-83daa93e242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:32.771618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208e28-25a8-499b-b1bf-83daa93e242a admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:32.771906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208e28-25a8-499b-b1bf-83daa93e242a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:32.772181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9208e28-25a8-499b-b1bf-83daa93e242a admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:32.784359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9208e28-25a8-499b-b1bf-83daa93e242a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:32.786602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9208e28-25a8-499b-b1bf-83daa93e242a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:32.845533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 827/1676] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:32.846677 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e244455-119b-4b7b-8f03-a9bcc4ee3ab1 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:32.848362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4e244455-119b-4b7b-8f03-a9bcc4ee3ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:32.865517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e244455-119b-4b7b-8f03-a9bcc4ee3ab1 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:32.884072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ac989-9310-488f-bff0-77bcc43c8fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:32.885024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac989-9310-488f-bff0-77bcc43c8fda admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:32.885478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac989-9310-488f-bff0-77bcc43c8fda admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:32.885984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac989-9310-488f-bff0-77bcc43c8fda admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:32.887490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ac989-9310-488f-bff0-77bcc43c8fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:32.894281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ac989-9310-488f-bff0-77bcc43c8fda admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:32.922649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 828/1677] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:32.924957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80ab3-100f-4331-9215-4ece6bc7a487 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:32.925648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80ab3-100f-4331-9215-4ece6bc7a487 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:32.931542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 850/1678] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:32 2022] POST /identity/v3/users => generated 299 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:32.933199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46051b9a-7d74-4f93-aeb4-7a756654c720 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:32.940281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46051b9a-7d74-4f93-aeb4-7a756654c720 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:32.940281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46051b9a-7d74-4f93-aeb4-7a756654c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:32.940990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80ab3-100f-4331-9215-4ece6bc7a487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:32.981477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-d8b80ab3-100f-4331-9215-4ece6bc7a487 None None] MFA Rules not processed for user `e775b9e1dfde44a0bfe23523399f8f22`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:32.985154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d8b80ab3-100f-4331-9215-4ece6bc7a487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:32.998454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-46051b9a-7d74-4f93-aeb4-7a756654c720 None None] MFA Rules not processed for user `8911babcd58647fdb6c861cc4e42b020`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:32.999882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-46051b9a-7d74-4f93-aeb4-7a756654c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:33.016124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 851/1679] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:33.017152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 829/1680] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:33.017270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46051b9a-7d74-4f93-aeb4-7a756654c720 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:33.018338 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b80ab3-100f-4331-9215-4ece6bc7a487 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:33.020818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d8b80ab3-100f-4331-9215-4ece6bc7a487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:33.049714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46051b9a-7d74-4f93-aeb4-7a756654c720 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:33.080258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ec7df-83e1-424c-958a-6dec0594fc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:33.081119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ec7df-83e1-424c-958a-6dec0594fc09 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:33.081408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ec7df-83e1-424c-958a-6dec0594fc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:33.081746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ec7df-83e1-424c-958a-6dec0594fc09 admin admin] PATH_INFO: `/v3/projects/d58ac05a12ec4194a121974dfbb888d8/users/43ce47dbd28747669ddcd626fa2cfacc/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:33.126092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ec7df-83e1-424c-958a-6dec0594fc09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58ac05a12ec4194a121974dfbb888d8, user_id=43ce47dbd28747669ddcd626fa2cfacc, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:33.129283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ec7df-83e1-424c-958a-6dec0594fc09 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:33.189151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b80ab3-100f-4331-9215-4ece6bc7a487 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:33.197286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26565c-ec1a-472b-9d05-149d61f63f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:33.198020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26565c-ec1a-472b-9d05-149d61f63f6b service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:33.198927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26565c-ec1a-472b-9d05-149d61f63f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:33.199208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26565c-ec1a-472b-9d05-149d61f63f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:33.221239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26565c-ec1a-472b-9d05-149d61f63f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:33.223042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26565c-ec1a-472b-9d05-149d61f63f6b service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:33.247834 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 830/1681] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:33.254240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26565c-ec1a-472b-9d05-149d61f63f6b service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:33.280064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26565c-ec1a-472b-9d05-149d61f63f6b service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:33.300661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 852/1682] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:33 2022] PUT /identity/v3/projects/d58ac05a12ec4194a121974dfbb888d8/users/43ce47dbd28747669ddcd626fa2cfacc/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:33.301992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ec7df-83e1-424c-958a-6dec0594fc09 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:33.306516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-697ec7df-83e1-424c-958a-6dec0594fc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:33.465353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe10e2-5edf-42c6-80c1-cb278ecb6ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:33.466073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe10e2-5edf-42c6-80c1-cb278ecb6ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:33.470200 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe10e2-5edf-42c6-80c1-cb278ecb6ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:33.470516 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe10e2-5edf-42c6-80c1-cb278ecb6ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:33.473426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe10e2-5edf-42c6-80c1-cb278ecb6ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:33.482879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe10e2-5edf-42c6-80c1-cb278ecb6ba6 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:33.492856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ec7df-83e1-424c-958a-6dec0594fc09 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:33.522143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 831/1683] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:33.522143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe10e2-5edf-42c6-80c1-cb278ecb6ba6 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:33.522143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-94fe10e2-5edf-42c6-80c1-cb278ecb6ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:33.530287 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7603b6-380a-4404-8555-7e1f5f4ed629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:33.535421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7603b6-380a-4404-8555-7e1f5f4ed629 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:33.536758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7603b6-380a-4404-8555-7e1f5f4ed629 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:33.537239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7603b6-380a-4404-8555-7e1f5f4ed629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:33.573387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe10e2-5edf-42c6-80c1-cb278ecb6ba6 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:33.580301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600eeaf9-e119-4ceb-a0f5-b8c786cc956e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:33.581012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eeaf9-e119-4ceb-a0f5-b8c786cc956e service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:33.581355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eeaf9-e119-4ceb-a0f5-b8c786cc956e service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:33.596588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eeaf9-e119-4ceb-a0f5-b8c786cc956e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:33.695397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7603b6-380a-4404-8555-7e1f5f4ed629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:33.700324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:33.702565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7603b6-380a-4404-8555-7e1f5f4ed629 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:33.717002 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 853/1684] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:33.731201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a74f1f-5166-4477-b9ea-744a200e6fa9 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:33.731975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a74f1f-5166-4477-b9ea-744a200e6fa9 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:33.732459 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a74f1f-5166-4477-b9ea-744a200e6fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:33.738320 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600eeaf9-e119-4ceb-a0f5-b8c786cc956e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:33.740639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600eeaf9-e119-4ceb-a0f5-b8c786cc956e service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:33.753255 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 832/1685] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:33.755426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f8f6b-8914-4a9d-815c-26dbee9a0604 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:33.755875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f8f6b-8914-4a9d-815c-26dbee9a0604 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:33.756295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f8f6b-8914-4a9d-815c-26dbee9a0604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:33.803298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b7a74f1f-5166-4477-b9ea-744a200e6fa9 None None] MFA Rules not processed for user `b049ee00b6404a678a010587074aba66`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:33.804960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b7a74f1f-5166-4477-b9ea-744a200e6fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:33.818144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-7e0f8f6b-8914-4a9d-815c-26dbee9a0604 None None] MFA Rules not processed for user `43ce47dbd28747669ddcd626fa2cfacc`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:33.819653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7e0f8f6b-8914-4a9d-815c-26dbee9a0604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:34.020788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 854/1686] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:34.036441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a74f1f-5166-4477-b9ea-744a200e6fa9 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:34.045187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:34.048186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b7a74f1f-5166-4477-b9ea-744a200e6fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:34.074205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a74f1f-5166-4477-b9ea-744a200e6fa9 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:34.079271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:34.079550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 833/1687] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:34.080112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:34.084127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f8f6b-8914-4a9d-815c-26dbee9a0604 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:34.084275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:34.084275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] PATH_INFO: `/v3/users/2f00824ca967485486300998e3203fa9` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:34.084275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f00824ca967485486300998e3203fa9)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:34.085669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:34.110401 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f8f6b-8914-4a9d-815c-26dbee9a0604 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:34.124035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f3aec-f37d-433c-8a09-05e567224dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:34.124636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f3aec-f37d-433c-8a09-05e567224dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:34.124919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f3aec-f37d-433c-8a09-05e567224dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:34.125274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f3aec-f37d-433c-8a09-05e567224dc6 admin admin] PATH_INFO: `/v3/projects/286bc3c184d64592a538fb907186d977/users/5f2b41d481854b44bfd452df06b1be90/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:34.176108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f3aec-f37d-433c-8a09-05e567224dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286bc3c184d64592a538fb907186d977, user_id=5f2b41d481854b44bfd452df06b1be90, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:34.187696 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f3aec-f37d-433c-8a09-05e567224dc6 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:34.325814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 834/1688] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:34 2022] PUT /identity/v3/projects/286bc3c184d64592a538fb907186d977/users/5f2b41d481854b44bfd452df06b1be90/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:34.327883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f3aec-f37d-433c-8a09-05e567224dc6 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:34.399588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f00824ca967485486300998e3203fa9'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:34.471899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f3aec-f37d-433c-8a09-05e567224dc6 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:34.480136 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072ea3d-40e7-44e9-a9ac-43f8f4427b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:34.481335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ea3d-40e7-44e9-a9ac-43f8f4427b86 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:34.481954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ea3d-40e7-44e9-a9ac-43f8f4427b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:34.486157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072ea3d-40e7-44e9-a9ac-43f8f4427b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:34.486157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ea3d-40e7-44e9-a9ac-43f8f4427b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:34.486827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f072ea3d-40e7-44e9-a9ac-43f8f4427b86 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:34.507824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f00824ca967485486300998e3203fa9'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:34.534249 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f00824ca967485486300998e3203fa9'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:34.589112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f00824ca967485486300998e3203fa9'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:34.590082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f00824ca967485486300998e3203fa9'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:34.599790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 855/1689] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:34 2022] DELETE /identity/v3/users/2f00824ca967485486300998e3203fa9 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:34.601608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:34.602933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:34.673977 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 835/1690] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:34 2022] POST /identity/v3/projects => generated 369 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:34.677132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba67386-f7b7-4173-8ff4-4c22aa7d93fb None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:34.677970 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba67386-f7b7-4173-8ff4-4c22aa7d93fb None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:34.679182 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba67386-f7b7-4173-8ff4-4c22aa7d93fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:34.773245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-eba67386-f7b7-4173-8ff4-4c22aa7d93fb None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:34.777815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-eba67386-f7b7-4173-8ff4-4c22aa7d93fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:34.794279 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1dd425-d3fe-455b-9196-46c3489e38be admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:34.994450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 836/1691] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:34.994450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba67386-f7b7-4173-8ff4-4c22aa7d93fb None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:34.998377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-eba67386-f7b7-4173-8ff4-4c22aa7d93fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:35.023503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4a20c-aa44-4e16-9442-c75944f763fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:35.031044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4a20c-aa44-4e16-9442-c75944f763fc admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.031044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4a20c-aa44-4e16-9442-c75944f763fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.031044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4a20c-aa44-4e16-9442-c75944f763fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.031044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4a20c-aa44-4e16-9442-c75944f763fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:35.034440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4a20c-aa44-4e16-9442-c75944f763fc admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:35.045141 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba67386-f7b7-4173-8ff4-4c22aa7d93fb None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:35.075106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63798cbe-251b-4b2a-9056-3bbfced188dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:35.075837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798cbe-251b-4b2a-9056-3bbfced188dd admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.076265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798cbe-251b-4b2a-9056-3bbfced188dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.076544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798cbe-251b-4b2a-9056-3bbfced188dd admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.077933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63798cbe-251b-4b2a-9056-3bbfced188dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:35.080625 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63798cbe-251b-4b2a-9056-3bbfced188dd admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:35.098587 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 856/1692] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:35.102975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4a20c-aa44-4e16-9442-c75944f763fc admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:35.118630 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-45f4a20c-aa44-4e16-9442-c75944f763fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:35.193668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 837/1693] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:34 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:35.194703 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63798cbe-251b-4b2a-9056-3bbfced188dd admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:35.208948 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63798cbe-251b-4b2a-9056-3bbfced188dd admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:35.214686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9d6b7-de04-44fe-b7d8-d63110ebba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:35.218008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9d6b7-de04-44fe-b7d8-d63110ebba06 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.218008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9d6b7-de04-44fe-b7d8-d63110ebba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.218450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9d6b7-de04-44fe-b7d8-d63110ebba06 admin admin] PATH_INFO: `/v3/projects/286bc3c184d64592a538fb907186d977/users/5f2b41d481854b44bfd452df06b1be90/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.220867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:35.223361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9d6b7-de04-44fe-b7d8-d63110ebba06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286bc3c184d64592a538fb907186d977, user_id=5f2b41d481854b44bfd452df06b1be90, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:35.227976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9d6b7-de04-44fe-b7d8-d63110ebba06 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:35.230310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4a20c-aa44-4e16-9442-c75944f763fc admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:35.235414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58b67b-2428-436c-82ae-346ae0e16f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:35.236189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58b67b-2428-436c-82ae-346ae0e16f33 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.236471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58b67b-2428-436c-82ae-346ae0e16f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.236791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58b67b-2428-436c-82ae-346ae0e16f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.247257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58b67b-2428-436c-82ae-346ae0e16f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:35.249195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 838/1694] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:35 2022] PUT /identity/v3/projects/286bc3c184d64592a538fb907186d977/users/5f2b41d481854b44bfd452df06b1be90/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:35.249363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58b67b-2428-436c-82ae-346ae0e16f33 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:35.250122 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9d6b7-de04-44fe-b7d8-d63110ebba06 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:35.260887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 857/1695] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:35.262222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aec8-bb98-4456-a5ba-7a30ea3ba5f6 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.262511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aec8-bb98-4456-a5ba-7a30ea3ba5f6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.262902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aec8-bb98-4456-a5ba-7a30ea3ba5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.346093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-9a87aec8-bb98-4456-a5ba-7a30ea3ba5f6 None None] MFA Rules not processed for user `5f2b41d481854b44bfd452df06b1be90`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:35.348083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-9a87aec8-bb98-4456-a5ba-7a30ea3ba5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:35.423569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9d6b7-de04-44fe-b7d8-d63110ebba06 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:35.436220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2ce6a-b034-4e71-a15b-b9858c1f7c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:35.438556 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ce6a-b034-4e71-a15b-b9858c1f7c09 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.438556 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ce6a-b034-4e71-a15b-b9858c1f7c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.438556 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ce6a-b034-4e71-a15b-b9858c1f7c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.439148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ce6a-b034-4e71-a15b-b9858c1f7c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:35.440814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ce6a-b034-4e71-a15b-b9858c1f7c09 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:35.462486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 839/1696] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:35.464042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9379d04-37bb-49b7-8377-7656d8d9fc7b None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.464042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9379d04-37bb-49b7-8377-7656d8d9fc7b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.464747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9379d04-37bb-49b7-8377-7656d8d9fc7b None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.466099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 840/1697] 10.222.0.74 () {54 vars in 912 bytes} [Wed Aug 31 00:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:36:35.471082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077d165-212f-4cf5-ac5e-a5ce693d860d None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.471303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077d165-212f-4cf5-ac5e-a5ce693d860d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.471395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077d165-212f-4cf5-ac5e-a5ce693d860d None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.473156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 841/1698] 10.222.0.74 () {54 vars in 912 bytes} [Wed Aug 31 00:36:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:36:35.473602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077d165-212f-4cf5-ac5e-a5ce693d860d None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:35.500838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:35.508149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077d165-212f-4cf5-ac5e-a5ce693d860d None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:35.525097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd213625-2f24-4898-a8b8-be5163ed9871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:35.526128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd213625-2f24-4898-a8b8-be5163ed9871 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.526563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd213625-2f24-4898-a8b8-be5163ed9871 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.526988 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd213625-2f24-4898-a8b8-be5163ed9871 admin admin] PATH_INFO: `/v3/projects/3b247b5dbc754ee483ca3d0a5b6697af/users/9888dd95f3574c548e71898fea2b780b/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.543844 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 858/1699] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:35.545214 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5aeb4-e796-4d78-9658-f7a9b386e45f None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.547279 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5aeb4-e796-4d78-9658-f7a9b386e45f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.550772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5aeb4-e796-4d78-9658-f7a9b386e45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.578935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd213625-2f24-4898-a8b8-be5163ed9871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b247b5dbc754ee483ca3d0a5b6697af, user_id=9888dd95f3574c548e71898fea2b780b, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:35.583811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd213625-2f24-4898-a8b8-be5163ed9871 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:35.630678 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-6bb5aeb4-e796-4d78-9658-f7a9b386e45f None None] MFA Rules not processed for user `6f5149b369e34afca6dd41a0082701e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:35.633875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6bb5aeb4-e796-4d78-9658-f7a9b386e45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:35.716118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 842/1700] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:35 2022] PUT /identity/v3/projects/3b247b5dbc754ee483ca3d0a5b6697af/users/9888dd95f3574c548e71898fea2b780b/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:35.716118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a50a10-843d-4f79-b8b3-f76fd1a8abdb None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.716336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a50a10-843d-4f79-b8b3-f76fd1a8abdb None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.717069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a50a10-843d-4f79-b8b3-f76fd1a8abdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.755643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 859/1701] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:36:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:35.758295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5aeb4-e796-4d78-9658-f7a9b386e45f None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:35.761188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6bb5aeb4-e796-4d78-9658-f7a9b386e45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:35.787910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-29a50a10-843d-4f79-b8b3-f76fd1a8abdb None None] MFA Rules not processed for user `6f5149b369e34afca6dd41a0082701e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:35.790313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-29a50a10-843d-4f79-b8b3-f76fd1a8abdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:35.810401 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5aeb4-e796-4d78-9658-f7a9b386e45f None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:35.895617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 843/1702] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:36:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:35.896998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a50a10-843d-4f79-b8b3-f76fd1a8abdb None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:35.900815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-29a50a10-843d-4f79-b8b3-f76fd1a8abdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:35.969322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:35.970914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:35.971493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:35.971936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] PATH_INFO: `/v3/projects/49bf5dab81874fc5a8600942737db564` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:35.974010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49bf5dab81874fc5a8600942737db564)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:35.975547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: WARNING py.warnings [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 00:36:35.975547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: warnings.warn(msg) Aug 31 00:36:35.975547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: Aug 31 00:36:35.977717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:36.065758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a50a10-843d-4f79-b8b3-f76fd1a8abdb None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:36.078976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad024e-4b99-4a82-a16f-17539a148367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:36.079870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad024e-4b99-4a82-a16f-17539a148367 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:36.080263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad024e-4b99-4a82-a16f-17539a148367 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:36.084854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad024e-4b99-4a82-a16f-17539a148367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:36.176930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad024e-4b99-4a82-a16f-17539a148367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:36.178976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad024e-4b99-4a82-a16f-17539a148367 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:36.180600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bf5dab81874fc5a8600942737db564', 'request_id': 'req-a9e9b1be-8f38-4484-bf7a-115851956ab5'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:36.190043 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bf5dab81874fc5a8600942737db564', 'request_id': 'req-a9e9b1be-8f38-4484-bf7a-115851956ab5'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:36.198698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 844/1703] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:36.203353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad024e-4b99-4a82-a16f-17539a148367 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:36.223496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bf5dab81874fc5a8600942737db564', 'request_id': 'req-a9e9b1be-8f38-4484-bf7a-115851956ab5'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:36.236950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad024e-4b99-4a82-a16f-17539a148367 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:36.313088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] The token cache is being invalidate because project 49bf5dab81874fc5a8600942737db564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:36.313397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:36.317241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:36.319307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 860/1704] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:35 2022] DELETE /identity/v3/projects/49bf5dab81874fc5a8600942737db564 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:36.320199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:36.324410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:36.427359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd314486-a589-4aad-aa7e-a2a876788ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:36.427359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd314486-a589-4aad-aa7e-a2a876788ecf admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:36.427359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd314486-a589-4aad-aa7e-a2a876788ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:36.427359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd314486-a589-4aad-aa7e-a2a876788ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:36.427752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd314486-a589-4aad-aa7e-a2a876788ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:36.427752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd314486-a589-4aad-aa7e-a2a876788ecf admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:36.442051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 845/1705] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:36.443407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd314486-a589-4aad-aa7e-a2a876788ecf admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:36.445559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-dd314486-a589-4aad-aa7e-a2a876788ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:36.489626 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9b1be-8f38-4484-bf7a-115851956ab5 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:36.499473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30debd-e722-4555-b120-94a28378a5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:36.501138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30debd-e722-4555-b120-94a28378a5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:36.502421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30debd-e722-4555-b120-94a28378a5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:36.503049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30debd-e722-4555-b120-94a28378a5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:36.506713 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2c30debd-e722-4555-b120-94a28378a5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:36.534628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30debd-e722-4555-b120-94a28378a5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:36.536101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30debd-e722-4555-b120-94a28378a5a5 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:36.539033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd314486-a589-4aad-aa7e-a2a876788ecf admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:36.548460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 861/1706] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:36.549418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30debd-e722-4555-b120-94a28378a5a5 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:36.550605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4919e1-1a1d-4c24-9c2f-122f941e2305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:36.554950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4919e1-1a1d-4c24-9c2f-122f941e2305 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:36.554950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4919e1-1a1d-4c24-9c2f-122f941e2305 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:36.554950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4919e1-1a1d-4c24-9c2f-122f941e2305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:36.555686 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2c30debd-e722-4555-b120-94a28378a5a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:36.557076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0d4919e1-1a1d-4c24-9c2f-122f941e2305 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:36.581957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:36.584098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4919e1-1a1d-4c24-9c2f-122f941e2305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:36.586029 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4919e1-1a1d-4c24-9c2f-122f941e2305 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:36.598097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30debd-e722-4555-b120-94a28378a5a5 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:36.603106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 846/1707] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:36.605664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851527-64bd-4a92-b848-ea703c196de2 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:36.607865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851527-64bd-4a92-b848-ea703c196de2 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:36.608032 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:36.609711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:36.610280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:36.610983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] PATH_INFO: `/v3/projects/e0cdc570388743b1b4fb21236d0eff66` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:36.612363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc851527-64bd-4a92-b848-ea703c196de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:36.613197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0cdc570388743b1b4fb21236d0eff66)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:36.618794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:36.619900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:36.667778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-cc851527-64bd-4a92-b848-ea703c196de2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:36.669032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cc851527-64bd-4a92-b848-ea703c196de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:36.699192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 847/1708] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:36.700604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ac173-8866-49b1-b85a-4835b631956b None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:36.700880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ac173-8866-49b1-b85a-4835b631956b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:36.701339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ac173-8866-49b1-b85a-4835b631956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:36.725062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-239ac173-8866-49b1-b85a-4835b631956b None None] MFA Rules not processed for user `7b2f116fd01d46ddab8096d0f3214307`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:36.729055 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-239ac173-8866-49b1-b85a-4835b631956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:36.795057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0cdc570388743b1b4fb21236d0eff66', 'request_id': 'req-5feeb890-4c59-48db-832c-2af5dc642cf4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:36.809354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0cdc570388743b1b4fb21236d0eff66', 'request_id': 'req-5feeb890-4c59-48db-832c-2af5dc642cf4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:36.819527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0cdc570388743b1b4fb21236d0eff66', 'request_id': 'req-5feeb890-4c59-48db-832c-2af5dc642cf4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:36.831399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 848/1709] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:36.833966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ac173-8866-49b1-b85a-4835b631956b None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:36.836787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-239ac173-8866-49b1-b85a-4835b631956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:36.861684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ac173-8866-49b1-b85a-4835b631956b None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:36.932560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] The token cache is being invalidate because project e0cdc570388743b1b4fb21236d0eff66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:36.932922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:36.933694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:36.943259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 862/1710] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:36 2022] DELETE /identity/v3/projects/e0cdc570388743b1b4fb21236d0eff66 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:36.944316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:36.946330 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:36.998283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182ffca-462d-4536-963e-08c9ca97df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:37.000474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182ffca-462d-4536-963e-08c9ca97df42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:37.000961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182ffca-462d-4536-963e-08c9ca97df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:37.001750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182ffca-462d-4536-963e-08c9ca97df42 admin admin] PATH_INFO: `/v3/users/f893402bab2e488c873d2103be5a325e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:37.003730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182ffca-462d-4536-963e-08c9ca97df42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f893402bab2e488c873d2103be5a325e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:37.007405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182ffca-462d-4536-963e-08c9ca97df42 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:37.086006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb890-4c59-48db-832c-2af5dc642cf4 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:37.098168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9ca9e-a930-487e-b374-487aecd4737d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:37.099841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9ca9e-a930-487e-b374-487aecd4737d admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:37.100318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9ca9e-a930-487e-b374-487aecd4737d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:37.101159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9ca9e-a930-487e-b374-487aecd4737d admin admin] PATH_INFO: `/v3/projects/3b247b5dbc754ee483ca3d0a5b6697af/users/9888dd95f3574c548e71898fea2b780b/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:37.105690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9ca9e-a930-487e-b374-487aecd4737d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b247b5dbc754ee483ca3d0a5b6697af, user_id=9888dd95f3574c548e71898fea2b780b, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:37.112952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9ca9e-a930-487e-b374-487aecd4737d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:37.131464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 863/1711] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:36 2022] PUT /identity/v3/projects/3b247b5dbc754ee483ca3d0a5b6697af/users/9888dd95f3574c548e71898fea2b780b/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:37.133911 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2f6d7-577c-4389-b182-d5547dd10f78 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:37.134411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2f6d7-577c-4389-b182-d5547dd10f78 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:37.134862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2f6d7-577c-4389-b182-d5547dd10f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:37.167416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-15d2f6d7-577c-4389-b182-d5547dd10f78 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:37.170383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-15d2f6d7-577c-4389-b182-d5547dd10f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:37.211196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:37.247641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e182ffca-462d-4536-963e-08c9ca97df42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f893402bab2e488c873d2103be5a325e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:37.270267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 864/1712] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:37.271265 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2f6d7-577c-4389-b182-d5547dd10f78 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:37.272698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-15d2f6d7-577c-4389-b182-d5547dd10f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:37.288322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2f6d7-577c-4389-b182-d5547dd10f78 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:37.288523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e182ffca-462d-4536-963e-08c9ca97df42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f893402bab2e488c873d2103be5a325e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:37.296364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6e56e-a9e4-4341-acfe-f12585ec6d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:37.297832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e56e-a9e4-4341-acfe-f12585ec6d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:37.298170 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e56e-a9e4-4341-acfe-f12585ec6d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:37.298449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6e56e-a9e4-4341-acfe-f12585ec6d2c admin admin] PATH_INFO: `/v3/users/566fcf4cd9de44ba94c87f7a8fba231d` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:37.300057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6e56e-a9e4-4341-acfe-f12585ec6d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=566fcf4cd9de44ba94c87f7a8fba231d)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:37.302504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6e56e-a9e4-4341-acfe-f12585ec6d2c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:37.306534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e182ffca-462d-4536-963e-08c9ca97df42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f893402bab2e488c873d2103be5a325e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:37.430428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e182ffca-462d-4536-963e-08c9ca97df42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f893402bab2e488c873d2103be5a325e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:37.431281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e182ffca-462d-4536-963e-08c9ca97df42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f893402bab2e488c873d2103be5a325e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:37.450536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 849/1713] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:36 2022] DELETE /identity/v3/users/f893402bab2e488c873d2103be5a325e => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:37.450536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c8468-63c8-4e4a-b4cd-06045af2ed56 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:37.450536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c8468-63c8-4e4a-b4cd-06045af2ed56 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:37.450536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c8468-63c8-4e4a-b4cd-06045af2ed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:37.528001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-9d2c8468-63c8-4e4a-b4cd-06045af2ed56 None None] MFA Rules not processed for user `9888dd95f3574c548e71898fea2b780b`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:37.534723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9d2c8468-63c8-4e4a-b4cd-06045af2ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:37.637756 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d8f6e56e-a9e4-4341-acfe-f12585ec6d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '566fcf4cd9de44ba94c87f7a8fba231d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:37.736164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d8f6e56e-a9e4-4341-acfe-f12585ec6d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '566fcf4cd9de44ba94c87f7a8fba231d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:37.757190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d8f6e56e-a9e4-4341-acfe-f12585ec6d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '566fcf4cd9de44ba94c87f7a8fba231d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:37.783970 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 850/1714] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:37.785141 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c8468-63c8-4e4a-b4cd-06045af2ed56 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:37.786581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9d2c8468-63c8-4e4a-b4cd-06045af2ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:37.814138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d8f6e56e-a9e4-4341-acfe-f12585ec6d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '566fcf4cd9de44ba94c87f7a8fba231d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:37.817364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d8f6e56e-a9e4-4341-acfe-f12585ec6d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '566fcf4cd9de44ba94c87f7a8fba231d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:37.851296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 865/1715] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:37 2022] DELETE /identity/v3/users/566fcf4cd9de44ba94c87f7a8fba231d => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:37.851476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6349f-ab26-48e8-b1ad-683e036a2f43 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:37.851949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6349f-ab26-48e8-b1ad-683e036a2f43 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:37.852436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6349f-ab26-48e8-b1ad-683e036a2f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:37.909155 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-71f6349f-ab26-48e8-b1ad-683e036a2f43 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:37.911590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-71f6349f-ab26-48e8-b1ad-683e036a2f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:37.993806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c8468-63c8-4e4a-b4cd-06045af2ed56 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:38.113828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 866/1716] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:38.114935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6349f-ab26-48e8-b1ad-683e036a2f43 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:38.119456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-71f6349f-ab26-48e8-b1ad-683e036a2f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:38.146445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdace81a-99a0-4b8f-9fa7-d3271f655925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:38.147338 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdace81a-99a0-4b8f-9fa7-d3271f655925 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:38.147920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdace81a-99a0-4b8f-9fa7-d3271f655925 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:38.148200 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdace81a-99a0-4b8f-9fa7-d3271f655925 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:38.148865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdace81a-99a0-4b8f-9fa7-d3271f655925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:38.149171 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdace81a-99a0-4b8f-9fa7-d3271f655925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:38.150892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdace81a-99a0-4b8f-9fa7-d3271f655925 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:38.168608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 851/1717] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:38.169664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdace81a-99a0-4b8f-9fa7-d3271f655925 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:38.176918 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cdace81a-99a0-4b8f-9fa7-d3271f655925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:38.305212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6349f-ab26-48e8-b1ad-683e036a2f43 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:38.314787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19779441-f45a-4a1d-8199-05cc2b54d100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:38.315426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779441-f45a-4a1d-8199-05cc2b54d100 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:38.315708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779441-f45a-4a1d-8199-05cc2b54d100 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:38.320944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19779441-f45a-4a1d-8199-05cc2b54d100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:38.320944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-19779441-f45a-4a1d-8199-05cc2b54d100 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:38.324872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdace81a-99a0-4b8f-9fa7-d3271f655925 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:38.333587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5175c0a-f8c3-4639-ae01-c358a14e3f4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:38.334324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5175c0a-f8c3-4639-ae01-c358a14e3f4b service placement] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:38.334686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5175c0a-f8c3-4639-ae01-c358a14e3f4b service placement] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:38.335048 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5175c0a-f8c3-4639-ae01-c358a14e3f4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:38.366457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b5175c0a-f8c3-4639-ae01-c358a14e3f4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:38.417289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5175c0a-f8c3-4639-ae01-c358a14e3f4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:38.418526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19779441-f45a-4a1d-8199-05cc2b54d100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:38.421226 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5175c0a-f8c3-4639-ae01-c358a14e3f4b service placement] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:38.422089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19779441-f45a-4a1d-8199-05cc2b54d100 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:38.451477 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:38.453746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 867/1718] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:38.460142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced23462-91d5-4adf-852b-210c4ea20048 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:38.461382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced23462-91d5-4adf-852b-210c4ea20048 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:38.462065 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced23462-91d5-4adf-852b-210c4ea20048 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:38.465313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 868/1719] 10.222.0.74 () {54 vars in 961 bytes} [Wed Aug 31 00:36:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:36:38.472240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced23462-91d5-4adf-852b-210c4ea20048 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:38.478188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ced23462-91d5-4adf-852b-210c4ea20048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:38.485327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 852/1720] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:38.486340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5175c0a-f8c3-4639-ae01-c358a14e3f4b service placement] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:38.488072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b5175c0a-f8c3-4639-ae01-c358a14e3f4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:38.543460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:38.667801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5175c0a-f8c3-4639-ae01-c358a14e3f4b service placement] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:38.678486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65745-bdf3-4a34-b5fc-a4f60d373c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:38.679200 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65745-bdf3-4a34-b5fc-a4f60d373c12 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:38.679408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65745-bdf3-4a34-b5fc-a4f60d373c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:38.679683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf65745-bdf3-4a34-b5fc-a4f60d373c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:38.683940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced23462-91d5-4adf-852b-210c4ea20048 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:38.691581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65745-bdf3-4a34-b5fc-a4f60d373c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:38.694468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf65745-bdf3-4a34-b5fc-a4f60d373c12 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:38.697724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a0546-d746-4d97-b3ea-6e76ce70546b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:38.698374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a0546-d746-4d97-b3ea-6e76ce70546b service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:38.698654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a0546-d746-4d97-b3ea-6e76ce70546b service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:38.698930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a0546-d746-4d97-b3ea-6e76ce70546b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:38.717354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-be2a0546-d746-4d97-b3ea-6e76ce70546b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:38.738158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 853/1721] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:38.738913 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65745-bdf3-4a34-b5fc-a4f60d373c12 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:38.745472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-faf65745-bdf3-4a34-b5fc-a4f60d373c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:38.799361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf65745-bdf3-4a34-b5fc-a4f60d373c12 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:38.804797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcb30a-be1f-4483-9f75-4c879ae10fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:38.805438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcb30a-be1f-4483-9f75-4c879ae10fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:38.805761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcb30a-be1f-4483-9f75-4c879ae10fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:38.806041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcb30a-be1f-4483-9f75-4c879ae10fa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:38.806694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcb30a-be1f-4483-9f75-4c879ae10fa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:38.808671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcb30a-be1f-4483-9f75-4c879ae10fa9 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:38.939934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 854/1722] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:38 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:38.943371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155babe1-9557-4de9-ab19-58450731d525 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:38.943831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155babe1-9557-4de9-ab19-58450731d525 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:38.944287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155babe1-9557-4de9-ab19-58450731d525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:38.976493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a0546-d746-4d97-b3ea-6e76ce70546b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:38.982643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a0546-d746-4d97-b3ea-6e76ce70546b service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:38.998932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:38.999730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-155babe1-9557-4de9-ab19-58450731d525 None None] MFA Rules not processed for user `5f8c004b9fe2402fbe94cfd7c2bf949e`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:39.005104 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-155babe1-9557-4de9-ab19-58450731d525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:39.014606 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 869/1723] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:39.031252 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a0546-d746-4d97-b3ea-6e76ce70546b service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:39.036545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-be2a0546-d746-4d97-b3ea-6e76ce70546b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:39.120894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a0546-d746-4d97-b3ea-6e76ce70546b service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:39.259491 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 855/1724] 10.222.0.74 () {58 vars in 1058 bytes} [Wed Aug 31 00:36:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:39.260387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155babe1-9557-4de9-ab19-58450731d525 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:39.301729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:39.302435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:39.302896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:39.303345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] PATH_INFO: `/v3/projects/a58a9b356a3d410c874c873629d0990d` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:39.305509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58a9b356a3d410c874c873629d0990d)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:39.311168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:39.385525 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155babe1-9557-4de9-ab19-58450731d525 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:39.392893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9eb7-870e-47b5-99ac-1924aa46352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:39.393712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9eb7-870e-47b5-99ac-1924aa46352f admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:39.394192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9eb7-870e-47b5-99ac-1924aa46352f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:39.395017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9eb7-870e-47b5-99ac-1924aa46352f admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:39.396266 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9eb7-870e-47b5-99ac-1924aa46352f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:39.399775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9eb7-870e-47b5-99ac-1924aa46352f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:39.508570 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58a9b356a3d410c874c873629d0990d', 'request_id': 'req-0955b238-74a6-4525-93ab-8feeea73be95'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:39.516885 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58a9b356a3d410c874c873629d0990d', 'request_id': 'req-0955b238-74a6-4525-93ab-8feeea73be95'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:39.524409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58a9b356a3d410c874c873629d0990d', 'request_id': 'req-0955b238-74a6-4525-93ab-8feeea73be95'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:39.537248 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 856/1725] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:39 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:39.540578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f541-5dfa-4ee3-93d6-d016a065b2e8 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:39.541049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f541-5dfa-4ee3-93d6-d016a065b2e8 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:39.543398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0f541-5dfa-4ee3-93d6-d016a065b2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:39.617812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] The token cache is being invalidate because project a58a9b356a3d410c874c873629d0990d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:39.618472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:39.620268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-abf0f541-5dfa-4ee3-93d6-d016a065b2e8 None None] MFA Rules not processed for user `e775b9e1dfde44a0bfe23523399f8f22`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:39.620539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:39.621688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-abf0f541-5dfa-4ee3-93d6-d016a065b2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:39.623620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 870/1726] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:39 2022] DELETE /identity/v3/projects/a58a9b356a3d410c874c873629d0990d => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:39.624935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:39.628700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:39.734758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 857/1727] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:39.734758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0f541-5dfa-4ee3-93d6-d016a065b2e8 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:39.737868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-abf0f541-5dfa-4ee3-93d6-d016a065b2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:39.797404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b238-74a6-4525-93ab-8feeea73be95 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:39.817016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971dad7-ab6b-4efb-a1ee-e132e77bd280 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:39.818308 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971dad7-ab6b-4efb-a1ee-e132e77bd280 service placement] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:39.818798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971dad7-ab6b-4efb-a1ee-e132e77bd280 service placement] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:39.821484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971dad7-ab6b-4efb-a1ee-e132e77bd280 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:39.838129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0f541-5dfa-4ee3-93d6-d016a065b2e8 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:39.842194 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7971dad7-ab6b-4efb-a1ee-e132e77bd280 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:39.848993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8720f-e2cb-48fc-9572-134cfc9dd9f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:39.849940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8720f-e2cb-48fc-9572-134cfc9dd9f2 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:39.850295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8720f-e2cb-48fc-9572-134cfc9dd9f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:39.850656 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8720f-e2cb-48fc-9572-134cfc9dd9f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:39.858405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-99e8720f-e2cb-48fc-9572-134cfc9dd9f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:39.862849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:39.883278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971dad7-ab6b-4efb-a1ee-e132e77bd280 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:39.884944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971dad7-ab6b-4efb-a1ee-e132e77bd280 service placement] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:39.905489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 871/1728] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:39.905489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971dad7-ab6b-4efb-a1ee-e132e77bd280 service placement] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:39.906024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7971dad7-ab6b-4efb-a1ee-e132e77bd280 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:40.006465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971dad7-ab6b-4efb-a1ee-e132e77bd280 service placement] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:40.014452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683cee4-8208-4fd6-9540-c120c8a1db13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:40.016057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683cee4-8208-4fd6-9540-c120c8a1db13 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:40.016817 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683cee4-8208-4fd6-9540-c120c8a1db13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:40.017484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683cee4-8208-4fd6-9540-c120c8a1db13 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:40.018763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683cee4-8208-4fd6-9540-c120c8a1db13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:40.021500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683cee4-8208-4fd6-9540-c120c8a1db13 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:40.043624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 872/1729] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:40.044455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78accb55-19df-487d-b71a-c7220eee2da3 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:40.044930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78accb55-19df-487d-b71a-c7220eee2da3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:40.045677 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78accb55-19df-487d-b71a-c7220eee2da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:40.072422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8720f-e2cb-48fc-9572-134cfc9dd9f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:40.074222 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8720f-e2cb-48fc-9572-134cfc9dd9f2 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:40.087525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-78accb55-19df-487d-b71a-c7220eee2da3 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:40.089920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-78accb55-19df-487d-b71a-c7220eee2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:40.090416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 858/1730] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:40.091479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8720f-e2cb-48fc-9572-134cfc9dd9f2 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:40.093702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-99e8720f-e2cb-48fc-9572-134cfc9dd9f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:40.113066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8720f-e2cb-48fc-9572-134cfc9dd9f2 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:40.115754 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 873/1731] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:40.117427 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78accb55-19df-487d-b71a-c7220eee2da3 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:40.127616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:40.128721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:40.129322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:40.129792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] PATH_INFO: `/v3/projects/c9f1e8bfa4d048bbbde5e585e21ff8f7` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:40.132310 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f1e8bfa4d048bbbde5e585e21ff8f7)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:40.136519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:40.141470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78accb55-19df-487d-b71a-c7220eee2da3 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:40.171718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af44b56-ac7c-4136-ae26-0c89e91a0dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:40.176475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af44b56-ac7c-4136-ae26-0c89e91a0dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:40.177074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af44b56-ac7c-4136-ae26-0c89e91a0dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:40.177915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af44b56-ac7c-4136-ae26-0c89e91a0dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:40.179023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af44b56-ac7c-4136-ae26-0c89e91a0dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:40.185382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af44b56-ac7c-4136-ae26-0c89e91a0dc1 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:40.217964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 874/1732] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:40.226798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02d3fc-1d62-4b85-9032-f3f5f68beb75 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:40.230836 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02d3fc-1d62-4b85-9032-f3f5f68beb75 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:40.230836 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02d3fc-1d62-4b85-9032-f3f5f68beb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:40.270933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-de02d3fc-1d62-4b85-9032-f3f5f68beb75 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:40.273563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-de02d3fc-1d62-4b85-9032-f3f5f68beb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:40.291956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 875/1733] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:40.293058 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02d3fc-1d62-4b85-9032-f3f5f68beb75 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:40.374869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02d3fc-1d62-4b85-9032-f3f5f68beb75 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:40.428677 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f1e8bfa4d048bbbde5e585e21ff8f7', 'request_id': 'req-de01a125-d2e0-498f-aaf3-9843a0fa42d3'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:40.550596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95298fa8-9c25-4daa-a905-469e4b78eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:40.551799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95298fa8-9c25-4daa-a905-469e4b78eeae admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:40.552399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95298fa8-9c25-4daa-a905-469e4b78eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:40.552966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95298fa8-9c25-4daa-a905-469e4b78eeae admin admin] PATH_INFO: `/v3/projects/dbd31be97a584c51a2c8579ba0369a56/users/386642a5fc2f4cb49d86e8d89a488bfe/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:40.587632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95298fa8-9c25-4daa-a905-469e4b78eeae admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd31be97a584c51a2c8579ba0369a56, user_id=386642a5fc2f4cb49d86e8d89a488bfe, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:40.590737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95298fa8-9c25-4daa-a905-469e4b78eeae admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:40.730921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f1e8bfa4d048bbbde5e585e21ff8f7', 'request_id': 'req-de01a125-d2e0-498f-aaf3-9843a0fa42d3'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:40.740074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 876/1734] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:40 2022] PUT /identity/v3/projects/dbd31be97a584c51a2c8579ba0369a56/users/386642a5fc2f4cb49d86e8d89a488bfe/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:40.741396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95298fa8-9c25-4daa-a905-469e4b78eeae admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:40.751793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f1e8bfa4d048bbbde5e585e21ff8f7', 'request_id': 'req-de01a125-d2e0-498f-aaf3-9843a0fa42d3'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:40.818449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] The token cache is being invalidate because project c9f1e8bfa4d048bbbde5e585e21ff8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:40.819009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:40.824043 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de01a125-d2e0-498f-aaf3-9843a0fa42d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:40.825997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 859/1735] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:40 2022] DELETE /identity/v3/projects/c9f1e8bfa4d048bbbde5e585e21ff8f7 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:40.838520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15982acd-30fe-4d0f-8a14-cf4e6da7bb8e None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:40.840434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15982acd-30fe-4d0f-8a14-cf4e6da7bb8e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:40.845078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15982acd-30fe-4d0f-8a14-cf4e6da7bb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:40.871390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95298fa8-9c25-4daa-a905-469e4b78eeae admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:40.880912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa09055-7491-46c8-99bd-b713e5ea719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:40.887699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa09055-7491-46c8-99bd-b713e5ea719a admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:40.888248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa09055-7491-46c8-99bd-b713e5ea719a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:40.891097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa09055-7491-46c8-99bd-b713e5ea719a admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:40.894337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa09055-7491-46c8-99bd-b713e5ea719a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:40.894337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa09055-7491-46c8-99bd-b713e5ea719a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:40.896601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa09055-7491-46c8-99bd-b713e5ea719a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:40.930805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 877/1736] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:40.931420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa09055-7491-46c8-99bd-b713e5ea719a admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:40.936383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ffa09055-7491-46c8-99bd-b713e5ea719a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:40.948528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-15982acd-30fe-4d0f-8a14-cf4e6da7bb8e None None] MFA Rules not processed for user `386642a5fc2f4cb49d86e8d89a488bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:40.948528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-15982acd-30fe-4d0f-8a14-cf4e6da7bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:40.955988 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa09055-7491-46c8-99bd-b713e5ea719a admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:40.962398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:40.963068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:40.963352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:40.963628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] PATH_INFO: `/v3/users/5f2b41d481854b44bfd452df06b1be90` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:40.965079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2b41d481854b44bfd452df06b1be90)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:40.968094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:41.102282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 860/1737] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:41.116392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15982acd-30fe-4d0f-8a14-cf4e6da7bb8e None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:41.120163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-15982acd-30fe-4d0f-8a14-cf4e6da7bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:41.143463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15982acd-30fe-4d0f-8a14-cf4e6da7bb8e None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:41.150672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5e3e6-bd1c-4646-906d-ff93371c0cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:41.152311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5e3e6-bd1c-4646-906d-ff93371c0cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:41.152452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5e3e6-bd1c-4646-906d-ff93371c0cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:41.153144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5e3e6-bd1c-4646-906d-ff93371c0cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:41.154047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5e3e6-bd1c-4646-906d-ff93371c0cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:41.156782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5e3e6-bd1c-4646-906d-ff93371c0cb0 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:41.208766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2b41d481854b44bfd452df06b1be90'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:41.302041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2b41d481854b44bfd452df06b1be90'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:41.311002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 861/1738] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:41 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:41.312469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5e3e6-bd1c-4646-906d-ff93371c0cb0 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:41.315478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a3d5e3e6-bd1c-4646-906d-ff93371c0cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:41.340127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2b41d481854b44bfd452df06b1be90'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:41.356669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2b41d481854b44bfd452df06b1be90'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:41.357816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2b41d481854b44bfd452df06b1be90'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:41.389171 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 878/1739] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:40 2022] DELETE /identity/v3/users/5f2b41d481854b44bfd452df06b1be90 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:41.390896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:41.392800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:41.563860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5e3e6-bd1c-4646-906d-ff93371c0cb0 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:41.668683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:41.686524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511bc81-b2f5-415c-8be5-e40d635e13c1 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:41.701399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6292ad0-e0a9-456f-9469-50ceec01216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:41.701399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6292ad0-e0a9-456f-9469-50ceec01216c admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:41.701399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6292ad0-e0a9-456f-9469-50ceec01216c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:41.703029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6292ad0-e0a9-456f-9469-50ceec01216c admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:41.704006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6292ad0-e0a9-456f-9469-50ceec01216c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:41.709050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6292ad0-e0a9-456f-9469-50ceec01216c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:41.743392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:41.776374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baf1c9-c9cb-40ea-ad60-09904630912d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:41.777033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf1c9-c9cb-40ea-ad60-09904630912d service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:41.777319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf1c9-c9cb-40ea-ad60-09904630912d service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:41.777608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baf1c9-c9cb-40ea-ad60-09904630912d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:41.785375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-95baf1c9-c9cb-40ea-ad60-09904630912d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:41.878375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 879/1740] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:41 2022] POST /identity/v3/users => generated 293 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:41.879744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6292ad0-e0a9-456f-9469-50ceec01216c admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:41.915487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6292ad0-e0a9-456f-9469-50ceec01216c admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:41.931966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff240b7d-c56c-46f0-b680-1f09a2a1d380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:41.932658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff240b7d-c56c-46f0-b680-1f09a2a1d380 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:41.934171 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff240b7d-c56c-46f0-b680-1f09a2a1d380 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:41.934821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff240b7d-c56c-46f0-b680-1f09a2a1d380 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:41.937680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff240b7d-c56c-46f0-b680-1f09a2a1d380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:41.942997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baf1c9-c9cb-40ea-ad60-09904630912d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:41.948196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff240b7d-c56c-46f0-b680-1f09a2a1d380 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:41.966007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baf1c9-c9cb-40ea-ad60-09904630912d service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:41.968794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 880/1741] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:36:41.972921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff240b7d-c56c-46f0-b680-1f09a2a1d380 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:41.988037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 862/1742] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:42.002907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff240b7d-c56c-46f0-b680-1f09a2a1d380 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:42.029624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f69103-4aef-4f3b-aade-cc232630fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:42.033463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f69103-4aef-4f3b-aade-cc232630fca5 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:42.035328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f69103-4aef-4f3b-aade-cc232630fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:42.035667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f69103-4aef-4f3b-aade-cc232630fca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:42.037609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f69103-4aef-4f3b-aade-cc232630fca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:42.040821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f69103-4aef-4f3b-aade-cc232630fca5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:42.099999 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baf1c9-c9cb-40ea-ad60-09904630912d service nova] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:42.102107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 881/1743] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:42.118558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baf1c9-c9cb-40ea-ad60-09904630912d service nova] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:42.129188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6b362-00cd-4053-9e35-8911862e951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:42.129740 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6b362-00cd-4053-9e35-8911862e951f admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:42.130040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6b362-00cd-4053-9e35-8911862e951f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:42.130302 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6b362-00cd-4053-9e35-8911862e951f admin admin] PATH_INFO: `/v3/projects/4068758e1f214ca284ab79cdafb3d494/users/7b526350c0734afca82dec7df9258c69/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:42.172638 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6b362-00cd-4053-9e35-8911862e951f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4068758e1f214ca284ab79cdafb3d494, user_id=7b526350c0734afca82dec7df9258c69, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:42.179818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6b362-00cd-4053-9e35-8911862e951f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:42.354245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 863/1744] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:42 2022] PUT /identity/v3/projects/4068758e1f214ca284ab79cdafb3d494/users/7b526350c0734afca82dec7df9258c69/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:36:42.364948 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6c720-c0a7-4cf0-b7c3-4f7dea41595f None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:42.366344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6c720-c0a7-4cf0-b7c3-4f7dea41595f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:42.366702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6c720-c0a7-4cf0-b7c3-4f7dea41595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:42.492503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-cdc6c720-c0a7-4cf0-b7c3-4f7dea41595f None None] MFA Rules not processed for user `7b526350c0734afca82dec7df9258c69`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:42.498067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cdc6c720-c0a7-4cf0-b7c3-4f7dea41595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:42.644330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6b362-00cd-4053-9e35-8911862e951f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:42.647714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3fc6b362-00cd-4053-9e35-8911862e951f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:42.849216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6b362-00cd-4053-9e35-8911862e951f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:42.862386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:42.864787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:42.866365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:42.884588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] PATH_INFO: `/v3/projects/286bc3c184d64592a538fb907186d977` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:42.898370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286bc3c184d64592a538fb907186d977)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:42.903279 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 882/1745] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 539 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:42.905677 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6c720-c0a7-4cf0-b7c3-4f7dea41595f None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:42.907624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cdc6c720-c0a7-4cf0-b7c3-4f7dea41595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:42.909847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:42.934869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6c720-c0a7-4cf0-b7c3-4f7dea41595f None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:42.949231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c437b-4234-4301-bf73-ce8de99b822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:42.950191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c437b-4234-4301-bf73-ce8de99b822f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:42.950797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c437b-4234-4301-bf73-ce8de99b822f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:42.951215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c437b-4234-4301-bf73-ce8de99b822f admin admin] PATH_INFO: `/v3/users/386642a5fc2f4cb49d86e8d89a488bfe` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:42.953003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c437b-4234-4301-bf73-ce8de99b822f admin admin] RBAC: Authorizing `identity:delete_user(user_id=386642a5fc2f4cb49d86e8d89a488bfe)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:42.956001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c437b-4234-4301-bf73-ce8de99b822f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:43.395358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286bc3c184d64592a538fb907186d977', 'request_id': 'req-b63e2edc-6c77-463f-8e5b-51a31817f559'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:43.417104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b52c437b-4234-4301-bf73-ce8de99b822f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386642a5fc2f4cb49d86e8d89a488bfe'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:43.536579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286bc3c184d64592a538fb907186d977', 'request_id': 'req-b63e2edc-6c77-463f-8e5b-51a31817f559'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:43.550494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286bc3c184d64592a538fb907186d977', 'request_id': 'req-b63e2edc-6c77-463f-8e5b-51a31817f559'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:43.601359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] The token cache is being invalidate because project 286bc3c184d64592a538fb907186d977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:43.618673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:43.618673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:43.618673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 864/1746] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:42 2022] DELETE /identity/v3/projects/286bc3c184d64592a538fb907186d977 => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:43.618673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:43.618673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:43.737611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e2edc-6c77-463f-8e5b-51a31817f559 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:43.745533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9e868-5db6-4672-b626-077bb9d17313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:43.747499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e868-5db6-4672-b626-077bb9d17313 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:43.747789 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e868-5db6-4672-b626-077bb9d17313 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:43.748102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9e868-5db6-4672-b626-077bb9d17313 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:43.748922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9e868-5db6-4672-b626-077bb9d17313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:43.751194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9e868-5db6-4672-b626-077bb9d17313 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:43.817306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b52c437b-4234-4301-bf73-ce8de99b822f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386642a5fc2f4cb49d86e8d89a488bfe'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:43.854224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b52c437b-4234-4301-bf73-ce8de99b822f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386642a5fc2f4cb49d86e8d89a488bfe'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:43.863683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b52c437b-4234-4301-bf73-ce8de99b822f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386642a5fc2f4cb49d86e8d89a488bfe'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:43.865335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b52c437b-4234-4301-bf73-ce8de99b822f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386642a5fc2f4cb49d86e8d89a488bfe'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:43.881143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 883/1747] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:42 2022] DELETE /identity/v3/users/386642a5fc2f4cb49d86e8d89a488bfe => generated 0 bytes in 976 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:43.883567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a35bb8-d3ac-4f1c-a40f-13ce4fec44c1 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:43.889961 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a35bb8-d3ac-4f1c-a40f-13ce4fec44c1 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:43.889961 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a35bb8-d3ac-4f1c-a40f-13ce4fec44c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:43.925537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b4a35bb8-d3ac-4f1c-a40f-13ce4fec44c1 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:43.929828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b4a35bb8-d3ac-4f1c-a40f-13ce4fec44c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:43.934342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 865/1748] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:43 2022] POST /identity/v3/projects => generated 385 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:43.936234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38505e-144f-4e63-b8f0-2471c1949763 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:43.937449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38505e-144f-4e63-b8f0-2471c1949763 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:43.937973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38505e-144f-4e63-b8f0-2471c1949763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:43.983070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ca38505e-144f-4e63-b8f0-2471c1949763 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:43.986807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ca38505e-144f-4e63-b8f0-2471c1949763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:44.041991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 884/1749] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:44.045048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a35bb8-d3ac-4f1c-a40f-13ce4fec44c1 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:44.047208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b4a35bb8-d3ac-4f1c-a40f-13ce4fec44c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:44.062295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a35bb8-d3ac-4f1c-a40f-13ce4fec44c1 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:44.072347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f5227-d81a-492a-bd69-582c78c00183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:44.072932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f5227-d81a-492a-bd69-582c78c00183 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:44.073509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f5227-d81a-492a-bd69-582c78c00183 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:44.074033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f5227-d81a-492a-bd69-582c78c00183 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:44.075443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f5227-d81a-492a-bd69-582c78c00183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:44.079424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f5227-d81a-492a-bd69-582c78c00183 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:44.128271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 866/1750] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:44.132536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf464a90-6eb5-4915-a642-7235763964d9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:44.141508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf464a90-6eb5-4915-a642-7235763964d9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:44.142046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf464a90-6eb5-4915-a642-7235763964d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:44.179894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-bf464a90-6eb5-4915-a642-7235763964d9 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:44.181526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bf464a90-6eb5-4915-a642-7235763964d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:44.239562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 867/1751] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:44.241149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf464a90-6eb5-4915-a642-7235763964d9 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:44.245771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bf464a90-6eb5-4915-a642-7235763964d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:44.284778 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 885/1752] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:44 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:44.285509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f5227-d81a-492a-bd69-582c78c00183 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:44.310257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f5227-d81a-492a-bd69-582c78c00183 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:44.330693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d293b6-de18-48c5-8c90-e55c9188fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:44.333061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d293b6-de18-48c5-8c90-e55c9188fd66 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:44.333511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d293b6-de18-48c5-8c90-e55c9188fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:44.333930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d293b6-de18-48c5-8c90-e55c9188fd66 admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:44.340840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d293b6-de18-48c5-8c90-e55c9188fd66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:44.340840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d293b6-de18-48c5-8c90-e55c9188fd66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:44.343624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d293b6-de18-48c5-8c90-e55c9188fd66 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:44.366004 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf464a90-6eb5-4915-a642-7235763964d9 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:44.370356 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8a69e-5a4e-4a05-a642-de82fc493422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:44.378333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a69e-5a4e-4a05-a642-de82fc493422 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:44.378333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a69e-5a4e-4a05-a642-de82fc493422 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:44.378333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8a69e-5a4e-4a05-a642-de82fc493422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:44.383637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 886/1753] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:44.384627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d293b6-de18-48c5-8c90-e55c9188fd66 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:44.385401 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8a69e-5a4e-4a05-a642-de82fc493422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:44.406142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8a69e-5a4e-4a05-a642-de82fc493422 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:44.415448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d293b6-de18-48c5-8c90-e55c9188fd66 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:44.429275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c49ea1-6545-455d-86cf-aaca33e1a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:44.429811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 868/1754] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:44.429953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c49ea1-6545-455d-86cf-aaca33e1a1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:44.430806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c49ea1-6545-455d-86cf-aaca33e1a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:44.431105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c49ea1-6545-455d-86cf-aaca33e1a1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:44.431264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4abc4-34bd-4543-b881-704503060b00 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:44.431556 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4abc4-34bd-4543-b881-704503060b00 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:44.431769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c49ea1-6545-455d-86cf-aaca33e1a1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:44.431878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4abc4-34bd-4543-b881-704503060b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:44.435772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c49ea1-6545-455d-86cf-aaca33e1a1e5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:44.454434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 887/1755] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:44.455655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c49ea1-6545-455d-86cf-aaca33e1a1e5 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:44.474601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c49ea1-6545-455d-86cf-aaca33e1a1e5 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:44.478847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-96d4abc4-34bd-4543-b881-704503060b00 None None] MFA Rules not processed for user `b049ee00b6404a678a010587074aba66`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:44.480486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-96d4abc4-34bd-4543-b881-704503060b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:44.485455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad48f60-cee4-4695-8915-bc83575a8118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:44.486623 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad48f60-cee4-4695-8915-bc83575a8118 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:44.488724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad48f60-cee4-4695-8915-bc83575a8118 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:44.489444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad48f60-cee4-4695-8915-bc83575a8118 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:44.494457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad48f60-cee4-4695-8915-bc83575a8118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:44.497042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad48f60-cee4-4695-8915-bc83575a8118 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:44.577052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:44.584975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 869/1756] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:44.584975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4abc4-34bd-4543-b881-704503060b00 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:44.617949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4abc4-34bd-4543-b881-704503060b00 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:44.626598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c33b7-1ab1-4f28-9571-05ca8e995ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:44.631470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c33b7-1ab1-4f28-9571-05ca8e995ded admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:44.631470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c33b7-1ab1-4f28-9571-05ca8e995ded admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:44.631470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c33b7-1ab1-4f28-9571-05ca8e995ded admin admin] PATH_INFO: `/v3/projects/32a66493a2514bb9ae9053cb07745de7/users/49fa2099c0d04e01b1d83eddcf780621/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:44.638303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 888/1757] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:44 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:44.644477 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad48f60-cee4-4695-8915-bc83575a8118 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:44.659181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c33b7-1ab1-4f28-9571-05ca8e995ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a66493a2514bb9ae9053cb07745de7, user_id=49fa2099c0d04e01b1d83eddcf780621, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:44.668163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c33b7-1ab1-4f28-9571-05ca8e995ded admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:44.873370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 870/1758] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:44 2022] PUT /identity/v3/projects/32a66493a2514bb9ae9053cb07745de7/users/49fa2099c0d04e01b1d83eddcf780621/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:44.875005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c33b7-1ab1-4f28-9571-05ca8e995ded admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:44.904390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad48f60-cee4-4695-8915-bc83575a8118 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:45.041496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce6f98-e2c7-4c7e-8cb7-4e78d8941979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:45.042584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6f98-e2c7-4c7e-8cb7-4e78d8941979 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:45.042955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6f98-e2c7-4c7e-8cb7-4e78d8941979 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:45.043313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6f98-e2c7-4c7e-8cb7-4e78d8941979 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:45.044055 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce6f98-e2c7-4c7e-8cb7-4e78d8941979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:45.052031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce6f98-e2c7-4c7e-8cb7-4e78d8941979 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:45.146548 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c33b7-1ab1-4f28-9571-05ca8e995ded admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:45.181787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f732-ba56-4bcd-9258-6c61bc0ea38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:45.182433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f732-ba56-4bcd-9258-6c61bc0ea38f admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:45.182716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f732-ba56-4bcd-9258-6c61bc0ea38f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:45.182993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f732-ba56-4bcd-9258-6c61bc0ea38f admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:45.183665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826f732-ba56-4bcd-9258-6c61bc0ea38f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:45.185463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826f732-ba56-4bcd-9258-6c61bc0ea38f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:45.198851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 871/1759] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:45.204091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f732-ba56-4bcd-9258-6c61bc0ea38f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:45.213276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 889/1760] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:44 2022] POST /identity/v3/users => generated 291 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:45.217039 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce6f98-e2c7-4c7e-8cb7-4e78d8941979 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:45.223461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f732-ba56-4bcd-9258-6c61bc0ea38f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:45.235389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce6f98-e2c7-4c7e-8cb7-4e78d8941979 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:45.241895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d65584-f9e3-472e-adab-dfae123cad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:45.242636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d65584-f9e3-472e-adab-dfae123cad7c admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:45.242928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d65584-f9e3-472e-adab-dfae123cad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:45.243210 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d65584-f9e3-472e-adab-dfae123cad7c admin admin] PATH_INFO: `/v3/projects/32a66493a2514bb9ae9053cb07745de7/users/49fa2099c0d04e01b1d83eddcf780621/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:45.245365 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1f402-6acd-4a4b-8c5b-af2422c88474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:45.245829 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1f402-6acd-4a4b-8c5b-af2422c88474 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:45.245917 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1f402-6acd-4a4b-8c5b-af2422c88474 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:45.246157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1f402-6acd-4a4b-8c5b-af2422c88474 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:45.246992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1f402-6acd-4a4b-8c5b-af2422c88474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:45.248161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d65584-f9e3-472e-adab-dfae123cad7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a66493a2514bb9ae9053cb07745de7, user_id=49fa2099c0d04e01b1d83eddcf780621, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:45.248704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1f402-6acd-4a4b-8c5b-af2422c88474 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:45.250883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d65584-f9e3-472e-adab-dfae123cad7c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:45.275930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 890/1761] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:36:45.276151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 872/1762] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:45 2022] PUT /identity/v3/projects/32a66493a2514bb9ae9053cb07745de7/users/49fa2099c0d04e01b1d83eddcf780621/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:45.307764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1f402-6acd-4a4b-8c5b-af2422c88474 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:45.315023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176eade-82fb-48c7-9d2b-126563ebfd86 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:45.328193 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176eade-82fb-48c7-9d2b-126563ebfd86 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:45.328476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176eade-82fb-48c7-9d2b-126563ebfd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:45.380324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1f402-6acd-4a4b-8c5b-af2422c88474 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:45.442365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-e176eade-82fb-48c7-9d2b-126563ebfd86 None None] MFA Rules not processed for user `49fa2099c0d04e01b1d83eddcf780621`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:45.445998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e176eade-82fb-48c7-9d2b-126563ebfd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:45.616192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcfef9-450a-43fe-9178-7059199ff9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:45.616837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcfef9-450a-43fe-9178-7059199ff9eb admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:45.617124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcfef9-450a-43fe-9178-7059199ff9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:45.617421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcfef9-450a-43fe-9178-7059199ff9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:45.619241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcfef9-450a-43fe-9178-7059199ff9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:45.622507 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcfef9-450a-43fe-9178-7059199ff9eb admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:45.646780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 891/1763] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:45.657682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcfef9-450a-43fe-9178-7059199ff9eb admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:45.671717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcfef9-450a-43fe-9178-7059199ff9eb admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:45.680702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a739e-32ec-4bcc-be92-78dd398b94f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:45.681606 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a739e-32ec-4bcc-be92-78dd398b94f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:45.682055 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a739e-32ec-4bcc-be92-78dd398b94f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:45.682864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a739e-32ec-4bcc-be92-78dd398b94f8 admin admin] PATH_INFO: `/v3/projects/0474798a13b6481b9d15339f4c34a873/users/5d8e06dbf936470f8fc6f3dabc2c26f9/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:45.699660 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 873/1764] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:45.711826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176eade-82fb-48c7-9d2b-126563ebfd86 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:45.713677 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e176eade-82fb-48c7-9d2b-126563ebfd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:45.767554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a739e-32ec-4bcc-be92-78dd398b94f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0474798a13b6481b9d15339f4c34a873, user_id=5d8e06dbf936470f8fc6f3dabc2c26f9, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:45.770679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a739e-32ec-4bcc-be92-78dd398b94f8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:45.829999 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176eade-82fb-48c7-9d2b-126563ebfd86 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:45.834795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27b7c0-e125-4058-87d3-7d072e9ab8f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:45.835648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27b7c0-e125-4058-87d3-7d072e9ab8f9 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:45.835932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27b7c0-e125-4058-87d3-7d072e9ab8f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:45.836630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27b7c0-e125-4058-87d3-7d072e9ab8f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:45.848755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27b7c0-e125-4058-87d3-7d072e9ab8f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:45.849990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27b7c0-e125-4058-87d3-7d072e9ab8f9 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:45.864477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 874/1765] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:36:45.871768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94528ff-7840-42b9-a9e2-2d908ebda7f9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:45.871768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94528ff-7840-42b9-a9e2-2d908ebda7f9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:45.872229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94528ff-7840-42b9-a9e2-2d908ebda7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:46.037965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f94528ff-7840-42b9-a9e2-2d908ebda7f9 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:46.040395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f94528ff-7840-42b9-a9e2-2d908ebda7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:46.117443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 892/1766] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:45 2022] PUT /identity/v3/projects/0474798a13b6481b9d15339f4c34a873/users/5d8e06dbf936470f8fc6f3dabc2c26f9/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:36:46.129188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a739e-32ec-4bcc-be92-78dd398b94f8 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:46.207472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:46.211262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 875/1767] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:36:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:46.215871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94528ff-7840-42b9-a9e2-2d908ebda7f9 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:46.222424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f94528ff-7840-42b9-a9e2-2d908ebda7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:46.271373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94528ff-7840-42b9-a9e2-2d908ebda7f9 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:46.298889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a739e-32ec-4bcc-be92-78dd398b94f8 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:46.306130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4756cc0-4e53-4b9b-88b0-5abb395025ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:46.307168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756cc0-4e53-4b9b-88b0-5abb395025ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:46.307671 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756cc0-4e53-4b9b-88b0-5abb395025ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:46.308133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4756cc0-4e53-4b9b-88b0-5abb395025ee admin admin] PATH_INFO: `/v3/users/7b526350c0734afca82dec7df9258c69` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:46.309674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4756cc0-4e53-4b9b-88b0-5abb395025ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b526350c0734afca82dec7df9258c69)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:46.313918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4756cc0-4e53-4b9b-88b0-5abb395025ee admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:46.402477 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:46.407310 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:46.407902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:46.408746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] PATH_INFO: `/v3/projects/dbd31be97a584c51a2c8579ba0369a56` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:46.410435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd31be97a584c51a2c8579ba0369a56)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:46.413168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:46.944347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd31be97a584c51a2c8579ba0369a56', 'request_id': 'req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:46.959360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d4756cc0-4e53-4b9b-88b0-5abb395025ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b526350c0734afca82dec7df9258c69'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:47.230880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd31be97a584c51a2c8579ba0369a56', 'request_id': 'req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:47.239163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd31be97a584c51a2c8579ba0369a56', 'request_id': 'req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:47.266807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] The token cache is being invalidate because project dbd31be97a584c51a2c8579ba0369a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:47.266807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:47.268046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-6c2c2228-8dfb-4769-97d2-aa29bd2f6400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:47.349121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 876/1768] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:46 2022] DELETE /identity/v3/projects/dbd31be97a584c51a2c8579ba0369a56 => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:47.349121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77585-fd2f-4231-bc86-a12548cf22c7 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:47.349121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77585-fd2f-4231-bc86-a12548cf22c7 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:47.349121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a77585-fd2f-4231-bc86-a12548cf22c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:47.349121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-27a77585-fd2f-4231-bc86-a12548cf22c7 None None] MFA Rules not processed for user `5d8e06dbf936470f8fc6f3dabc2c26f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:47.349121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-27a77585-fd2f-4231-bc86-a12548cf22c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:47.489427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 877/1769] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:47.492092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77585-fd2f-4231-bc86-a12548cf22c7 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:47.494821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-27a77585-fd2f-4231-bc86-a12548cf22c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:47.558251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d4756cc0-4e53-4b9b-88b0-5abb395025ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b526350c0734afca82dec7df9258c69'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:47.621871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d4756cc0-4e53-4b9b-88b0-5abb395025ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b526350c0734afca82dec7df9258c69'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:47.650233 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d4756cc0-4e53-4b9b-88b0-5abb395025ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b526350c0734afca82dec7df9258c69'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:47.650889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d4756cc0-4e53-4b9b-88b0-5abb395025ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b526350c0734afca82dec7df9258c69'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:47.665869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 893/1770] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:46 2022] DELETE /identity/v3/users/7b526350c0734afca82dec7df9258c69 => generated 0 bytes in 1545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:47.665869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f37d71-9ffb-4e0c-a781-b59a37d1a0f9 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:47.665869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f37d71-9ffb-4e0c-a781-b59a37d1a0f9 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:47.665869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f37d71-9ffb-4e0c-a781-b59a37d1a0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:47.711560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-a9f37d71-9ffb-4e0c-a781-b59a37d1a0f9 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:47.713087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a9f37d71-9ffb-4e0c-a781-b59a37d1a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:47.747298 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a77585-fd2f-4231-bc86-a12548cf22c7 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:47.847467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 894/1771] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:47.847467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f37d71-9ffb-4e0c-a781-b59a37d1a0f9 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:47.847467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a9f37d71-9ffb-4e0c-a781-b59a37d1a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:47.866509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f37d71-9ffb-4e0c-a781-b59a37d1a0f9 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:47.876250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348548e-c0fb-452d-a790-e1eecbb7755e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:47.877221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348548e-c0fb-452d-a790-e1eecbb7755e service swift] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:47.877221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348548e-c0fb-452d-a790-e1eecbb7755e service swift] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:47.877423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348548e-c0fb-452d-a790-e1eecbb7755e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:47.880220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e348548e-c0fb-452d-a790-e1eecbb7755e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:47.884546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4581d1b-6c02-45af-8591-d16b888b2d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:47.885208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581d1b-6c02-45af-8591-d16b888b2d57 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:47.885487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581d1b-6c02-45af-8591-d16b888b2d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:47.885814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581d1b-6c02-45af-8591-d16b888b2d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:47.886474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4581d1b-6c02-45af-8591-d16b888b2d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:47.888440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4581d1b-6c02-45af-8591-d16b888b2d57 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:47.984387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348548e-c0fb-452d-a790-e1eecbb7755e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:47.989539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348548e-c0fb-452d-a790-e1eecbb7755e service swift] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:48.011110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 878/1772] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:36:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:36:48.012731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb241722-27f2-40b3-88d1-febfeeffdd28 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:48.014147 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb241722-27f2-40b3-88d1-febfeeffdd28 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:48.014147 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb241722-27f2-40b3-88d1-febfeeffdd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:48.040372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 895/1773] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:47 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:48.042036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b0879-0f96-4cc4-a4b9-27c6f31aa7bf None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:48.042467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b0879-0f96-4cc4-a4b9-27c6f31aa7bf None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:48.042901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b0879-0f96-4cc4-a4b9-27c6f31aa7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:48.107515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0c4b0879-0f96-4cc4-a4b9-27c6f31aa7bf None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:48.110241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0c4b0879-0f96-4cc4-a4b9-27c6f31aa7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:48.125492 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-bb241722-27f2-40b3-88d1-febfeeffdd28 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:48.127062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bb241722-27f2-40b3-88d1-febfeeffdd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:48.320591 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 896/1774] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:48.321749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b0879-0f96-4cc4-a4b9-27c6f31aa7bf None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:48.335840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b0879-0f96-4cc4-a4b9-27c6f31aa7bf None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:48.352737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fcb6b-7a60-4378-978f-1a79c7e9d4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:48.352737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fcb6b-7a60-4378-978f-1a79c7e9d4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:48.352737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fcb6b-7a60-4378-978f-1a79c7e9d4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:48.352737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fcb6b-7a60-4378-978f-1a79c7e9d4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:48.353168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fcb6b-7a60-4378-978f-1a79c7e9d4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:48.366621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fcb6b-7a60-4378-978f-1a79c7e9d4e0 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:48.385738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 879/1775] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:48.387275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c227c6-f5dd-4c58-9b83-5a28785fdc39 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:48.387572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c227c6-f5dd-4c58-9b83-5a28785fdc39 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:48.387894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c227c6-f5dd-4c58-9b83-5a28785fdc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:48.469435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-49c227c6-f5dd-4c58-9b83-5a28785fdc39 None None] MFA Rules not processed for user `6f5149b369e34afca6dd41a0082701e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:48.474989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-49c227c6-f5dd-4c58-9b83-5a28785fdc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:48.606672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 880/1776] 10.222.0.78 () {58 vars in 1015 bytes} [Wed Aug 31 00:36:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:48.608699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c227c6-f5dd-4c58-9b83-5a28785fdc39 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:48.625782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c227c6-f5dd-4c58-9b83-5a28785fdc39 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:48.632759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cb0c5-1c13-455b-82ce-46213be4fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:48.633422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cb0c5-1c13-455b-82ce-46213be4fc26 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:48.633775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cb0c5-1c13-455b-82ce-46213be4fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:48.634057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cb0c5-1c13-455b-82ce-46213be4fc26 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:48.634862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cb0c5-1c13-455b-82ce-46213be4fc26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:48.635210 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cb0c5-1c13-455b-82ce-46213be4fc26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:48.637146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cb0c5-1c13-455b-82ce-46213be4fc26 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:48.656304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 881/1777] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:48.656304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cb0c5-1c13-455b-82ce-46213be4fc26 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:48.664388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-af3cb0c5-1c13-455b-82ce-46213be4fc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:48.676753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cb0c5-1c13-455b-82ce-46213be4fc26 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:48.682634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d239ef-30a9-4bdf-93fa-92f4cd47d83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:48.699005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d239ef-30a9-4bdf-93fa-92f4cd47d83d service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:48.699329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d239ef-30a9-4bdf-93fa-92f4cd47d83d service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:48.699793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d239ef-30a9-4bdf-93fa-92f4cd47d83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:48.724366 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d239ef-30a9-4bdf-93fa-92f4cd47d83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:48.726470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d239ef-30a9-4bdf-93fa-92f4cd47d83d service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:48.743884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 882/1778] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:48.760840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d239ef-30a9-4bdf-93fa-92f4cd47d83d service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:48.760840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-53d239ef-30a9-4bdf-93fa-92f4cd47d83d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:48.762359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d239ef-30a9-4bdf-93fa-92f4cd47d83d service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:48.767659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6670d-a112-4f9c-a06e-33ba418794b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:48.768352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6670d-a112-4f9c-a06e-33ba418794b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:48.768650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6670d-a112-4f9c-a06e-33ba418794b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:48.768928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6670d-a112-4f9c-a06e-33ba418794b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:48.778091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6670d-a112-4f9c-a06e-33ba418794b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:48.781722 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6670d-a112-4f9c-a06e-33ba418794b1 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:48.806388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 883/1779] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:48.808024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6670d-a112-4f9c-a06e-33ba418794b1 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:48.841904 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 897/1780] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:48 2022] POST /identity/v3/users => generated 297 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:48.846586 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fcb6b-7a60-4378-978f-1a79c7e9d4e0 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:48.877087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fcb6b-7a60-4378-978f-1a79c7e9d4e0 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:48.895870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6670d-a112-4f9c-a06e-33ba418794b1 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:48.906221 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dfa31-c03b-4a7f-9312-aaa7d601402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:48.908213 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dfa31-c03b-4a7f-9312-aaa7d601402e admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:48.910763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dfa31-c03b-4a7f-9312-aaa7d601402e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:48.911621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dfa31-c03b-4a7f-9312-aaa7d601402e admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:48.914507 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dfa31-c03b-4a7f-9312-aaa7d601402e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:48.919199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dfa31-c03b-4a7f-9312-aaa7d601402e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:48.922083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d6e08-d019-4db7-8a4f-d81727db0645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:48.922816 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6e08-d019-4db7-8a4f-d81727db0645 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:48.923103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6e08-d019-4db7-8a4f-d81727db0645 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:48.923491 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d6e08-d019-4db7-8a4f-d81727db0645 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:48.924064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d6e08-d019-4db7-8a4f-d81727db0645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:48.926158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d6e08-d019-4db7-8a4f-d81727db0645 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:49.012377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 898/1781] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:49.018647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dfa31-c03b-4a7f-9312-aaa7d601402e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:49.096679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dfa31-c03b-4a7f-9312-aaa7d601402e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:49.130111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe139e7-0fba-432f-a5ec-b7077879fdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:49.130934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe139e7-0fba-432f-a5ec-b7077879fdfa admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:49.135244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe139e7-0fba-432f-a5ec-b7077879fdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:49.135719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe139e7-0fba-432f-a5ec-b7077879fdfa admin admin] PATH_INFO: `/v3/projects/619d48935efe470495b12c3ecb1c69d5/users/70865f1ad7334c248cc87bdac325f2f1/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:49.192683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe139e7-0fba-432f-a5ec-b7077879fdfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=619d48935efe470495b12c3ecb1c69d5, user_id=70865f1ad7334c248cc87bdac325f2f1, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:49.198903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe139e7-0fba-432f-a5ec-b7077879fdfa admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:49.205850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 884/1782] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:48 2022] POST /identity/v3/projects => generated 405 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:49.206862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d6e08-d019-4db7-8a4f-d81727db0645 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:49.371514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 899/1783] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:49 2022] PUT /identity/v3/projects/619d48935efe470495b12c3ecb1c69d5/users/70865f1ad7334c248cc87bdac325f2f1/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:49.372417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe139e7-0fba-432f-a5ec-b7077879fdfa admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:49.379880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-abe139e7-0fba-432f-a5ec-b7077879fdfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:49.390569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d6e08-d019-4db7-8a4f-d81727db0645 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:49.564388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b1ae4-d299-433f-a191-e7a4d668c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:49.565538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1ae4-d299-433f-a191-e7a4d668c135 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:49.566224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1ae4-d299-433f-a191-e7a4d668c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:49.566361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b1ae4-d299-433f-a191-e7a4d668c135 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:49.567260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b1ae4-d299-433f-a191-e7a4d668c135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:49.574647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b1ae4-d299-433f-a191-e7a4d668c135 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:49.629684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe139e7-0fba-432f-a5ec-b7077879fdfa admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:49.635756 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5d624-ad0e-4767-8ec4-e3bbe3d6cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:49.636559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5d624-ad0e-4767-8ec4-e3bbe3d6cb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:49.636960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5d624-ad0e-4767-8ec4-e3bbe3d6cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:49.637379 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5d624-ad0e-4767-8ec4-e3bbe3d6cb77 admin admin] PATH_INFO: `/v3/users/43ce47dbd28747669ddcd626fa2cfacc` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:49.638722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5d624-ad0e-4767-8ec4-e3bbe3d6cb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ce47dbd28747669ddcd626fa2cfacc)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:49.642202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5d624-ad0e-4767-8ec4-e3bbe3d6cb77 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:49.753673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 885/1784] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:49 2022] POST /identity/v3/users => generated 303 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:49.754620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b1ae4-d299-433f-a191-e7a4d668c135 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:49.801948 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b1ae4-d299-433f-a191-e7a4d668c135 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:49.818420 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa887e-b8c7-4ea7-a282-58c0339ecdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:49.819068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa887e-b8c7-4ea7-a282-58c0339ecdce admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:49.819353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa887e-b8c7-4ea7-a282-58c0339ecdce admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:49.819673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa887e-b8c7-4ea7-a282-58c0339ecdce admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:49.820434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa887e-b8c7-4ea7-a282-58c0339ecdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:49.822503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa887e-b8c7-4ea7-a282-58c0339ecdce admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:49.858072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 886/1785] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:49.863021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa887e-b8c7-4ea7-a282-58c0339ecdce admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:49.887758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa887e-b8c7-4ea7-a282-58c0339ecdce admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:49.895769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3674-707d-4b2e-8d79-f4cbb5f8dfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:49.896665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3674-707d-4b2e-8d79-f4cbb5f8dfab admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:49.896955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3674-707d-4b2e-8d79-f4cbb5f8dfab admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:49.897423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee3674-707d-4b2e-8d79-f4cbb5f8dfab admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:49.898166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee3674-707d-4b2e-8d79-f4cbb5f8dfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:49.901455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee3674-707d-4b2e-8d79-f4cbb5f8dfab admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:49.984607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e1e5d624-ad0e-4767-8ec4-e3bbe3d6cb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ce47dbd28747669ddcd626fa2cfacc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:49.986682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 887/1786] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:49.989087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3674-707d-4b2e-8d79-f4cbb5f8dfab admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:50.019789 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee3674-707d-4b2e-8d79-f4cbb5f8dfab admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:50.027216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec13b2-00c3-40fa-ae1e-9a73385c0433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:50.027981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec13b2-00c3-40fa-ae1e-9a73385c0433 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:50.028598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec13b2-00c3-40fa-ae1e-9a73385c0433 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:50.029493 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec13b2-00c3-40fa-ae1e-9a73385c0433 admin admin] PATH_INFO: `/v3/projects/619d48935efe470495b12c3ecb1c69d5/users/70865f1ad7334c248cc87bdac325f2f1/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:50.034327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec13b2-00c3-40fa-ae1e-9a73385c0433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619d48935efe470495b12c3ecb1c69d5, user_id=70865f1ad7334c248cc87bdac325f2f1, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:50.070557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec13b2-00c3-40fa-ae1e-9a73385c0433 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:50.122196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 888/1787] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:49 2022] PUT /identity/v3/projects/619d48935efe470495b12c3ecb1c69d5/users/70865f1ad7334c248cc87bdac325f2f1/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:50.127295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e1e5d624-ad0e-4767-8ec4-e3bbe3d6cb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ce47dbd28747669ddcd626fa2cfacc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:50.153987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec13b2-00c3-40fa-ae1e-9a73385c0433 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:50.179931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e1e5d624-ad0e-4767-8ec4-e3bbe3d6cb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ce47dbd28747669ddcd626fa2cfacc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:50.223188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e1e5d624-ad0e-4767-8ec4-e3bbe3d6cb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ce47dbd28747669ddcd626fa2cfacc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:50.249349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e1e5d624-ad0e-4767-8ec4-e3bbe3d6cb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ce47dbd28747669ddcd626fa2cfacc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:50.249349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 900/1788] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:49 2022] DELETE /identity/v3/users/43ce47dbd28747669ddcd626fa2cfacc => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:50.249349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5aedf-caf4-47a5-9e20-cd52e663dfb7 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:50.249349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5aedf-caf4-47a5-9e20-cd52e663dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:50.249349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5aedf-caf4-47a5-9e20-cd52e663dfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:50.338952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-13a5aedf-caf4-47a5-9e20-cd52e663dfb7 None None] MFA Rules not processed for user `70865f1ad7334c248cc87bdac325f2f1`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:50.344192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-13a5aedf-caf4-47a5-9e20-cd52e663dfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:50.429106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec13b2-00c3-40fa-ae1e-9a73385c0433 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:50.549151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4ae9b-098c-4ab5-bf52-43fd76b61acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:50.549840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4ae9b-098c-4ab5-bf52-43fd76b61acc admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:50.550122 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4ae9b-098c-4ab5-bf52-43fd76b61acc admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:50.550393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4ae9b-098c-4ab5-bf52-43fd76b61acc admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:50.551058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4ae9b-098c-4ab5-bf52-43fd76b61acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:50.552957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a4ae9b-098c-4ab5-bf52-43fd76b61acc admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:50.568873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 889/1789] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:50.570364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1093f-cf7e-41db-9b7c-f1ee4cab826c None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:50.570619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1093f-cf7e-41db-9b7c-f1ee4cab826c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:50.571035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1093f-cf7e-41db-9b7c-f1ee4cab826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:50.575752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 901/1790] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:50.582747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5aedf-caf4-47a5-9e20-cd52e663dfb7 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:50.584228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-13a5aedf-caf4-47a5-9e20-cd52e663dfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:50.606104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5aedf-caf4-47a5-9e20-cd52e663dfb7 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:50.607585 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-71a1093f-cf7e-41db-9b7c-f1ee4cab826c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:50.610326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-71a1093f-cf7e-41db-9b7c-f1ee4cab826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:50.622449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 890/1791] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:50.624486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1093f-cf7e-41db-9b7c-f1ee4cab826c None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:50.626476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-71a1093f-cf7e-41db-9b7c-f1ee4cab826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:50.641166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa2e2e-0711-426e-884b-3c3c5044c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:50.654449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa2e2e-0711-426e-884b-3c3c5044c75e admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:50.654449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa2e2e-0711-426e-884b-3c3c5044c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:50.654449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa2e2e-0711-426e-884b-3c3c5044c75e admin admin] PATH_INFO: `/v3/projects/e00525fa0071460ebe79ef0d117f256b/users/a5533df14c43400f8a8f02b2d511896b/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:50.666143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa2e2e-0711-426e-884b-3c3c5044c75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00525fa0071460ebe79ef0d117f256b, user_id=a5533df14c43400f8a8f02b2d511896b, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:50.669418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa2e2e-0711-426e-884b-3c3c5044c75e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:50.734830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1093f-cf7e-41db-9b7c-f1ee4cab826c None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:50.747221 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e2f29-2bd0-412f-ad51-79b770b76cf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:50.748164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e2f29-2bd0-412f-ad51-79b770b76cf1 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:50.749518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e2f29-2bd0-412f-ad51-79b770b76cf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:50.750045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e2f29-2bd0-412f-ad51-79b770b76cf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:50.768632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e2f29-2bd0-412f-ad51-79b770b76cf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:50.770978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e2f29-2bd0-412f-ad51-79b770b76cf1 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:50.786119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 891/1792] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:50.786119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e2f29-2bd0-412f-ad51-79b770b76cf1 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:50.794894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7c6e2f29-2bd0-412f-ad51-79b770b76cf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:50.877907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 902/1793] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:50 2022] PUT /identity/v3/projects/e00525fa0071460ebe79ef0d117f256b/users/a5533df14c43400f8a8f02b2d511896b/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:50.891990 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb198940-6315-45f3-9fe2-8b3fd331a93d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:50.892343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb198940-6315-45f3-9fe2-8b3fd331a93d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:50.892634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb198940-6315-45f3-9fe2-8b3fd331a93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:50.994722 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e2f29-2bd0-412f-ad51-79b770b76cf1 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:51.051723 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-bb198940-6315-45f3-9fe2-8b3fd331a93d None None] MFA Rules not processed for user `a5533df14c43400f8a8f02b2d511896b`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:51.061351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bb198940-6315-45f3-9fe2-8b3fd331a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:51.081375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a9e2d-fc6b-4cdf-9ced-e1bd1b7884c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:51.082344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9e2d-fc6b-4cdf-9ced-e1bd1b7884c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:51.082540 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9e2d-fc6b-4cdf-9ced-e1bd1b7884c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:51.082880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a9e2d-fc6b-4cdf-9ced-e1bd1b7884c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:51.203770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 903/1794] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:51.205154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb198940-6315-45f3-9fe2-8b3fd331a93d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:51.207231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bb198940-6315-45f3-9fe2-8b3fd331a93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:51.257314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a9e2d-fc6b-4cdf-9ced-e1bd1b7884c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:51.258912 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a9e2d-fc6b-4cdf-9ced-e1bd1b7884c4 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:51.289325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:51.295629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 892/1795] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:51.295629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a9e2d-fc6b-4cdf-9ced-e1bd1b7884c4 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:51.305892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a9e2d-fc6b-4cdf-9ced-e1bd1b7884c4 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:51.318584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4855acd-a958-4e85-b6d9-99fbb374b36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:51.319363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4855acd-a958-4e85-b6d9-99fbb374b36f admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:51.319652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4855acd-a958-4e85-b6d9-99fbb374b36f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:51.320003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4855acd-a958-4e85-b6d9-99fbb374b36f admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:51.320665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4855acd-a958-4e85-b6d9-99fbb374b36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:51.323143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4855acd-a958-4e85-b6d9-99fbb374b36f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:51.379387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:51.442105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb198940-6315-45f3-9fe2-8b3fd331a93d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:51.455500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:51.456211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:51.456553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:51.456899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] PATH_INFO: `/v3/projects/4068758e1f214ca284ab79cdafb3d494` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:51.462563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4068758e1f214ca284ab79cdafb3d494)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:51.464840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:51.543037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 893/1796] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:51 2022] POST /identity/v3/projects => generated 405 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:51.544128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4855acd-a958-4e85-b6d9-99fbb374b36f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:51.739847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4068758e1f214ca284ab79cdafb3d494', 'request_id': 'req-823659f4-94d5-4436-9351-2aa7eab9b99d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:51.771902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4068758e1f214ca284ab79cdafb3d494', 'request_id': 'req-823659f4-94d5-4436-9351-2aa7eab9b99d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:51.801682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4855acd-a958-4e85-b6d9-99fbb374b36f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:51.805016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4068758e1f214ca284ab79cdafb3d494', 'request_id': 'req-823659f4-94d5-4436-9351-2aa7eab9b99d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:51.928821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] The token cache is being invalidate because project 4068758e1f214ca284ab79cdafb3d494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:51.929121 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:51.929845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:51.931566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 904/1797] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:51 2022] DELETE /identity/v3/projects/4068758e1f214ca284ab79cdafb3d494 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:51.936838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:51.948985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:52.026595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb9408-9a1a-4876-a9ff-236e0b63b6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:52.027710 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb9408-9a1a-4876-a9ff-236e0b63b6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:52.028211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb9408-9a1a-4876-a9ff-236e0b63b6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:52.029322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb9408-9a1a-4876-a9ff-236e0b63b6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:52.038657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb9408-9a1a-4876-a9ff-236e0b63b6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:52.042615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb9408-9a1a-4876-a9ff-236e0b63b6c8 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:52.155290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823659f4-94d5-4436-9351-2aa7eab9b99d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:52.166256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:52.167533 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:52.168044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:52.172544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] PATH_INFO: `/v3/users/49fa2099c0d04e01b1d83eddcf780621` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:52.187165 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49fa2099c0d04e01b1d83eddcf780621)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:52.191179 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:52.199160 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 894/1798] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:51 2022] POST /identity/v3/users => generated 309 bytes in 656 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:52.204062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb9408-9a1a-4876-a9ff-236e0b63b6c8 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:52.206986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-79cb9408-9a1a-4876-a9ff-236e0b63b6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:52.278143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb9408-9a1a-4876-a9ff-236e0b63b6c8 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:52.322248 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465fca4-20a6-491c-910c-6abcdf460469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:52.323034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465fca4-20a6-491c-910c-6abcdf460469 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:52.324709 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465fca4-20a6-491c-910c-6abcdf460469 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:52.325115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465fca4-20a6-491c-910c-6abcdf460469 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:52.327277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465fca4-20a6-491c-910c-6abcdf460469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:52.341013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465fca4-20a6-491c-910c-6abcdf460469 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:52.375072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 895/1799] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:52.376224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465fca4-20a6-491c-910c-6abcdf460469 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:52.383634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7465fca4-20a6-491c-910c-6abcdf460469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:52.401373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465fca4-20a6-491c-910c-6abcdf460469 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:52.409598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdaaca4-e96a-4d1c-9642-9cc3f032ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:52.410428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaaca4-e96a-4d1c-9642-9cc3f032ca4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:52.410815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaaca4-e96a-4d1c-9642-9cc3f032ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:52.411527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdaaca4-e96a-4d1c-9642-9cc3f032ca4f admin admin] PATH_INFO: `/v3/users/5d8e06dbf936470f8fc6f3dabc2c26f9` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:52.412568 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdaaca4-e96a-4d1c-9642-9cc3f032ca4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8e06dbf936470f8fc6f3dabc2c26f9)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:52.415310 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdaaca4-e96a-4d1c-9642-9cc3f032ca4f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:52.617668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49fa2099c0d04e01b1d83eddcf780621'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:52.759505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49fa2099c0d04e01b1d83eddcf780621'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:52.817087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49fa2099c0d04e01b1d83eddcf780621'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:52.857062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-dcdaaca4-e96a-4d1c-9642-9cc3f032ca4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8e06dbf936470f8fc6f3dabc2c26f9'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:52.866612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49fa2099c0d04e01b1d83eddcf780621'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:52.867884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49fa2099c0d04e01b1d83eddcf780621'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:52.909420 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-dcdaaca4-e96a-4d1c-9642-9cc3f032ca4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8e06dbf936470f8fc6f3dabc2c26f9'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:52.912517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 905/1800] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:51 2022] DELETE /identity/v3/users/49fa2099c0d04e01b1d83eddcf780621 => generated 0 bytes in 976 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:52.914305 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:52.915777 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:52.925009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-dcdaaca4-e96a-4d1c-9642-9cc3f032ca4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8e06dbf936470f8fc6f3dabc2c26f9'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:53.055826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-dcdaaca4-e96a-4d1c-9642-9cc3f032ca4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8e06dbf936470f8fc6f3dabc2c26f9'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:53.056612 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-dcdaaca4-e96a-4d1c-9642-9cc3f032ca4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8e06dbf936470f8fc6f3dabc2c26f9'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:53.073305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 896/1801] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:52 2022] DELETE /identity/v3/users/5d8e06dbf936470f8fc6f3dabc2c26f9 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:53.074890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd5391-6ddf-4bf5-8f18-f41f07ef3c78 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:53.075412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd5391-6ddf-4bf5-8f18-f41f07ef3c78 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:53.076146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd5391-6ddf-4bf5-8f18-f41f07ef3c78 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:53.078905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 897/1802] 10.222.0.74 () {54 vars in 921 bytes} [Wed Aug 31 00:36:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:36:53.080403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229c64e-e3a5-4c04-a13e-a96e2a844585 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:53.081043 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229c64e-e3a5-4c04-a13e-a96e2a844585 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:53.081827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229c64e-e3a5-4c04-a13e-a96e2a844585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:53.106186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2229c64e-e3a5-4c04-a13e-a96e2a844585 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:53.108840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2229c64e-e3a5-4c04-a13e-a96e2a844585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:53.125215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02942a5b-86f2-43f9-930a-d044e1106371 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:53.223387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 898/1803] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:53.225563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5565a5-10db-4ff8-8b49-622ac8e466fa None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:53.226014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5565a5-10db-4ff8-8b49-622ac8e466fa None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:53.226426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5565a5-10db-4ff8-8b49-622ac8e466fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:53.247356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64d068-d9ea-4682-99a8-4318d79955df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:53.249122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64d068-d9ea-4682-99a8-4318d79955df admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:53.249676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64d068-d9ea-4682-99a8-4318d79955df admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:53.250129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64d068-d9ea-4682-99a8-4318d79955df admin admin] PATH_INFO: `/v3/projects/4de907c7798a42b394ce5eb5d2b544df/users/f3d02f845e854c569bcc077f492cbf37/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:53.252350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-cb5565a5-10db-4ff8-8b49-622ac8e466fa None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:53.254291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cb5565a5-10db-4ff8-8b49-622ac8e466fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:53.277393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64d068-d9ea-4682-99a8-4318d79955df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de907c7798a42b394ce5eb5d2b544df, user_id=f3d02f845e854c569bcc077f492cbf37, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:53.282953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64d068-d9ea-4682-99a8-4318d79955df admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:53.353009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 899/1804] 10.222.0.74 () {58 vars in 1018 bytes} [Wed Aug 31 00:36:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:53.356081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5565a5-10db-4ff8-8b49-622ac8e466fa None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:53.357914 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cb5565a5-10db-4ff8-8b49-622ac8e466fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:53.398389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 906/1805] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:52 2022] PUT /identity/v3/projects/4de907c7798a42b394ce5eb5d2b544df/users/f3d02f845e854c569bcc077f492cbf37/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:53.407037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64d068-d9ea-4682-99a8-4318d79955df admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:53.410335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ae64d068-d9ea-4682-99a8-4318d79955df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:53.466719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5565a5-10db-4ff8-8b49-622ac8e466fa None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:53.553267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61faf9b-6f1e-4f40-b285-efde291954a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:53.553267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61faf9b-6f1e-4f40-b285-efde291954a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:53.553267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61faf9b-6f1e-4f40-b285-efde291954a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:53.553267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61faf9b-6f1e-4f40-b285-efde291954a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:53.638498 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64d068-d9ea-4682-99a8-4318d79955df admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:53.652660 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70599e-77a4-4421-a301-76170d21b585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:53.653662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70599e-77a4-4421-a301-76170d21b585 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:53.655532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70599e-77a4-4421-a301-76170d21b585 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:53.656299 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70599e-77a4-4421-a301-76170d21b585 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:53.657251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70599e-77a4-4421-a301-76170d21b585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:53.666388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70599e-77a4-4421-a301-76170d21b585 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:53.697561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 907/1806] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:53.700407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70599e-77a4-4421-a301-76170d21b585 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:53.729659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70599e-77a4-4421-a301-76170d21b585 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:53.741028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc270793-90ee-4a39-927e-9b055ff6d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:53.742140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc270793-90ee-4a39-927e-9b055ff6d425 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:53.742635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc270793-90ee-4a39-927e-9b055ff6d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:53.743129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc270793-90ee-4a39-927e-9b055ff6d425 admin admin] PATH_INFO: `/v3/projects/4de907c7798a42b394ce5eb5d2b544df/users/f3d02f845e854c569bcc077f492cbf37/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:53.747689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc270793-90ee-4a39-927e-9b055ff6d425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de907c7798a42b394ce5eb5d2b544df, user_id=f3d02f845e854c569bcc077f492cbf37, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:53.770972 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc270793-90ee-4a39-927e-9b055ff6d425 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:53.779569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61faf9b-6f1e-4f40-b285-efde291954a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:53.781346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61faf9b-6f1e-4f40-b285-efde291954a2 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:53.806170 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 908/1808] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:53 2022] PUT /identity/v3/projects/4de907c7798a42b394ce5eb5d2b544df/users/f3d02f845e854c569bcc077f492cbf37/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:53.806573 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 900/1808] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:53.818829 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac14c8-210d-4d84-b2fa-3e3b4cb9cb70 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:53.819895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac14c8-210d-4d84-b2fa-3e3b4cb9cb70 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:53.819895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac14c8-210d-4d84-b2fa-3e3b4cb9cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:53.875757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2cac14c8-210d-4d84-b2fa-3e3b4cb9cb70 None None] MFA Rules not processed for user `f3d02f845e854c569bcc077f492cbf37`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:53.877618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2cac14c8-210d-4d84-b2fa-3e3b4cb9cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:53.976473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 909/1809] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:53.989719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61faf9b-6f1e-4f40-b285-efde291954a2 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:53.991615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e61faf9b-6f1e-4f40-b285-efde291954a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:54.113958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61faf9b-6f1e-4f40-b285-efde291954a2 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:54.189680 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febddb25-920a-4092-81ec-8c7780aa7233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:54.190256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febddb25-920a-4092-81ec-8c7780aa7233 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:54.190689 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febddb25-920a-4092-81ec-8c7780aa7233 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:54.191190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febddb25-920a-4092-81ec-8c7780aa7233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:54.214512 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febddb25-920a-4092-81ec-8c7780aa7233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:54.216177 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febddb25-920a-4092-81ec-8c7780aa7233 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:54.241927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 901/1810] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:53 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:54.527269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac14c8-210d-4d84-b2fa-3e3b4cb9cb70 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:54.700632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac14c8-210d-4d84-b2fa-3e3b4cb9cb70 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:54.700632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:54.700632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:54.700632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:54.701674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] PATH_INFO: `/v3/users/a5533df14c43400f8a8f02b2d511896b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:54.701674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5533df14c43400f8a8f02b2d511896b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:54.701674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:54.858707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febddb25-920a-4092-81ec-8c7780aa7233 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:54.860351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-febddb25-920a-4092-81ec-8c7780aa7233 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:54.991715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febddb25-920a-4092-81ec-8c7780aa7233 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:55.000225 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ca497-fcf6-4d56-b58f-065d68b933fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:55.001464 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca497-fcf6-4d56-b58f-065d68b933fb service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:55.001464 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca497-fcf6-4d56-b58f-065d68b933fb service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:55.001464 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca497-fcf6-4d56-b58f-065d68b933fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:55.012419 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ca497-fcf6-4d56-b58f-065d68b933fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:55.015118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ca497-fcf6-4d56-b58f-065d68b933fb service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:55.030443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 902/1811] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:55.181117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ca497-fcf6-4d56-b58f-065d68b933fb service nova] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:55.183191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-796ca497-fcf6-4d56-b58f-065d68b933fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:55.254787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ca497-fcf6-4d56-b58f-065d68b933fb service nova] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:55.271740 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:55.272521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:55.272825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:55.273103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] PATH_INFO: `/v3/projects/d58ac05a12ec4194a121974dfbb888d8` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:55.274587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58ac05a12ec4194a121974dfbb888d8)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:55.276926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:55.663960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5533df14c43400f8a8f02b2d511896b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:55.675121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58ac05a12ec4194a121974dfbb888d8', 'request_id': 'req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:55.682371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:56.046500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5533df14c43400f8a8f02b2d511896b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.150598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5533df14c43400f8a8f02b2d511896b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.150598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5533df14c43400f8a8f02b2d511896b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.150598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5533df14c43400f8a8f02b2d511896b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.150598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 910/1812] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:54 2022] DELETE /identity/v3/users/a5533df14c43400f8a8f02b2d511896b => generated 0 bytes in 1555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:56.150598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:56.151211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:56.203061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc52764-645c-41b2-a934-1dab8fa51b49 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:56.213309 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:56.214416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:56.214906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:56.215900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] PATH_INFO: `/v3/projects/32a66493a2514bb9ae9053cb07745de7` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:56.218890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a66493a2514bb9ae9053cb07745de7)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:56.222799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:56.429900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58ac05a12ec4194a121974dfbb888d8', 'request_id': 'req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.439229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58ac05a12ec4194a121974dfbb888d8', 'request_id': 'req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.466472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] The token cache is being invalidate because project d58ac05a12ec4194a121974dfbb888d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:56.478616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.478616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f3b44f1a-40b5-4be6-85f6-ec32e0cd4d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.478616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 903/1813] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:55 2022] DELETE /identity/v3/projects/d58ac05a12ec4194a121974dfbb888d8 => generated 0 bytes in 1293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:36:56.478616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b394d1e-4cab-4018-9623-db0030590d36 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:56.478616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b394d1e-4cab-4018-9623-db0030590d36 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:56.478616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b394d1e-4cab-4018-9623-db0030590d36 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:56.481796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 904/1814] 10.222.0.74 () {54 vars in 921 bytes} [Wed Aug 31 00:36:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:36:56.484031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3cb7a-d82a-441a-8e3d-da69fc549f33 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:56.484373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3cb7a-d82a-441a-8e3d-da69fc549f33 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:56.485277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3cb7a-d82a-441a-8e3d-da69fc549f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:56.487336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a66493a2514bb9ae9053cb07745de7', 'request_id': 'req-d6cf8cca-4798-4292-92be-390f9d8f603d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.496453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a66493a2514bb9ae9053cb07745de7', 'request_id': 'req-d6cf8cca-4798-4292-92be-390f9d8f603d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.506826 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a66493a2514bb9ae9053cb07745de7', 'request_id': 'req-d6cf8cca-4798-4292-92be-390f9d8f603d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.538485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-e7d3cb7a-d82a-441a-8e3d-da69fc549f33 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:56.549494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e7d3cb7a-d82a-441a-8e3d-da69fc549f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:56.684771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 905/1815] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:56.686044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3cb7a-d82a-441a-8e3d-da69fc549f33 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:56.689049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e7d3cb7a-d82a-441a-8e3d-da69fc549f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:56.703170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3cb7a-d82a-441a-8e3d-da69fc549f33 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:56.709206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:56.709947 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:56.710279 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:56.710570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] PATH_INFO: `/v3/projects/0474798a13b6481b9d15339f4c34a873` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:56.711819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0474798a13b6481b9d15339f4c34a873)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:56.713893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:56.975259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] The token cache is being invalidate because project 32a66493a2514bb9ae9053cb07745de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:56.977667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.979620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:56.987046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 911/1816] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:56 2022] DELETE /identity/v3/projects/32a66493a2514bb9ae9053cb07745de7 => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:56.991585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:57.000104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:57.026140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf8cca-4798-4292-92be-390f9d8f603d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:57.042072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0474798a13b6481b9d15339f4c34a873', 'request_id': 'req-a7f10916-5f7a-4061-869c-5d812a2a9734'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:57.157657 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c9be5-17be-4a91-abee-a4dfbc0a6617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:57.158915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c9be5-17be-4a91-abee-a4dfbc0a6617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:57.159703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c9be5-17be-4a91-abee-a4dfbc0a6617 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:57.160142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c9be5-17be-4a91-abee-a4dfbc0a6617 admin admin] PATH_INFO: `/v3/users/9888dd95f3574c548e71898fea2b780b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:57.171301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0474798a13b6481b9d15339f4c34a873', 'request_id': 'req-a7f10916-5f7a-4061-869c-5d812a2a9734'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:57.172082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c9be5-17be-4a91-abee-a4dfbc0a6617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9888dd95f3574c548e71898fea2b780b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:57.174217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0474798a13b6481b9d15339f4c34a873', 'request_id': 'req-a7f10916-5f7a-4061-869c-5d812a2a9734'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:57.174452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c9be5-17be-4a91-abee-a4dfbc0a6617 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:57.209178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] The token cache is being invalidate because project 0474798a13b6481b9d15339f4c34a873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:36:57.209544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:57.212548 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a7f10916-5f7a-4061-869c-5d812a2a9734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:57.219906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 906/1817] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:56 2022] DELETE /identity/v3/projects/0474798a13b6481b9d15339f4c34a873 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:57.225602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29521097-9037-41be-b087-8ebc42adf46f None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:57.225958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29521097-9037-41be-b087-8ebc42adf46f None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:57.226246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29521097-9037-41be-b087-8ebc42adf46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:57.279197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-29521097-9037-41be-b087-8ebc42adf46f None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:57.281439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-29521097-9037-41be-b087-8ebc42adf46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:57.456963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 907/1818] 10.222.0.74 () {58 vars in 1018 bytes} [Wed Aug 31 00:36:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:57.458422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29521097-9037-41be-b087-8ebc42adf46f None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:57.459904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-29521097-9037-41be-b087-8ebc42adf46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:57.589192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29521097-9037-41be-b087-8ebc42adf46f None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:57.608867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6a6c9be5-17be-4a91-abee-a4dfbc0a6617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9888dd95f3574c548e71898fea2b780b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:57.614367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015b939-350a-4d7a-8f63-13e88828de13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:57.615233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015b939-350a-4d7a-8f63-13e88828de13 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:57.616870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015b939-350a-4d7a-8f63-13e88828de13 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:57.617307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015b939-350a-4d7a-8f63-13e88828de13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:57.621129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0015b939-350a-4d7a-8f63-13e88828de13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:57.666795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015b939-350a-4d7a-8f63-13e88828de13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:57.669987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015b939-350a-4d7a-8f63-13e88828de13 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:57.688657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 908/1819] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:57.690495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb26935-9a70-4d0e-ac9a-896e1b390653 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:57.690788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb26935-9a70-4d0e-ac9a-896e1b390653 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:57.691065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb26935-9a70-4d0e-ac9a-896e1b390653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:57.736309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8fb26935-9a70-4d0e-ac9a-896e1b390653 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:57.746021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8fb26935-9a70-4d0e-ac9a-896e1b390653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:57.756674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 909/1820] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:57.756674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb26935-9a70-4d0e-ac9a-896e1b390653 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:57.756674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8fb26935-9a70-4d0e-ac9a-896e1b390653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:57.770310 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb26935-9a70-4d0e-ac9a-896e1b390653 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:57.777510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:57.778449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:57.781908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:57.782486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] PATH_INFO: `/v3/users/70865f1ad7334c248cc87bdac325f2f1` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:57.784271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] RBAC: Authorizing `identity:delete_user(user_id=70865f1ad7334c248cc87bdac325f2f1)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:57.787801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:57.955987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6a6c9be5-17be-4a91-abee-a4dfbc0a6617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9888dd95f3574c548e71898fea2b780b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:58.001613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6a6c9be5-17be-4a91-abee-a4dfbc0a6617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9888dd95f3574c548e71898fea2b780b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:58.022652 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6a6c9be5-17be-4a91-abee-a4dfbc0a6617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9888dd95f3574c548e71898fea2b780b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:58.028067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6a6c9be5-17be-4a91-abee-a4dfbc0a6617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9888dd95f3574c548e71898fea2b780b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:58.048282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 912/1821] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:56 2022] DELETE /identity/v3/users/9888dd95f3574c548e71898fea2b780b => generated 0 bytes in 1060 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:58.050225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89b132-5557-484a-b3cf-bb5785665ec5 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:58.051175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89b132-5557-484a-b3cf-bb5785665ec5 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:58.051706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89b132-5557-484a-b3cf-bb5785665ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:58.088853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-cd89b132-5557-484a-b3cf-bb5785665ec5 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:36:58.092476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cd89b132-5557-484a-b3cf-bb5785665ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:58.185234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70865f1ad7334c248cc87bdac325f2f1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:58.217694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 913/1822] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:36:58.220422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89b132-5557-484a-b3cf-bb5785665ec5 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:58.224078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cd89b132-5557-484a-b3cf-bb5785665ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:58.242703 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70865f1ad7334c248cc87bdac325f2f1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:58.254582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70865f1ad7334c248cc87bdac325f2f1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:58.356509 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70865f1ad7334c248cc87bdac325f2f1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:58.358416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70865f1ad7334c248cc87bdac325f2f1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:36:58.369189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 910/1823] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:36:57 2022] DELETE /identity/v3/users/70865f1ad7334c248cc87bdac325f2f1 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:58.370543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:58.376119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:58.396955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89b132-5557-484a-b3cf-bb5785665ec5 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:58.455036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:36:58.538738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5dd7f-e3d6-4b0a-94f4-16d62de3e84e admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:58.548167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff1b11-8bfa-4641-ac7d-434b9ea8c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:58.549073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff1b11-8bfa-4641-ac7d-434b9ea8c1ad admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:58.549365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff1b11-8bfa-4641-ac7d-434b9ea8c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:58.549793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff1b11-8bfa-4641-ac7d-434b9ea8c1ad admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:58.550492 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff1b11-8bfa-4641-ac7d-434b9ea8c1ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:36:58.550796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff1b11-8bfa-4641-ac7d-434b9ea8c1ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:58.561834 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff1b11-8bfa-4641-ac7d-434b9ea8c1ad admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:58.600569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 911/1824] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:36:58.610021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff1b11-8bfa-4641-ac7d-434b9ea8c1ad admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:58.628070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e974e8f-1336-4eb5-abb5-26ca7b8c1318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:58.629198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974e8f-1336-4eb5-abb5-26ca7b8c1318 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:58.629755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974e8f-1336-4eb5-abb5-26ca7b8c1318 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:58.630172 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974e8f-1336-4eb5-abb5-26ca7b8c1318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:58.633646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7e974e8f-1336-4eb5-abb5-26ca7b8c1318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:58.641420 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff1b11-8bfa-4641-ac7d-434b9ea8c1ad admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:58.647068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25fce9-2b09-4d09-b025-b2761c8a6347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:58.648659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25fce9-2b09-4d09-b025-b2761c8a6347 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:58.648659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25fce9-2b09-4d09-b025-b2761c8a6347 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:58.648659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25fce9-2b09-4d09-b025-b2761c8a6347 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:58.648952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25fce9-2b09-4d09-b025-b2761c8a6347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:58.651719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25fce9-2b09-4d09-b025-b2761c8a6347 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:58.663527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e974e8f-1336-4eb5-abb5-26ca7b8c1318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:58.668273 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e974e8f-1336-4eb5-abb5-26ca7b8c1318 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:58.713974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 914/1825] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:36:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:36:58.845318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 912/1826] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:36:58 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:58.846528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e974e8f-1336-4eb5-abb5-26ca7b8c1318 service nova] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:58.873804 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e974e8f-1336-4eb5-abb5-26ca7b8c1318 service nova] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:59.033548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158f91e-0b20-4024-9ed1-adaab5151c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:59.034357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f91e-0b20-4024-9ed1-adaab5151c88 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:59.034690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f91e-0b20-4024-9ed1-adaab5151c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:59.035109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158f91e-0b20-4024-9ed1-adaab5151c88 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:59.035970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158f91e-0b20-4024-9ed1-adaab5151c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:59.038020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158f91e-0b20-4024-9ed1-adaab5151c88 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:59.470290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 915/1827] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:36:58 2022] POST /identity/v3/users => generated 293 bytes in 624 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:36:59.474802 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25fce9-2b09-4d09-b025-b2761c8a6347 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:59.505096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25fce9-2b09-4d09-b025-b2761c8a6347 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:59.515300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f24c5f-485c-4997-ae20-0943b90f7d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:59.526500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f24c5f-485c-4997-ae20-0943b90f7d4e admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:59.526787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f24c5f-485c-4997-ae20-0943b90f7d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:59.527067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f24c5f-485c-4997-ae20-0943b90f7d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:59.544617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f24c5f-485c-4997-ae20-0943b90f7d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:59.544617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f24c5f-485c-4997-ae20-0943b90f7d4e admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:59.556673 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 913/1828] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:36:59.562186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158f91e-0b20-4024-9ed1-adaab5151c88 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:59.621600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158f91e-0b20-4024-9ed1-adaab5151c88 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:59.644243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78253337-75c1-44b5-a1ae-2bba8af228ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:59.644998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78253337-75c1-44b5-a1ae-2bba8af228ca admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:59.645321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78253337-75c1-44b5-a1ae-2bba8af228ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:59.645706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78253337-75c1-44b5-a1ae-2bba8af228ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:59.646535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78253337-75c1-44b5-a1ae-2bba8af228ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:59.648635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78253337-75c1-44b5-a1ae-2bba8af228ca admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:59.684145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 916/1829] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:36:59.686228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f24c5f-485c-4997-ae20-0943b90f7d4e admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:59.713643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f24c5f-485c-4997-ae20-0943b90f7d4e admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:36:59.736838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507f31e-5d73-48ad-8302-786be634e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:36:59.738064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507f31e-5d73-48ad-8302-786be634e7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:59.740734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507f31e-5d73-48ad-8302-786be634e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:59.741343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507f31e-5d73-48ad-8302-786be634e7ec admin admin] PATH_INFO: `/v3/projects/c6018990e8cd4eaab079061a7f537057/users/f6a1952e07ff4faeb09f0146a9fbc3cb/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:59.800442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507f31e-5d73-48ad-8302-786be634e7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6018990e8cd4eaab079061a7f537057, user_id=f6a1952e07ff4faeb09f0146a9fbc3cb, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:36:59.814254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507f31e-5d73-48ad-8302-786be634e7ec admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:36:59.942934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78253337-75c1-44b5-a1ae-2bba8af228ca admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:36:59.943761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 914/1830] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:36:59 2022] PUT /identity/v3/projects/c6018990e8cd4eaab079061a7f537057/users/f6a1952e07ff4faeb09f0146a9fbc3cb/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:36:59.947577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-78253337-75c1-44b5-a1ae-2bba8af228ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:36:59.954984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baca15-508e-4d7b-89b4-db310a7bdf12 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:36:59.955271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baca15-508e-4d7b-89b4-db310a7bdf12 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:36:59.955728 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baca15-508e-4d7b-89b4-db310a7bdf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:36:59.973764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78253337-75c1-44b5-a1ae-2bba8af228ca admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:00.037899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-32baca15-508e-4d7b-89b4-db310a7bdf12 None None] MFA Rules not processed for user `f6a1952e07ff4faeb09f0146a9fbc3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:00.053734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-32baca15-508e-4d7b-89b4-db310a7bdf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:00.141237 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:00.143331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:00.144602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:00.145144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] PATH_INFO: `/v3/projects/3b247b5dbc754ee483ca3d0a5b6697af` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:00.149400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b247b5dbc754ee483ca3d0a5b6697af)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:00.153068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:00.219115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 915/1831] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:36:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:00.220267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baca15-508e-4d7b-89b4-db310a7bdf12 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:00.221908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-32baca15-508e-4d7b-89b4-db310a7bdf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:00.239120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baca15-508e-4d7b-89b4-db310a7bdf12 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:00.244170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:00.245097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:00.245563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:00.245719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] PATH_INFO: `/v3/projects/e00525fa0071460ebe79ef0d117f256b` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:00.246895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00525fa0071460ebe79ef0d117f256b)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:00.249117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:00.491169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00525fa0071460ebe79ef0d117f256b', 'request_id': 'req-77856939-79ed-4e39-9024-e8f9015616bb'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:00.506447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b247b5dbc754ee483ca3d0a5b6697af', 'request_id': 'req-4790a57e-db48-4601-8dc0-45707f711b97'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:00.510319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:00.527391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b247b5dbc754ee483ca3d0a5b6697af', 'request_id': 'req-4790a57e-db48-4601-8dc0-45707f711b97'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:00.540703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b247b5dbc754ee483ca3d0a5b6697af', 'request_id': 'req-4790a57e-db48-4601-8dc0-45707f711b97'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:00.698945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00525fa0071460ebe79ef0d117f256b', 'request_id': 'req-77856939-79ed-4e39-9024-e8f9015616bb'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:00.712191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00525fa0071460ebe79ef0d117f256b', 'request_id': 'req-77856939-79ed-4e39-9024-e8f9015616bb'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:00.726020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] The token cache is being invalidate because project e00525fa0071460ebe79ef0d117f256b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:00.726685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:00.727665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:00.730352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 916/1832] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:00 2022] DELETE /identity/v3/projects/e00525fa0071460ebe79ef0d117f256b => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:00.731958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:00.734598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:00.737024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:00.789705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] The token cache is being invalidate because project 3b247b5dbc754ee483ca3d0a5b6697af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:00.790490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:00.792199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:00.793916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 917/1833] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:36:59 2022] DELETE /identity/v3/projects/3b247b5dbc754ee483ca3d0a5b6697af => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:00.795364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:00.797022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:00.808454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856939-79ed-4e39-9024-e8f9015616bb admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:00.815264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57c611-ebfe-430a-9428-0642251cb9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:00.816078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57c611-ebfe-430a-9428-0642251cb9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:00.816496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57c611-ebfe-430a-9428-0642251cb9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:00.816841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57c611-ebfe-430a-9428-0642251cb9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:00.817855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57c611-ebfe-430a-9428-0642251cb9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:00.820214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57c611-ebfe-430a-9428-0642251cb9b0 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:00.891680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790a57e-db48-4601-8dc0-45707f711b97 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:00.900287 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:00.901250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:00.901792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:00.902350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] PATH_INFO: `/v3/projects/619d48935efe470495b12c3ecb1c69d5` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:00.904450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619d48935efe470495b12c3ecb1c69d5)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:00.907189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:00.971176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 917/1834] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:00 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:00.971872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57c611-ebfe-430a-9428-0642251cb9b0 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:00.974004 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3e57c611-ebfe-430a-9428-0642251cb9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:01.056843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57c611-ebfe-430a-9428-0642251cb9b0 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:01.060192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a101492-cdbc-4fd8-a0c4-61041a301831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:01.061598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a101492-cdbc-4fd8-a0c4-61041a301831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.061598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a101492-cdbc-4fd8-a0c4-61041a301831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.061788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a101492-cdbc-4fd8-a0c4-61041a301831 admin admin] PATH_INFO: `/v3/users/f3d02f845e854c569bcc077f492cbf37` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.063234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a101492-cdbc-4fd8-a0c4-61041a301831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d02f845e854c569bcc077f492cbf37)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:01.065289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a101492-cdbc-4fd8-a0c4-61041a301831 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:01.101177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619d48935efe470495b12c3ecb1c69d5', 'request_id': 'req-94bc4092-12e2-431c-bf70-bfdfe2727d08'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:01.106998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619d48935efe470495b12c3ecb1c69d5', 'request_id': 'req-94bc4092-12e2-431c-bf70-bfdfe2727d08'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:01.115000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619d48935efe470495b12c3ecb1c69d5', 'request_id': 'req-94bc4092-12e2-431c-bf70-bfdfe2727d08'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:01.198621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] The token cache is being invalidate because project 619d48935efe470495b12c3ecb1c69d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:01.199455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:01.199552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-94bc4092-12e2-431c-bf70-bfdfe2727d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:01.201642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 918/1835] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:00 2022] DELETE /identity/v3/projects/619d48935efe470495b12c3ecb1c69d5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:01.202920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926069bc-cb7b-40e0-8873-60557a749d7d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.203211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926069bc-cb7b-40e0-8873-60557a749d7d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.203484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926069bc-cb7b-40e0-8873-60557a749d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.224505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-926069bc-cb7b-40e0-8873-60557a749d7d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:01.225696 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-926069bc-cb7b-40e0-8873-60557a749d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:01.281545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5a101492-cdbc-4fd8-a0c4-61041a301831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d02f845e854c569bcc077f492cbf37'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:01.291548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 919/1836] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:01.296924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5a101492-cdbc-4fd8-a0c4-61041a301831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d02f845e854c569bcc077f492cbf37'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:01.300036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926069bc-cb7b-40e0-8873-60557a749d7d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:01.305369 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-926069bc-cb7b-40e0-8873-60557a749d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:01.305485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5a101492-cdbc-4fd8-a0c4-61041a301831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d02f845e854c569bcc077f492cbf37'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:01.314251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926069bc-cb7b-40e0-8873-60557a749d7d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:01.319359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab558af5-812f-4886-99e5-6ce4cf339243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:01.319976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab558af5-812f-4886-99e5-6ce4cf339243 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.320257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab558af5-812f-4886-99e5-6ce4cf339243 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.320533 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab558af5-812f-4886-99e5-6ce4cf339243 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.321172 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab558af5-812f-4886-99e5-6ce4cf339243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:01.323233 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab558af5-812f-4886-99e5-6ce4cf339243 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:01.427205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5a101492-cdbc-4fd8-a0c4-61041a301831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d02f845e854c569bcc077f492cbf37'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:01.428274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5a101492-cdbc-4fd8-a0c4-61041a301831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d02f845e854c569bcc077f492cbf37'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:01.442228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 918/1837] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:00 2022] DELETE /identity/v3/users/f3d02f845e854c569bcc077f492cbf37 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:01.444496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a9ac-d60c-4161-a8b4-1e4d7aa32f45 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.444871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a9ac-d60c-4161-a8b4-1e4d7aa32f45 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.445153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43a9ac-d60c-4161-a8b4-1e4d7aa32f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.461377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 920/1838] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:01 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:01.462683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e821-e39e-4364-ad23-84cd94758ece None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.462971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e821-e39e-4364-ad23-84cd94758ece None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.463247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e821-e39e-4364-ad23-84cd94758ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.466829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-cd43a9ac-d60c-4161-a8b4-1e4d7aa32f45 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:01.468116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cd43a9ac-d60c-4161-a8b4-1e4d7aa32f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:01.497839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-3bc0e821-e39e-4364-ad23-84cd94758ece None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:01.499518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-3bc0e821-e39e-4364-ad23-84cd94758ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:01.541910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 919/1839] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:01.543809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43a9ac-d60c-4161-a8b4-1e4d7aa32f45 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:01.546281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cd43a9ac-d60c-4161-a8b4-1e4d7aa32f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:01.564367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43a9ac-d60c-4161-a8b4-1e4d7aa32f45 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:01.572062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b306c44-1bea-4152-9aed-a11c076cba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:01.572752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b306c44-1bea-4152-9aed-a11c076cba06 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.573208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b306c44-1bea-4152-9aed-a11c076cba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.573492 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b306c44-1bea-4152-9aed-a11c076cba06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.574614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b306c44-1bea-4152-9aed-a11c076cba06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:01.576799 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b306c44-1bea-4152-9aed-a11c076cba06 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:01.590636 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 921/1840] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:01.592277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 920/1841] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:01.596109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4577-5f44-4d49-8546-a0bf23c6ff91 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.596109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4577-5f44-4d49-8546-a0bf23c6ff91 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.602524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4577-5f44-4d49-8546-a0bf23c6ff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.603085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b306c44-1bea-4152-9aed-a11c076cba06 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:01.612425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b306c44-1bea-4152-9aed-a11c076cba06 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:01.617328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e991a2d-c9a5-4ad9-bda9-bdfdc23deb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:01.617978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e991a2d-c9a5-4ad9-bda9-bdfdc23deb21 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.618260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e991a2d-c9a5-4ad9-bda9-bdfdc23deb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.618533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e991a2d-c9a5-4ad9-bda9-bdfdc23deb21 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.619473 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e991a2d-c9a5-4ad9-bda9-bdfdc23deb21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:01.620266 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e991a2d-c9a5-4ad9-bda9-bdfdc23deb21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:01.621408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e991a2d-c9a5-4ad9-bda9-bdfdc23deb21 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:01.629334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-5a6c4577-5f44-4d49-8546-a0bf23c6ff91 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:01.630601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5a6c4577-5f44-4d49-8546-a0bf23c6ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:01.636579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 921/1842] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:01.637718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e991a2d-c9a5-4ad9-bda9-bdfdc23deb21 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:01.640989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 922/1843] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:01.645457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c4577-5f44-4d49-8546-a0bf23c6ff91 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:01.649988 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e991a2d-c9a5-4ad9-bda9-bdfdc23deb21 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:01.656515 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e136e-455d-4854-87d4-fc1cb1640b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:01.657150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e136e-455d-4854-87d4-fc1cb1640b83 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.657446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e136e-455d-4854-87d4-fc1cb1640b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.657819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c4577-5f44-4d49-8546-a0bf23c6ff91 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:01.657928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e136e-455d-4854-87d4-fc1cb1640b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.658635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e136e-455d-4854-87d4-fc1cb1640b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:01.660267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e136e-455d-4854-87d4-fc1cb1640b83 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:01.662782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381c6f7-68e9-4c05-88a4-d386db7ab73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:01.663293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c6f7-68e9-4c05-88a4-d386db7ab73d admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.663578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c6f7-68e9-4c05-88a4-d386db7ab73d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.663906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381c6f7-68e9-4c05-88a4-d386db7ab73d admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.664551 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381c6f7-68e9-4c05-88a4-d386db7ab73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:01.666565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381c6f7-68e9-4c05-88a4-d386db7ab73d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:01.671434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 922/1844] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:01.672316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e136e-455d-4854-87d4-fc1cb1640b83 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:01.687496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e136e-455d-4854-87d4-fc1cb1640b83 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:01.692421 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903901f1-37ae-428b-9217-f588493e36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:01.693358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903901f1-37ae-428b-9217-f588493e36b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.693698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903901f1-37ae-428b-9217-f588493e36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.693949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903901f1-37ae-428b-9217-f588493e36b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.694640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903901f1-37ae-428b-9217-f588493e36b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:01.694966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903901f1-37ae-428b-9217-f588493e36b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:01.696576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903901f1-37ae-428b-9217-f588493e36b8 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:01.714388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 923/1845] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:01.714388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903901f1-37ae-428b-9217-f588493e36b8 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:01.725363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903901f1-37ae-428b-9217-f588493e36b8 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:01.730736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c58e-d109-44e9-a0a9-60a222fc4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:01.731613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c58e-d109-44e9-a0a9-60a222fc4574 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:01.731900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c58e-d109-44e9-a0a9-60a222fc4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:01.732227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c58e-d109-44e9-a0a9-60a222fc4574 admin admin] PATH_INFO: `/v3/projects/e5c3ef532de94b13a688cd0213c41f22/users/761cbdbaae574fd2a2eac47b23dd0d1b/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:01.761683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786c58e-d109-44e9-a0a9-60a222fc4574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c3ef532de94b13a688cd0213c41f22, user_id=761cbdbaae574fd2a2eac47b23dd0d1b, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:01.763107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786c58e-d109-44e9-a0a9-60a222fc4574 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:01.862947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 923/1846] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:01 2022] POST /identity/v3/projects => generated 379 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:01.862947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381c6f7-68e9-4c05-88a4-d386db7ab73d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:01.947993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381c6f7-68e9-4c05-88a4-d386db7ab73d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:01.964325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 924/1847] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:01 2022] PUT /identity/v3/projects/e5c3ef532de94b13a688cd0213c41f22/users/761cbdbaae574fd2a2eac47b23dd0d1b/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:01.964325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c58e-d109-44e9-a0a9-60a222fc4574 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:02.010467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909fe8a-cb1c-42a7-b863-e25833fa50da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:02.011083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fe8a-cb1c-42a7-b863-e25833fa50da admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.011393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fe8a-cb1c-42a7-b863-e25833fa50da admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.011793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909fe8a-cb1c-42a7-b863-e25833fa50da admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.012389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909fe8a-cb1c-42a7-b863-e25833fa50da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:02.015288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909fe8a-cb1c-42a7-b863-e25833fa50da admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:02.030869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c58e-d109-44e9-a0a9-60a222fc4574 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:02.035785 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0781b3-e24e-4ffe-a9f7-897e384f8fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:02.036393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0781b3-e24e-4ffe-a9f7-897e384f8fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.036716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0781b3-e24e-4ffe-a9f7-897e384f8fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.036988 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0781b3-e24e-4ffe-a9f7-897e384f8fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.037698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0781b3-e24e-4ffe-a9f7-897e384f8fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:02.044466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0781b3-e24e-4ffe-a9f7-897e384f8fc0 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:02.113614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 924/1848] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:01 2022] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:02.113614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dbf47-534c-4f55-86a1-a9a115f7f6d5 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.113903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dbf47-534c-4f55-86a1-a9a115f7f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.115100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dbf47-534c-4f55-86a1-a9a115f7f6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.140875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 925/1849] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:01 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:02.141838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0781b3-e24e-4ffe-a9f7-897e384f8fc0 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:02.143695 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ea0781b3-e24e-4ffe-a9f7-897e384f8fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:02.147393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-9e2dbf47-534c-4f55-86a1-a9a115f7f6d5 None None] MFA Rules not processed for user `761cbdbaae574fd2a2eac47b23dd0d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:02.148743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-9e2dbf47-534c-4f55-86a1-a9a115f7f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:02.159275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0781b3-e24e-4ffe-a9f7-897e384f8fc0 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:02.238847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:02.239496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.240047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.240047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] PATH_INFO: `/v3/projects/4de907c7798a42b394ce5eb5d2b544df` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.241229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de907c7798a42b394ce5eb5d2b544df)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:02.243293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:02.246189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 925/1850] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:02.246876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dbf47-534c-4f55-86a1-a9a115f7f6d5 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:02.262146 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dbf47-534c-4f55-86a1-a9a115f7f6d5 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:02.270090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6f87-21c4-4890-ace1-ebc20a31f1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:02.270878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6f87-21c4-4890-ace1-ebc20a31f1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.271062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6f87-21c4-4890-ace1-ebc20a31f1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.271293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6f87-21c4-4890-ace1-ebc20a31f1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.271932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6f87-21c4-4890-ace1-ebc20a31f1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:02.274206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6f87-21c4-4890-ace1-ebc20a31f1c7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:02.445335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 926/1851] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:02 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:02.445335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6f87-21c4-4890-ace1-ebc20a31f1c7 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:02.457335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6f87-21c4-4890-ace1-ebc20a31f1c7 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:02.461020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de907c7798a42b394ce5eb5d2b544df', 'request_id': 'req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:02.516725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda06d50-45cb-4b47-b7d4-41c5f45731d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:02.517265 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06d50-45cb-4b47-b7d4-41c5f45731d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.517544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06d50-45cb-4b47-b7d4-41c5f45731d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.517865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda06d50-45cb-4b47-b7d4-41c5f45731d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.518515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda06d50-45cb-4b47-b7d4-41c5f45731d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:02.520312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda06d50-45cb-4b47-b7d4-41c5f45731d0 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:02.530756 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 927/1852] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:02.531698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda06d50-45cb-4b47-b7d4-41c5f45731d0 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:02.541645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda06d50-45cb-4b47-b7d4-41c5f45731d0 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:02.546397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902e91c-2707-4f74-ba27-fea779f26a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:02.546986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902e91c-2707-4f74-ba27-fea779f26a9a admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.547268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902e91c-2707-4f74-ba27-fea779f26a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.547536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902e91c-2707-4f74-ba27-fea779f26a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.548157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902e91c-2707-4f74-ba27-fea779f26a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:02.550116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902e91c-2707-4f74-ba27-fea779f26a9a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:02.555268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de907c7798a42b394ce5eb5d2b544df', 'request_id': 'req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:02.561995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de907c7798a42b394ce5eb5d2b544df', 'request_id': 'req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:02.574095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] The token cache is being invalidate because project 4de907c7798a42b394ce5eb5d2b544df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:02.574441 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:02.575115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:02.577167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 926/1853] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:02 2022] DELETE /identity/v3/projects/4de907c7798a42b394ce5eb5d2b544df => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:02.578120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:02.579461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:02.591938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40815c-aaf1-41f6-b3f5-5b5ed4e88c85 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:02.597431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d0e45-64e1-461b-be94-f1a74d7ddddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:02.602547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0e45-64e1-461b-be94-f1a74d7ddddd admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.602547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0e45-64e1-461b-be94-f1a74d7ddddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.602547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0e45-64e1-461b-be94-f1a74d7ddddd admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.602547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d0e45-64e1-461b-be94-f1a74d7ddddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:02.602547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d0e45-64e1-461b-be94-f1a74d7ddddd admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:02.612023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 927/1854] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:02.612859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d0e45-64e1-461b-be94-f1a74d7ddddd admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:02.614675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-960d0e45-64e1-461b-be94-f1a74d7ddddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:02.628761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d0e45-64e1-461b-be94-f1a74d7ddddd admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:02.633472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c11856-4a5c-45e9-8342-ffff15154072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:02.634210 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c11856-4a5c-45e9-8342-ffff15154072 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.634493 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c11856-4a5c-45e9-8342-ffff15154072 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.634770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c11856-4a5c-45e9-8342-ffff15154072 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.635471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c11856-4a5c-45e9-8342-ffff15154072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:02.637075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c11856-4a5c-45e9-8342-ffff15154072 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:02.648144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 928/1855] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:02.649436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12890bce-2dd5-4580-8557-24db5e5a9433 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.649725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12890bce-2dd5-4580-8557-24db5e5a9433 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.649998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12890bce-2dd5-4580-8557-24db5e5a9433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.669475 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-12890bce-2dd5-4580-8557-24db5e5a9433 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:02.671351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-12890bce-2dd5-4580-8557-24db5e5a9433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:02.676915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 928/1856] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:02 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:02.677852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902e91c-2707-4f74-ba27-fea779f26a9a admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:02.681418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 929/1857] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:02.682268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12890bce-2dd5-4580-8557-24db5e5a9433 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:02.697542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12890bce-2dd5-4580-8557-24db5e5a9433 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:02.743613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902e91c-2707-4f74-ba27-fea779f26a9a admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:02.749052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09b929-9cd7-42e2-8294-2730c14a36e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:02.749692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b929-9cd7-42e2-8294-2730c14a36e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.749975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b929-9cd7-42e2-8294-2730c14a36e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.750349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09b929-9cd7-42e2-8294-2730c14a36e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.750903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09b929-9cd7-42e2-8294-2730c14a36e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:02.752585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09b929-9cd7-42e2-8294-2730c14a36e9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:02.758406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59532fed-0131-4727-9128-aa2dc787d283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:02.759274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59532fed-0131-4727-9128-aa2dc787d283 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.759589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59532fed-0131-4727-9128-aa2dc787d283 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.759864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59532fed-0131-4727-9128-aa2dc787d283 admin admin] PATH_INFO: `/v3/projects/fd0d5ccbb4654403a1d84010f40e17d3/users/618bf841385c47fbaedd92117ce5b758/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.769603 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 929/1858] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:02.769603 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09b929-9cd7-42e2-8294-2730c14a36e9 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:02.770706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6a09b929-9cd7-42e2-8294-2730c14a36e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:02.776815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59532fed-0131-4727-9128-aa2dc787d283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0d5ccbb4654403a1d84010f40e17d3, user_id=618bf841385c47fbaedd92117ce5b758, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:02.780251 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59532fed-0131-4727-9128-aa2dc787d283 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:02.784082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09b929-9cd7-42e2-8294-2730c14a36e9 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:02.788972 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b670b-1be8-4b8a-a120-6b4bdcdc5eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:02.792933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b670b-1be8-4b8a-a120-6b4bdcdc5eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.792933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b670b-1be8-4b8a-a120-6b4bdcdc5eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.792933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b670b-1be8-4b8a-a120-6b4bdcdc5eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.792933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b670b-1be8-4b8a-a120-6b4bdcdc5eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:02.792933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b670b-1be8-4b8a-a120-6b4bdcdc5eb5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:02.892437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 930/1859] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:02 2022] PUT /identity/v3/projects/fd0d5ccbb4654403a1d84010f40e17d3/users/618bf841385c47fbaedd92117ce5b758/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:02.893910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c963d5-6e45-4e61-b478-612767c78c57 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:02.894226 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c963d5-6e45-4e61-b478-612767c78c57 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:02.894569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c963d5-6e45-4e61-b478-612767c78c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:02.917139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-91c963d5-6e45-4e61-b478-612767c78c57 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:02.918976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-91c963d5-6e45-4e61-b478-612767c78c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:02.944963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 930/1860] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:02 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:02.949737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b670b-1be8-4b8a-a120-6b4bdcdc5eb5 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:02.963634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b670b-1be8-4b8a-a120-6b4bdcdc5eb5 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:02.995105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 931/1861] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:03.000377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cda7a-b63b-4265-9e13-e5ee72aaa558 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.000736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cda7a-b63b-4265-9e13-e5ee72aaa558 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.001101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cda7a-b63b-4265-9e13-e5ee72aaa558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.025301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2eb5c-453b-42ee-aa75-764197776eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:03.026186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2eb5c-453b-42ee-aa75-764197776eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.026539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2eb5c-453b-42ee-aa75-764197776eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.026821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2eb5c-453b-42ee-aa75-764197776eb7 admin admin] PATH_INFO: `/v3/projects/683319fc649d4713b6f6906cafd4a84e/users/41e60e5f96eb420984e3f5f810c402b1/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.044307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2eb5c-453b-42ee-aa75-764197776eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683319fc649d4713b6f6906cafd4a84e, user_id=41e60e5f96eb420984e3f5f810c402b1, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:03.047303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a67cda7a-b63b-4265-9e13-e5ee72aaa558 None None] MFA Rules not processed for user `618bf841385c47fbaedd92117ce5b758`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:03.047303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a67cda7a-b63b-4265-9e13-e5ee72aaa558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:03.048403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2eb5c-453b-42ee-aa75-764197776eb7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:03.116779 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 932/1862] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:03.117956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cda7a-b63b-4265-9e13-e5ee72aaa558 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:03.130653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cda7a-b63b-4265-9e13-e5ee72aaa558 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:03.135329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa38d6-f199-4028-b1a5-f7edb387f04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:03.135950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa38d6-f199-4028-b1a5-f7edb387f04f admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.136233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa38d6-f199-4028-b1a5-f7edb387f04f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.136507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa38d6-f199-4028-b1a5-f7edb387f04f admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.137163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa38d6-f199-4028-b1a5-f7edb387f04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:03.141370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa38d6-f199-4028-b1a5-f7edb387f04f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:03.152130 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 933/1863] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:03.152972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa38d6-f199-4028-b1a5-f7edb387f04f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:03.156562 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 931/1864] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:02 2022] PUT /identity/v3/projects/683319fc649d4713b6f6906cafd4a84e/users/41e60e5f96eb420984e3f5f810c402b1/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:03.156562 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2eb5c-453b-42ee-aa75-764197776eb7 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:03.167473 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa38d6-f199-4028-b1a5-f7edb387f04f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:03.229720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2eb5c-453b-42ee-aa75-764197776eb7 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:03.230671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42130-48c1-45c2-8980-28f3db09c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:03.231391 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42130-48c1-45c2-8980-28f3db09c090 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.231714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42130-48c1-45c2-8980-28f3db09c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.231994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba42130-48c1-45c2-8980-28f3db09c090 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.233451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42130-48c1-45c2-8980-28f3db09c090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:03.234075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42130-48c1-45c2-8980-28f3db09c090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:03.236057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba42130-48c1-45c2-8980-28f3db09c090 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:03.236325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022189e-bac6-4879-90ca-989dbcf6a420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:03.236946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022189e-bac6-4879-90ca-989dbcf6a420 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.237239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022189e-bac6-4879-90ca-989dbcf6a420 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.237527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022189e-bac6-4879-90ca-989dbcf6a420 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.238228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022189e-bac6-4879-90ca-989dbcf6a420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:03.240277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022189e-bac6-4879-90ca-989dbcf6a420 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:03.249422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 934/1865] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:03.250410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42130-48c1-45c2-8980-28f3db09c090 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:03.262290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba42130-48c1-45c2-8980-28f3db09c090 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:03.267386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb782-f3a0-478f-bd75-745ad3af8464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:03.268057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb782-f3a0-478f-bd75-745ad3af8464 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.268333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb782-f3a0-478f-bd75-745ad3af8464 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.268617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb782-f3a0-478f-bd75-745ad3af8464 admin admin] PATH_INFO: `/v3/projects/7a6cb504795141cbbab97936701b9dc1/users/c3c85e4e0d1e4c20880e9703ccd85bf6/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.284919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cb782-f3a0-478f-bd75-745ad3af8464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6cb504795141cbbab97936701b9dc1, user_id=c3c85e4e0d1e4c20880e9703ccd85bf6, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:03.287711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cb782-f3a0-478f-bd75-745ad3af8464 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:03.340893 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 932/1866] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:03 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:03.349319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3ceb8-90a0-4bf7-90b8-bfbd7ad776f0 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.349319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3ceb8-90a0-4bf7-90b8-bfbd7ad776f0 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.349319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3ceb8-90a0-4bf7-90b8-bfbd7ad776f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.377633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-a9a3ceb8-90a0-4bf7-90b8-bfbd7ad776f0 None None] MFA Rules not processed for user `41e60e5f96eb420984e3f5f810c402b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:03.380504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a9a3ceb8-90a0-4bf7-90b8-bfbd7ad776f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:03.408635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 935/1867] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:03 2022] PUT /identity/v3/projects/7a6cb504795141cbbab97936701b9dc1/users/c3c85e4e0d1e4c20880e9703ccd85bf6/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:03.409483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb782-f3a0-478f-bd75-745ad3af8464 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:03.471181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 933/1868] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:03.472442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3ceb8-90a0-4bf7-90b8-bfbd7ad776f0 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:03.481502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:03.499424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb782-f3a0-478f-bd75-745ad3af8464 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:03.504970 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944afbe-9f24-4878-a74c-eac9a31db892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:03.505619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944afbe-9f24-4878-a74c-eac9a31db892 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.505902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944afbe-9f24-4878-a74c-eac9a31db892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.506247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944afbe-9f24-4878-a74c-eac9a31db892 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.506866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944afbe-9f24-4878-a74c-eac9a31db892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:03.508787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944afbe-9f24-4878-a74c-eac9a31db892 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:03.526131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:03.561748 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3ceb8-90a0-4bf7-90b8-bfbd7ad776f0 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:03.566439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f9757-158e-4da1-8286-bbbac0841cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:03.567060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f9757-158e-4da1-8286-bbbac0841cef admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.567341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f9757-158e-4da1-8286-bbbac0841cef admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.567616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f9757-158e-4da1-8286-bbbac0841cef admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.568516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f9757-158e-4da1-8286-bbbac0841cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:03.570499 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f9757-158e-4da1-8286-bbbac0841cef admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:03.634597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 936/1869] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:03 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:03.634597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944afbe-9f24-4878-a74c-eac9a31db892 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:03.695537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944afbe-9f24-4878-a74c-eac9a31db892 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:03.700419 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b9293-f977-46d8-8123-396296112590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:03.701526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b9293-f977-46d8-8123-396296112590 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.701843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b9293-f977-46d8-8123-396296112590 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.702121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b9293-f977-46d8-8123-396296112590 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.702835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b9293-f977-46d8-8123-396296112590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:03.704445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b9293-f977-46d8-8123-396296112590 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:03.714368 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 937/1870] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:03.715142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b9293-f977-46d8-8123-396296112590 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:03.725602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b9293-f977-46d8-8123-396296112590 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:03.730451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bed9f2-42e0-4e57-9901-f68c508da332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:03.731060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed9f2-42e0-4e57-9901-f68c508da332 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.731340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed9f2-42e0-4e57-9901-f68c508da332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.731619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed9f2-42e0-4e57-9901-f68c508da332 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.732313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bed9f2-42e0-4e57-9901-f68c508da332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:03.734692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bed9f2-42e0-4e57-9901-f68c508da332 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:03.750900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 934/1871] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:03 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:03.758056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f9757-158e-4da1-8286-bbbac0841cef admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:03.761546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f9757-158e-4da1-8286-bbbac0841cef admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:03.767344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f0214-7c04-41d1-960e-a3a585bf0b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:03.767945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f0214-7c04-41d1-960e-a3a585bf0b6a admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:03.768225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f0214-7c04-41d1-960e-a3a585bf0b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:03.768504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f0214-7c04-41d1-960e-a3a585bf0b6a admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:03.769136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f0214-7c04-41d1-960e-a3a585bf0b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:03.771113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f0214-7c04-41d1-960e-a3a585bf0b6a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:03.968063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 935/1872] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:03 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:03.968898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f0214-7c04-41d1-960e-a3a585bf0b6a admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:03.969606 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 938/1873] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:03 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:03.971212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bed9f2-42e0-4e57-9901-f68c508da332 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:03.984338 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f0214-7c04-41d1-960e-a3a585bf0b6a admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.050173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bed9f2-42e0-4e57-9901-f68c508da332 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.051071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fab7c-5e62-44c2-b32f-52b81aecd584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.051859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fab7c-5e62-44c2-b32f-52b81aecd584 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.052146 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fab7c-5e62-44c2-b32f-52b81aecd584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.052490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fab7c-5e62-44c2-b32f-52b81aecd584 admin admin] PATH_INFO: `/v3/projects/7a6cb504795141cbbab97936701b9dc1/users/c3c85e4e0d1e4c20880e9703ccd85bf6/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.054800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fab7c-5e62-44c2-b32f-52b81aecd584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6cb504795141cbbab97936701b9dc1, user_id=c3c85e4e0d1e4c20880e9703ccd85bf6, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.055257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b49728-d5a4-457d-b83d-8b0c3a18dacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.055871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49728-d5a4-457d-b83d-8b0c3a18dacb admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.056157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49728-d5a4-457d-b83d-8b0c3a18dacb admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.056433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b49728-d5a4-457d-b83d-8b0c3a18dacb admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.057076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49728-d5a4-457d-b83d-8b0c3a18dacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.057487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fab7c-5e62-44c2-b32f-52b81aecd584 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.059476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b49728-d5a4-457d-b83d-8b0c3a18dacb admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.074049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 939/1874] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:04.074049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b49728-d5a4-457d-b83d-8b0c3a18dacb admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:04.074296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 936/1875] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:03 2022] PUT /identity/v3/projects/7a6cb504795141cbbab97936701b9dc1/users/c3c85e4e0d1e4c20880e9703ccd85bf6/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:04.074296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fab7c-5e62-44c2-b32f-52b81aecd584 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:04.083295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b49728-d5a4-457d-b83d-8b0c3a18dacb admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.143630 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fab7c-5e62-44c2-b32f-52b81aecd584 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.149701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f00cb1-e0a6-4a90-bdbe-8c3efa5b2067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.152705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00cb1-e0a6-4a90-bdbe-8c3efa5b2067 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.152705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00cb1-e0a6-4a90-bdbe-8c3efa5b2067 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.152705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00cb1-e0a6-4a90-bdbe-8c3efa5b2067 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.152705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f00cb1-e0a6-4a90-bdbe-8c3efa5b2067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.153148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08642af-ccab-41d7-87c2-b33706b80b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.153242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f00cb1-e0a6-4a90-bdbe-8c3efa5b2067 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.153600 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08642af-ccab-41d7-87c2-b33706b80b95 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.153909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08642af-ccab-41d7-87c2-b33706b80b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.154885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08642af-ccab-41d7-87c2-b33706b80b95 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.155971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08642af-ccab-41d7-87c2-b33706b80b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.158698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08642af-ccab-41d7-87c2-b33706b80b95 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.164899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 937/1876] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:04.165841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f00cb1-e0a6-4a90-bdbe-8c3efa5b2067 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:04.179864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f00cb1-e0a6-4a90-bdbe-8c3efa5b2067 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.184573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfd015-2d00-4ea5-b10a-dde59415be40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.186120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd015-2d00-4ea5-b10a-dde59415be40 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.186120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd015-2d00-4ea5-b10a-dde59415be40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.186120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfd015-2d00-4ea5-b10a-dde59415be40 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.186643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfd015-2d00-4ea5-b10a-dde59415be40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.188090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfd015-2d00-4ea5-b10a-dde59415be40 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.199695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 938/1877] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:04.201913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e935d7-c58e-476b-af23-326dffd27eb6 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.202263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e935d7-c58e-476b-af23-326dffd27eb6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.202519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e935d7-c58e-476b-af23-326dffd27eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.245163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-88e935d7-c58e-476b-af23-326dffd27eb6 None None] MFA Rules not processed for user `c3c85e4e0d1e4c20880e9703ccd85bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:04.247349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-88e935d7-c58e-476b-af23-326dffd27eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:04.267342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 940/1878] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:04 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:04.268629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08642af-ccab-41d7-87c2-b33706b80b95 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:04.285855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08642af-ccab-41d7-87c2-b33706b80b95 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.285855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a75dd-188b-4ba2-bf49-05dbe9d68841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.286670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a75dd-188b-4ba2-bf49-05dbe9d68841 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.286670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a75dd-188b-4ba2-bf49-05dbe9d68841 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.286956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a75dd-188b-4ba2-bf49-05dbe9d68841 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.287652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a75dd-188b-4ba2-bf49-05dbe9d68841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.289327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a75dd-188b-4ba2-bf49-05dbe9d68841 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.303151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 941/1879] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:04.304619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a75dd-188b-4ba2-bf49-05dbe9d68841 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:04.321274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a75dd-188b-4ba2-bf49-05dbe9d68841 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.330055 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb224e70-0484-4d00-9829-8a8aaa6abf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.330749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb224e70-0484-4d00-9829-8a8aaa6abf87 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.336353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb224e70-0484-4d00-9829-8a8aaa6abf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.336353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb224e70-0484-4d00-9829-8a8aaa6abf87 admin admin] PATH_INFO: `/v3/projects/03f9bf8468db4a7ab1b577fb046ecc5d/users/0e4610785da94d7cae1d5f17b1f3362b/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.348439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb224e70-0484-4d00-9829-8a8aaa6abf87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f9bf8468db4a7ab1b577fb046ecc5d, user_id=0e4610785da94d7cae1d5f17b1f3362b, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.351639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb224e70-0484-4d00-9829-8a8aaa6abf87 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.393604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 939/1880] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:04.393604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e935d7-c58e-476b-af23-326dffd27eb6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:04.401260 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e935d7-c58e-476b-af23-326dffd27eb6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.407191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27ed4d-851e-4bc1-9805-ac1fd98702ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.407827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27ed4d-851e-4bc1-9805-ac1fd98702ea admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.408110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27ed4d-851e-4bc1-9805-ac1fd98702ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.408389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27ed4d-851e-4bc1-9805-ac1fd98702ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.409040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27ed4d-851e-4bc1-9805-ac1fd98702ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.410697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27ed4d-851e-4bc1-9805-ac1fd98702ea admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.421370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 940/1881] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:04.425151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27ed4d-851e-4bc1-9805-ac1fd98702ea admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:04.427446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 942/1882] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:04 2022] PUT /identity/v3/projects/03f9bf8468db4a7ab1b577fb046ecc5d/users/0e4610785da94d7cae1d5f17b1f3362b/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:04.428769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb224e70-0484-4d00-9829-8a8aaa6abf87 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:04.431023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cb224e70-0484-4d00-9829-8a8aaa6abf87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:04.435504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27ed4d-851e-4bc1-9805-ac1fd98702ea admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.496798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e74e14-3a86-4a6b-a474-aded97e3f30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.497455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e74e14-3a86-4a6b-a474-aded97e3f30e admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.498343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e74e14-3a86-4a6b-a474-aded97e3f30e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.502281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e74e14-3a86-4a6b-a474-aded97e3f30e admin admin] PATH_INFO: `/v3/projects/8348be33950d49ae945ac87889ad8e2c/users/08df1135397c40bb911711012b430609/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.502454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb224e70-0484-4d00-9829-8a8aaa6abf87 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.502797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfff51c-830a-4407-96d3-1cfdf62df998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.503461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfff51c-830a-4407-96d3-1cfdf62df998 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.503740 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfff51c-830a-4407-96d3-1cfdf62df998 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.504013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfff51c-830a-4407-96d3-1cfdf62df998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.514393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e74e14-3a86-4a6b-a474-aded97e3f30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8348be33950d49ae945ac87889ad8e2c, user_id=08df1135397c40bb911711012b430609, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.517248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e74e14-3a86-4a6b-a474-aded97e3f30e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.568297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfff51c-830a-4407-96d3-1cfdf62df998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.569853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfff51c-830a-4407-96d3-1cfdf62df998 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.577297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:04.584069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 943/1883] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:04.584937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfff51c-830a-4407-96d3-1cfdf62df998 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:04.595865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfff51c-830a-4407-96d3-1cfdf62df998 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.603402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430052b-4131-43b5-9a18-db3fa7a1838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.604294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430052b-4131-43b5-9a18-db3fa7a1838d admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.604692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430052b-4131-43b5-9a18-db3fa7a1838d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.605047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430052b-4131-43b5-9a18-db3fa7a1838d admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.605986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430052b-4131-43b5-9a18-db3fa7a1838d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.607782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430052b-4131-43b5-9a18-db3fa7a1838d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.626399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 944/1884] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:04.627863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a4d6-740f-4833-95ad-3b1d92d78332 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.628359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a4d6-740f-4833-95ad-3b1d92d78332 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.628621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0a4d6-740f-4833-95ad-3b1d92d78332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.657264 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 941/1885] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:04 2022] PUT /identity/v3/projects/8348be33950d49ae945ac87889ad8e2c/users/08df1135397c40bb911711012b430609/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:04.657264 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e74e14-3a86-4a6b-a474-aded97e3f30e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:04.663154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0da0a4d6-740f-4833-95ad-3b1d92d78332 None None] MFA Rules not processed for user `0e4610785da94d7cae1d5f17b1f3362b`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:04.664625 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0da0a4d6-740f-4833-95ad-3b1d92d78332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:04.751358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 945/1886] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:04.751358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db08f2-db49-4ce4-9c4a-94d8b2d928de None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.751358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db08f2-db49-4ce4-9c4a-94d8b2d928de None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.751358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db08f2-db49-4ce4-9c4a-94d8b2d928de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.755752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e74e14-3a86-4a6b-a474-aded97e3f30e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.761548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9f583-98b5-4f8d-910b-16cf06751538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.763132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9f583-98b5-4f8d-910b-16cf06751538 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.765023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9f583-98b5-4f8d-910b-16cf06751538 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.765701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9f583-98b5-4f8d-910b-16cf06751538 admin admin] PATH_INFO: `/v3/projects/ea1a20b915ae407ea2e21201cde35940/users/396092fe03b04ce383bdc7a2071eddf3/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.782427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-47db08f2-db49-4ce4-9c4a-94d8b2d928de None None] MFA Rules not processed for user `08df1135397c40bb911711012b430609`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:04.783780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-47db08f2-db49-4ce4-9c4a-94d8b2d928de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:04.822242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9f583-98b5-4f8d-910b-16cf06751538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1a20b915ae407ea2e21201cde35940, user_id=396092fe03b04ce383bdc7a2071eddf3, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.822242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9f583-98b5-4f8d-910b-16cf06751538 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.875424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 946/1887] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:04.875424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db08f2-db49-4ce4-9c4a-94d8b2d928de None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:04.901938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db08f2-db49-4ce4-9c4a-94d8b2d928de None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:04.907405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971622c9-01fe-4ab0-ac9d-ed29ab698f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:04.907957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971622c9-01fe-4ab0-ac9d-ed29ab698f2a admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:04.908235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971622c9-01fe-4ab0-ac9d-ed29ab698f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:04.908515 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971622c9-01fe-4ab0-ac9d-ed29ab698f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:04.909244 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971622c9-01fe-4ab0-ac9d-ed29ab698f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:04.911329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971622c9-01fe-4ab0-ac9d-ed29ab698f2a admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:04.958837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 942/1888] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:04 2022] PUT /identity/v3/projects/ea1a20b915ae407ea2e21201cde35940/users/396092fe03b04ce383bdc7a2071eddf3/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:04.958837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9f583-98b5-4f8d-910b-16cf06751538 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:05.015998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 947/1889] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:04 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:05.017457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f1ee2-8447-4601-b3e1-0b9d3c717509 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:05.017810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f1ee2-8447-4601-b3e1-0b9d3c717509 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:05.018090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f1ee2-8447-4601-b3e1-0b9d3c717509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:05.056600 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f11f1ee2-8447-4601-b3e1-0b9d3c717509 None None] MFA Rules not processed for user `396092fe03b04ce383bdc7a2071eddf3`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:05.056835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f11f1ee2-8447-4601-b3e1-0b9d3c717509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:05.119795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9f583-98b5-4f8d-910b-16cf06751538 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:05.173389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:05.221692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 948/1890] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:05.221692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f1ee2-8447-4601-b3e1-0b9d3c717509 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:05.263124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f039653-13fc-47aa-a6ca-5c35bed6f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:05.264796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039653-13fc-47aa-a6ca-5c35bed6f09d admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:05.265567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039653-13fc-47aa-a6ca-5c35bed6f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:05.265884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f039653-13fc-47aa-a6ca-5c35bed6f09d admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:05.266619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f039653-13fc-47aa-a6ca-5c35bed6f09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:05.269192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f039653-13fc-47aa-a6ca-5c35bed6f09d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:05.313981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f1ee2-8447-4601-b3e1-0b9d3c717509 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:05.319773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48b6b1-c4a9-4a4c-8221-f868d3e03d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:05.320478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b6b1-c4a9-4a4c-8221-f868d3e03d78 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:05.320687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b6b1-c4a9-4a4c-8221-f868d3e03d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:05.321020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b6b1-c4a9-4a4c-8221-f868d3e03d78 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:05.321703 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48b6b1-c4a9-4a4c-8221-f868d3e03d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:05.328840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48b6b1-c4a9-4a4c-8221-f868d3e03d78 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:05.361506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 943/1891] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:04 2022] POST /identity/v3/projects => generated 379 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:05.361506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f039653-13fc-47aa-a6ca-5c35bed6f09d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:05.467980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 949/1892] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:05 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:05.471407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48b6b1-c4a9-4a4c-8221-f868d3e03d78 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:05.472225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f039653-13fc-47aa-a6ca-5c35bed6f09d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:05.477777 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69dfcf-fbc6-4b27-b747-a19d7da5833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:05.478462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69dfcf-fbc6-4b27-b747-a19d7da5833e admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:05.478747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69dfcf-fbc6-4b27-b747-a19d7da5833e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:05.479057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69dfcf-fbc6-4b27-b747-a19d7da5833e admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:05.479722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69dfcf-fbc6-4b27-b747-a19d7da5833e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:05.482746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69dfcf-fbc6-4b27-b747-a19d7da5833e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:05.497217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48b6b1-c4a9-4a4c-8221-f868d3e03d78 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:05.503670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df6f18-d5c5-4f32-a2b3-aa060d99552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:05.504300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df6f18-d5c5-4f32-a2b3-aa060d99552b admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:05.504817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df6f18-d5c5-4f32-a2b3-aa060d99552b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:05.505621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df6f18-d5c5-4f32-a2b3-aa060d99552b admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:05.506413 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df6f18-d5c5-4f32-a2b3-aa060d99552b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:05.510406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df6f18-d5c5-4f32-a2b3-aa060d99552b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:05.636561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 950/1893] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:05 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:05.637467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df6f18-d5c5-4f32-a2b3-aa060d99552b admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:05.641225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 944/1894] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:05 2022] POST /identity/v3/projects => generated 377 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:05.642232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69dfcf-fbc6-4b27-b747-a19d7da5833e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:05.652319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df6f18-d5c5-4f32-a2b3-aa060d99552b admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:05.735785 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996a963-7a27-4052-8e9f-e3c5d295c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:05.736485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996a963-7a27-4052-8e9f-e3c5d295c961 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:05.736838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996a963-7a27-4052-8e9f-e3c5d295c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:05.737185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996a963-7a27-4052-8e9f-e3c5d295c961 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:05.737952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996a963-7a27-4052-8e9f-e3c5d295c961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:05.739355 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69dfcf-fbc6-4b27-b747-a19d7da5833e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:05.740443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996a963-7a27-4052-8e9f-e3c5d295c961 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:05.744673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b75b79-8c0f-46fa-863b-0aa87c195857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:05.746156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b75b79-8c0f-46fa-863b-0aa87c195857 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:05.746156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b75b79-8c0f-46fa-863b-0aa87c195857 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:05.746156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b75b79-8c0f-46fa-863b-0aa87c195857 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:05.746878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b75b79-8c0f-46fa-863b-0aa87c195857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:05.749908 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b75b79-8c0f-46fa-863b-0aa87c195857 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:05.753554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 951/1895] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:05.754605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996a963-7a27-4052-8e9f-e3c5d295c961 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:05.763793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 945/1896] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:05.764811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b75b79-8c0f-46fa-863b-0aa87c195857 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:05.765444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996a963-7a27-4052-8e9f-e3c5d295c961 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:05.770156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58cf43-d9aa-4d5f-8c12-91238ab68c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:05.770760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58cf43-d9aa-4d5f-8c12-91238ab68c2b admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:05.771444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58cf43-d9aa-4d5f-8c12-91238ab68c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:05.771444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58cf43-d9aa-4d5f-8c12-91238ab68c2b admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:05.771928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58cf43-d9aa-4d5f-8c12-91238ab68c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:05.774112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58cf43-d9aa-4d5f-8c12-91238ab68c2b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:05.775209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b75b79-8c0f-46fa-863b-0aa87c195857 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:05.781245 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094dbd5-8fd8-4c41-bf13-a7f8d4845035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:05.781865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094dbd5-8fd8-4c41-bf13-a7f8d4845035 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:05.782282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094dbd5-8fd8-4c41-bf13-a7f8d4845035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:05.786047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094dbd5-8fd8-4c41-bf13-a7f8d4845035 admin admin] PATH_INFO: `/v3/projects/930376ab70c4486893937d1f4a1b0d16/users/239d48b1bc5d455796eb99de019b43b1/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:05.800859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094dbd5-8fd8-4c41-bf13-a7f8d4845035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930376ab70c4486893937d1f4a1b0d16, user_id=239d48b1bc5d455796eb99de019b43b1, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:05.803729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094dbd5-8fd8-4c41-bf13-a7f8d4845035 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:05.853148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 952/1897] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:05 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:05.854038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58cf43-d9aa-4d5f-8c12-91238ab68c2b admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:05.864612 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58cf43-d9aa-4d5f-8c12-91238ab68c2b admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:05.869467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2624a-cee1-4e53-b8b5-f485f5993af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:05.870572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2624a-cee1-4e53-b8b5-f485f5993af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:05.870572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2624a-cee1-4e53-b8b5-f485f5993af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:05.870893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2624a-cee1-4e53-b8b5-f485f5993af9 admin admin] PATH_INFO: `/v3/projects/18bb4600f7eb4c81bc4215179fbd582c/users/1630af7d1b854d05a43719f2033856ef/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:05.887930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2624a-cee1-4e53-b8b5-f485f5993af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18bb4600f7eb4c81bc4215179fbd582c, user_id=1630af7d1b854d05a43719f2033856ef, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:05.891019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2624a-cee1-4e53-b8b5-f485f5993af9 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:05.895987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 946/1898] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:05 2022] PUT /identity/v3/projects/930376ab70c4486893937d1f4a1b0d16/users/239d48b1bc5d455796eb99de019b43b1/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:05.897378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094dbd5-8fd8-4c41-bf13-a7f8d4845035 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:05.978189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094dbd5-8fd8-4c41-bf13-a7f8d4845035 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:05.987865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 953/1899] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:05 2022] PUT /identity/v3/projects/18bb4600f7eb4c81bc4215179fbd582c/users/1630af7d1b854d05a43719f2033856ef/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:05.987865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2624a-cee1-4e53-b8b5-f485f5993af9 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:06.075516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf4b9c-05e8-4b06-bb1d-47da4ae437ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:06.076605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf4b9c-05e8-4b06-bb1d-47da4ae437ab admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.076605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf4b9c-05e8-4b06-bb1d-47da4ae437ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.076983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf4b9c-05e8-4b06-bb1d-47da4ae437ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.077676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf4b9c-05e8-4b06-bb1d-47da4ae437ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:06.079584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf4b9c-05e8-4b06-bb1d-47da4ae437ab admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:06.093661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 947/1900] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:06.094158 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf4b9c-05e8-4b06-bb1d-47da4ae437ab admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:06.104917 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf4b9c-05e8-4b06-bb1d-47da4ae437ab admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:06.114454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5319fd-ec80-47c7-9050-6325eea450f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:06.119182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5319fd-ec80-47c7-9050-6325eea450f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.119182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5319fd-ec80-47c7-9050-6325eea450f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.119182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5319fd-ec80-47c7-9050-6325eea450f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.119182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5319fd-ec80-47c7-9050-6325eea450f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:06.131110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5319fd-ec80-47c7-9050-6325eea450f1 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:06.133806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2624a-cee1-4e53-b8b5-f485f5993af9 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:06.140212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf71242-d0e8-44dd-8745-34e62082221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:06.140852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf71242-d0e8-44dd-8745-34e62082221c admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.141138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf71242-d0e8-44dd-8745-34e62082221c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.141490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf71242-d0e8-44dd-8745-34e62082221c admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.142520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf71242-d0e8-44dd-8745-34e62082221c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:06.143110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 948/1901] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:06.143940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5319fd-ec80-47c7-9050-6325eea450f1 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:06.144365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf71242-d0e8-44dd-8745-34e62082221c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:06.155857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5319fd-ec80-47c7-9050-6325eea450f1 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:06.161717 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 954/1902] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:06.161717 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf71242-d0e8-44dd-8745-34e62082221c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:06.163568 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-abf71242-d0e8-44dd-8745-34e62082221c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:06.165095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af6206-c90e-4ebb-b405-42dfd8930ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:06.165885 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af6206-c90e-4ebb-b405-42dfd8930ada admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.166247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af6206-c90e-4ebb-b405-42dfd8930ada admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.166590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af6206-c90e-4ebb-b405-42dfd8930ada admin admin] PATH_INFO: `/v3/projects/053f57e4898144ac8e9ebae63c355cf5/users/d8fbc41c5c314abaa4b289054ed31337/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.179553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:06.191290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af6206-c90e-4ebb-b405-42dfd8930ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=053f57e4898144ac8e9ebae63c355cf5, user_id=d8fbc41c5c314abaa4b289054ed31337, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:06.194880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af6206-c90e-4ebb-b405-42dfd8930ada admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:06.210793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:06.240242 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf71242-d0e8-44dd-8745-34e62082221c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:06.244386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd4956-4507-40ef-91d7-3c32f40c8b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:06.249323 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd4956-4507-40ef-91d7-3c32f40c8b2e service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.249323 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd4956-4507-40ef-91d7-3c32f40c8b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.249323 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd4956-4507-40ef-91d7-3c32f40c8b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.249323 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-96bd4956-4507-40ef-91d7-3c32f40c8b2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:06.280557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 949/1903] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:06 2022] PUT /identity/v3/projects/053f57e4898144ac8e9ebae63c355cf5/users/d8fbc41c5c314abaa4b289054ed31337/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:06.281779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af6206-c90e-4ebb-b405-42dfd8930ada admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:06.310869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd4956-4507-40ef-91d7-3c32f40c8b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:06.312413 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd4956-4507-40ef-91d7-3c32f40c8b2e service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:06.322002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 955/1904] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:06.322817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd4956-4507-40ef-91d7-3c32f40c8b2e service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:06.334796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd4956-4507-40ef-91d7-3c32f40c8b2e service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:06.348846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af6206-c90e-4ebb-b405-42dfd8930ada admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:06.354694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a6b24-8c73-4499-b62f-0e20124bea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:06.355714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a6b24-8c73-4499-b62f-0e20124bea57 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.356148 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a6b24-8c73-4499-b62f-0e20124bea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.366134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a6b24-8c73-4499-b62f-0e20124bea57 admin admin] PATH_INFO: `/v3/projects/18bb4600f7eb4c81bc4215179fbd582c/users/1630af7d1b854d05a43719f2033856ef/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.366134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a6b24-8c73-4499-b62f-0e20124bea57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18bb4600f7eb4c81bc4215179fbd582c, user_id=1630af7d1b854d05a43719f2033856ef, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:06.366134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a6b24-8c73-4499-b62f-0e20124bea57 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:06.376677 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 950/1905] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:06 2022] PUT /identity/v3/projects/18bb4600f7eb4c81bc4215179fbd582c/users/1630af7d1b854d05a43719f2033856ef/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:06.378198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a6b24-8c73-4499-b62f-0e20124bea57 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:06.424514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8e68b-758d-431d-bfe6-c3a05f96a6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:06.425890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8e68b-758d-431d-bfe6-c3a05f96a6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.426337 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8e68b-758d-431d-bfe6-c3a05f96a6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.426883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8e68b-758d-431d-bfe6-c3a05f96a6c8 admin admin] PATH_INFO: `/v3/projects/930376ab70c4486893937d1f4a1b0d16/users/239d48b1bc5d455796eb99de019b43b1/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.430388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8e68b-758d-431d-bfe6-c3a05f96a6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930376ab70c4486893937d1f4a1b0d16, user_id=239d48b1bc5d455796eb99de019b43b1, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:06.435136 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8e68b-758d-431d-bfe6-c3a05f96a6c8 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:06.460996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 956/1906] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:06 2022] PUT /identity/v3/projects/930376ab70c4486893937d1f4a1b0d16/users/239d48b1bc5d455796eb99de019b43b1/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:06.460996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969f117-2070-4b86-a3bc-5fcc7a4df192 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.460996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969f117-2070-4b86-a3bc-5fcc7a4df192 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.460996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969f117-2070-4b86-a3bc-5fcc7a4df192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.482982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a6b24-8c73-4499-b62f-0e20124bea57 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:06.495097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-7969f117-2070-4b86-a3bc-5fcc7a4df192 None None] MFA Rules not processed for user `1630af7d1b854d05a43719f2033856ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:06.496426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7969f117-2070-4b86-a3bc-5fcc7a4df192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:06.570573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683112fc-0150-41dd-845d-3f9f009bf776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:06.571199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683112fc-0150-41dd-845d-3f9f009bf776 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.571598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683112fc-0150-41dd-845d-3f9f009bf776 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.571891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683112fc-0150-41dd-845d-3f9f009bf776 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.572552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683112fc-0150-41dd-845d-3f9f009bf776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:06.574773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683112fc-0150-41dd-845d-3f9f009bf776 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:06.591090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 951/1907] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:06.595259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc52b-211b-46a7-8589-e3741772b9c6 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.595745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc52b-211b-46a7-8589-e3741772b9c6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.597670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdc52b-211b-46a7-8589-e3741772b9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.619940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 957/1908] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:06.626393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969f117-2070-4b86-a3bc-5fcc7a4df192 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:06.647695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-40bdc52b-211b-46a7-8589-e3741772b9c6 None None] MFA Rules not processed for user `239d48b1bc5d455796eb99de019b43b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:06.647695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-40bdc52b-211b-46a7-8589-e3741772b9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:06.649740 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969f117-2070-4b86-a3bc-5fcc7a4df192 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:06.660281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d5741-414f-4360-a5bd-78b19b442c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:06.660992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d5741-414f-4360-a5bd-78b19b442c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.661273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d5741-414f-4360-a5bd-78b19b442c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.661554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d5741-414f-4360-a5bd-78b19b442c1f admin admin] PATH_INFO: `/v3/projects/053f57e4898144ac8e9ebae63c355cf5/users/d8fbc41c5c314abaa4b289054ed31337/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.667469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d5741-414f-4360-a5bd-78b19b442c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=053f57e4898144ac8e9ebae63c355cf5, user_id=d8fbc41c5c314abaa4b289054ed31337, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:06.672105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d5741-414f-4360-a5bd-78b19b442c1f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:06.684686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 958/1909] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:06 2022] PUT /identity/v3/projects/053f57e4898144ac8e9ebae63c355cf5/users/d8fbc41c5c314abaa4b289054ed31337/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:06.714664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b0c5a-ba90-4309-a75a-320faec5c942 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.715113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b0c5a-ba90-4309-a75a-320faec5c942 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.716547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b0c5a-ba90-4309-a75a-320faec5c942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:06.759975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-134b0c5a-ba90-4309-a75a-320faec5c942 None None] MFA Rules not processed for user `d8fbc41c5c314abaa4b289054ed31337`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:06.761451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-134b0c5a-ba90-4309-a75a-320faec5c942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:06.792241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 952/1910] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:06.807696 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdc52b-211b-46a7-8589-e3741772b9c6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:06.928923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdc52b-211b-46a7-8589-e3741772b9c6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:06.948062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 959/1911] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:06.995559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42b3f5-6347-4ca3-a24c-8a957958535a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:06.996286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42b3f5-6347-4ca3-a24c-8a957958535a service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:06.996708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42b3f5-6347-4ca3-a24c-8a957958535a service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:06.997744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42b3f5-6347-4ca3-a24c-8a957958535a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:07.064421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42b3f5-6347-4ca3-a24c-8a957958535a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:07.066268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42b3f5-6347-4ca3-a24c-8a957958535a service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:07.078070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 953/1912] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:07.124815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b0c5a-ba90-4309-a75a-320faec5c942 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:07.139650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b0c5a-ba90-4309-a75a-320faec5c942 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:07.143642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b947aa-dfd4-4796-ada1-6199b66fc1de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:07.144273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b947aa-dfd4-4796-ada1-6199b66fc1de service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:07.144801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b947aa-dfd4-4796-ada1-6199b66fc1de service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:07.145083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b947aa-dfd4-4796-ada1-6199b66fc1de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:07.236962 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b947aa-dfd4-4796-ada1-6199b66fc1de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:07.239657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b947aa-dfd4-4796-ada1-6199b66fc1de service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:07.271397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 960/1913] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:07.285795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42b3f5-6347-4ca3-a24c-8a957958535a service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:07.298741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42b3f5-6347-4ca3-a24c-8a957958535a service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:07.307370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd617cb-d380-4de5-817b-e9dabefe7d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:07.308185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd617cb-d380-4de5-817b-e9dabefe7d58 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:07.308679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd617cb-d380-4de5-817b-e9dabefe7d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:07.309204 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd617cb-d380-4de5-817b-e9dabefe7d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:07.413905 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd617cb-d380-4de5-817b-e9dabefe7d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:07.415739 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd617cb-d380-4de5-817b-e9dabefe7d58 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:07.442322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 954/1914] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:07.487929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:08.196132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:09.219612 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:09.614622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b947aa-dfd4-4796-ada1-6199b66fc1de service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:09.642063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b947aa-dfd4-4796-ada1-6199b66fc1de service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:09.642063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a1e70-7c0a-4a5b-b4e4-cba9ed34403f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:09.642063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1e70-7c0a-4a5b-b4e4-cba9ed34403f service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:09.642063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1e70-7c0a-4a5b-b4e4-cba9ed34403f service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:09.642645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a1e70-7c0a-4a5b-b4e4-cba9ed34403f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:09.686510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a1e70-7c0a-4a5b-b4e4-cba9ed34403f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:09.687961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a1e70-7c0a-4a5b-b4e4-cba9ed34403f service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:09.697932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 961/1915] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:10.100484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ff53-b4d1-4a59-895c-bfc43f6a8687 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:10.101290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ff53-b4d1-4a59-895c-bfc43f6a8687 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:10.101290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ff53-b4d1-4a59-895c-bfc43f6a8687 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:10.102505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 955/1916] 10.222.0.74 () {54 vars in 921 bytes} [Wed Aug 31 00:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:37:10.116736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159a40d-7d95-4dfc-8784-868394460d2f None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:10.117040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159a40d-7d95-4dfc-8784-868394460d2f None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:10.117313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159a40d-7d95-4dfc-8784-868394460d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:10.152857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2159a40d-7d95-4dfc-8784-868394460d2f None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:10.154247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2159a40d-7d95-4dfc-8784-868394460d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:10.275529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 962/1917] 10.222.0.74 () {58 vars in 1018 bytes} [Wed Aug 31 00:37:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:10.315765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ff53-b4d1-4a59-895c-bfc43f6a8687 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:10.317669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a286ff53-b4d1-4a59-895c-bfc43f6a8687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:10.336128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ff53-b4d1-4a59-895c-bfc43f6a8687 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:10.342719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd62f-f164-4e0e-9301-b12bfc58a016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:10.343819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd62f-f164-4e0e-9301-b12bfc58a016 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:10.343819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd62f-f164-4e0e-9301-b12bfc58a016 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:10.343986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd62f-f164-4e0e-9301-b12bfc58a016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:10.358148 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dd62f-f164-4e0e-9301-b12bfc58a016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:10.359903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dd62f-f164-4e0e-9301-b12bfc58a016 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:10.372593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 956/1918] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:11.043689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:11.662842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159a40d-7d95-4dfc-8784-868394460d2f None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:11.674476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159a40d-7d95-4dfc-8784-868394460d2f None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:11.692810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab8c04-a846-4ff5-84f7-3d46c89cfb5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:11.693943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab8c04-a846-4ff5-84f7-3d46c89cfb5f service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:11.694299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab8c04-a846-4ff5-84f7-3d46c89cfb5f service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:11.694735 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab8c04-a846-4ff5-84f7-3d46c89cfb5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:11.709724 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab8c04-a846-4ff5-84f7-3d46c89cfb5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:11.712336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab8c04-a846-4ff5-84f7-3d46c89cfb5f service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:11.724544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 963/1919] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:11.879622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:12.116877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd62f-f164-4e0e-9301-b12bfc58a016 service nova] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:12.127026 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd62f-f164-4e0e-9301-b12bfc58a016 service nova] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:12.130898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5b8e3-0345-4808-aa5c-b761aa57da08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:12.131508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5b8e3-0345-4808-aa5c-b761aa57da08 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:12.131788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5b8e3-0345-4808-aa5c-b761aa57da08 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:12.132064 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5b8e3-0345-4808-aa5c-b761aa57da08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:12.133852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-73d5b8e3-0345-4808-aa5c-b761aa57da08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:12.196802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5b8e3-0345-4808-aa5c-b761aa57da08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:12.198276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5b8e3-0345-4808-aa5c-b761aa57da08 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:12.207810 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 957/1920] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:12.650112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:12.762024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab8c04-a846-4ff5-84f7-3d46c89cfb5f service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:12.863548 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab8c04-a846-4ff5-84f7-3d46c89cfb5f service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:12.868932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:12.869604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:12.869876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:12.870152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] PATH_INFO: `/v3/users/618bf841385c47fbaedd92117ce5b758` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:12.871282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] RBAC: Authorizing `identity:delete_user(user_id=618bf841385c47fbaedd92117ce5b758)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:12.873794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:13.129100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '618bf841385c47fbaedd92117ce5b758'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:13.150092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '618bf841385c47fbaedd92117ce5b758'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:13.160580 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '618bf841385c47fbaedd92117ce5b758'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:13.224189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '618bf841385c47fbaedd92117ce5b758'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:13.224849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '618bf841385c47fbaedd92117ce5b758'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:13.234097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 964/1921] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:12 2022] DELETE /identity/v3/users/618bf841385c47fbaedd92117ce5b758 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:13.237930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45146369-51bc-4cfe-ba00-ed2d0939325c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:13.238411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45146369-51bc-4cfe-ba00-ed2d0939325c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:13.238502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45146369-51bc-4cfe-ba00-ed2d0939325c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:13.258439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-45146369-51bc-4cfe-ba00-ed2d0939325c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:13.259644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-45146369-51bc-4cfe-ba00-ed2d0939325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:13.321655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 958/1922] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:13.333521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:13.334972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:13.413657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8cd38-1589-4e4f-a697-a25fddabf99b admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:13.422777 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41360506-d5a1-4352-9d17-dfece14db698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:13.424920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360506-d5a1-4352-9d17-dfece14db698 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:13.425339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360506-d5a1-4352-9d17-dfece14db698 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:13.425884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360506-d5a1-4352-9d17-dfece14db698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:13.437760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41360506-d5a1-4352-9d17-dfece14db698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:13.439219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41360506-d5a1-4352-9d17-dfece14db698 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:13.449371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 965/1923] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:13.493098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:14.465274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45146369-51bc-4cfe-ba00-ed2d0939325c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:14.467931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-45146369-51bc-4cfe-ba00-ed2d0939325c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:14.485405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45146369-51bc-4cfe-ba00-ed2d0939325c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:14.491054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:14.491698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:14.492163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:14.492444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] PATH_INFO: `/v3/projects/fd0d5ccbb4654403a1d84010f40e17d3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:14.493629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0d5ccbb4654403a1d84010f40e17d3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:14.495575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:14.665884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0d5ccbb4654403a1d84010f40e17d3', 'request_id': 'req-decc9639-01a7-4df9-95ef-6c0ea49997e4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:14.666730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:14.672845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0d5ccbb4654403a1d84010f40e17d3', 'request_id': 'req-decc9639-01a7-4df9-95ef-6c0ea49997e4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:14.680174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0d5ccbb4654403a1d84010f40e17d3', 'request_id': 'req-decc9639-01a7-4df9-95ef-6c0ea49997e4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:14.775272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] The token cache is being invalidate because project fd0d5ccbb4654403a1d84010f40e17d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:14.775463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:14.776189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:14.777781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 959/1924] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:14 2022] DELETE /identity/v3/projects/fd0d5ccbb4654403a1d84010f40e17d3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:14.782416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41360506-d5a1-4352-9d17-dfece14db698 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:14.792101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41360506-d5a1-4352-9d17-dfece14db698 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:14.854738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:14.855383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:14.855669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:14.855946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] PATH_INFO: `/v3/users/0e4610785da94d7cae1d5f17b1f3362b` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:14.857085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4610785da94d7cae1d5f17b1f3362b)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:14.859065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:15.127104 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4610785da94d7cae1d5f17b1f3362b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:15.139931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4610785da94d7cae1d5f17b1f3362b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:15.148202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4610785da94d7cae1d5f17b1f3362b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:15.249993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4610785da94d7cae1d5f17b1f3362b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:15.250672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4610785da94d7cae1d5f17b1f3362b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:15.257688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 966/1925] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:14 2022] DELETE /identity/v3/users/0e4610785da94d7cae1d5f17b1f3362b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:16.046707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:16.049183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:16.068548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc9639-01a7-4df9-95ef-6c0ea49997e4 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:16.131317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:16.131958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:16.132236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:16.132509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] PATH_INFO: `/v3/projects/03f9bf8468db4a7ab1b577fb046ecc5d` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:16.133668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f9bf8468db4a7ab1b577fb046ecc5d)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:16.136734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:16.270563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f9bf8468db4a7ab1b577fb046ecc5d', 'request_id': 'req-eec6232c-d35e-4529-a630-a50e48ff2f5c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:16.276065 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f9bf8468db4a7ab1b577fb046ecc5d', 'request_id': 'req-eec6232c-d35e-4529-a630-a50e48ff2f5c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:16.284632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:16.285757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f9bf8468db4a7ab1b577fb046ecc5d', 'request_id': 'req-eec6232c-d35e-4529-a630-a50e48ff2f5c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:16.395524 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:16.435471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] The token cache is being invalidate because project 03f9bf8468db4a7ab1b577fb046ecc5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:16.435579 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:16.436219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:16.438692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 960/1926] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:16 2022] DELETE /identity/v3/projects/03f9bf8468db4a7ab1b577fb046ecc5d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:16.441956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:16.444467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:16.459318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9095aa-dfab-43bd-983e-a611082e5b2a admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:16.537476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:16.538229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:16.538546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:16.538898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] PATH_INFO: `/v3/users/239d48b1bc5d455796eb99de019b43b1` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:16.540119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=239d48b1bc5d455796eb99de019b43b1)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:16.542160 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:16.775750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '239d48b1bc5d455796eb99de019b43b1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:16.787986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '239d48b1bc5d455796eb99de019b43b1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:16.795395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '239d48b1bc5d455796eb99de019b43b1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:16.858755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '239d48b1bc5d455796eb99de019b43b1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:16.859521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '239d48b1bc5d455796eb99de019b43b1'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:16.866183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 967/1927] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:16 2022] DELETE /identity/v3/users/239d48b1bc5d455796eb99de019b43b1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:17.099479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:17.101090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:17.117926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6232c-d35e-4529-a630-a50e48ff2f5c admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:17.183975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:17.185338 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:17.186113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:17.186662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] PATH_INFO: `/v3/users/41e60e5f96eb420984e3f5f810c402b1` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:17.188343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e60e5f96eb420984e3f5f810c402b1)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:17.190622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:17.335407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:17.338296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:17.369905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9c3da-7dde-4fb2-b9f2-eb64d8c3ece3 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:17.377699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:17.378423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:17.378715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:17.378994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] PATH_INFO: `/v3/projects/930376ab70c4486893937d1f4a1b0d16` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:17.380283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=930376ab70c4486893937d1f4a1b0d16)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:17.382288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:17.425500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e60e5f96eb420984e3f5f810c402b1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:17.495416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e60e5f96eb420984e3f5f810c402b1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:17.509954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e60e5f96eb420984e3f5f810c402b1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:17.518132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e60e5f96eb420984e3f5f810c402b1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:17.518381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930376ab70c4486893937d1f4a1b0d16', 'request_id': 'req-d3708e66-9389-461f-82f4-7e576f335190'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:17.519122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e60e5f96eb420984e3f5f810c402b1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:17.525353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 961/1928] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:17 2022] DELETE /identity/v3/users/41e60e5f96eb420984e3f5f810c402b1 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:17.526244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:17.528304 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:17.595209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f13f0-48f1-417e-869f-4511ce0df418 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:17.600526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649956a-2d0c-4d39-ba19-8ccc23f878a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:17.601648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649956a-2d0c-4d39-ba19-8ccc23f878a5 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:17.602162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649956a-2d0c-4d39-ba19-8ccc23f878a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:17.602664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649956a-2d0c-4d39-ba19-8ccc23f878a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:17.604846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6649956a-2d0c-4d39-ba19-8ccc23f878a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:17.609497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930376ab70c4486893937d1f4a1b0d16', 'request_id': 'req-d3708e66-9389-461f-82f4-7e576f335190'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:17.616205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930376ab70c4486893937d1f4a1b0d16', 'request_id': 'req-d3708e66-9389-461f-82f4-7e576f335190'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:17.628880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] The token cache is being invalidate because project 930376ab70c4486893937d1f4a1b0d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:17.629177 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:17.629891 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:17.631608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 968/1929] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:17 2022] DELETE /identity/v3/projects/930376ab70c4486893937d1f4a1b0d16 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:17.636012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:17.636012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:17.673395 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649956a-2d0c-4d39-ba19-8ccc23f878a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:17.674983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649956a-2d0c-4d39-ba19-8ccc23f878a5 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:17.686745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 962/1930] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:17.688062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e02b-8766-4022-b678-c7c3ee5e7b8c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:17.688350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e02b-8766-4022-b678-c7c3ee5e7b8c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:17.688628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742e02b-8766-4022-b678-c7c3ee5e7b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:17.705121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3708e66-9389-461f-82f4-7e576f335190 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:17.709028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-5742e02b-8766-4022-b678-c7c3ee5e7b8c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:17.710297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5742e02b-8766-4022-b678-c7c3ee5e7b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:17.783945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dec22-bbbd-4bbb-bf5f-9c89a1a8ccde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:17.784676 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dec22-bbbd-4bbb-bf5f-9c89a1a8ccde admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:17.785031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dec22-bbbd-4bbb-bf5f-9c89a1a8ccde admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:17.785376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dec22-bbbd-4bbb-bf5f-9c89a1a8ccde admin admin] PATH_INFO: `/v3/users/f6a1952e07ff4faeb09f0146a9fbc3cb` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:17.786830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dec22-bbbd-4bbb-bf5f-9c89a1a8ccde admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a1952e07ff4faeb09f0146a9fbc3cb)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:17.790891 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dec22-bbbd-4bbb-bf5f-9c89a1a8ccde admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:17.811478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 963/1931] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:17.813143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb063523-7e1a-4df2-9ff2-28aeb9169123 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:17.813439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb063523-7e1a-4df2-9ff2-28aeb9169123 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:17.813964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb063523-7e1a-4df2-9ff2-28aeb9169123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:17.836220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-eb063523-7e1a-4df2-9ff2-28aeb9169123 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:17.837492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-eb063523-7e1a-4df2-9ff2-28aeb9169123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:17.847656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 964/1932] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:17.854722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb063523-7e1a-4df2-9ff2-28aeb9169123 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:17.854722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-eb063523-7e1a-4df2-9ff2-28aeb9169123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:17.916608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb063523-7e1a-4df2-9ff2-28aeb9169123 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:17.921554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252ef6b-2f66-4ba0-8de5-538d314420cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:17.922208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252ef6b-2f66-4ba0-8de5-538d314420cd service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:17.923000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252ef6b-2f66-4ba0-8de5-538d314420cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:17.923278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252ef6b-2f66-4ba0-8de5-538d314420cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:17.925406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:17.933614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252ef6b-2f66-4ba0-8de5-538d314420cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:17.940389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252ef6b-2f66-4ba0-8de5-538d314420cd service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:17.967674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 965/1933] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:17.969045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d806-aec5-4a52-8a6f-1c41b30ee2f4 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:17.969343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d806-aec5-4a52-8a6f-1c41b30ee2f4 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:17.969933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d806-aec5-4a52-8a6f-1c41b30ee2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:18.005318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-5f56d806-aec5-4a52-8a6f-1c41b30ee2f4 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:18.005318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5f56d806-aec5-4a52-8a6f-1c41b30ee2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:18.006705 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e32dec22-bbbd-4bbb-bf5f-9c89a1a8ccde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a1952e07ff4faeb09f0146a9fbc3cb'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:18.018390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 966/1934] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:18.022366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56d806-aec5-4a52-8a6f-1c41b30ee2f4 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:18.023735 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e32dec22-bbbd-4bbb-bf5f-9c89a1a8ccde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a1952e07ff4faeb09f0146a9fbc3cb'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:18.031833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e32dec22-bbbd-4bbb-bf5f-9c89a1a8ccde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a1952e07ff4faeb09f0146a9fbc3cb'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:18.038073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56d806-aec5-4a52-8a6f-1c41b30ee2f4 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:18.043716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e39d-8583-4fab-8251-e5dca2355646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:18.044646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e39d-8583-4fab-8251-e5dca2355646 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:18.045322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e39d-8583-4fab-8251-e5dca2355646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:18.045776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e39d-8583-4fab-8251-e5dca2355646 admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:18.046564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e39d-8583-4fab-8251-e5dca2355646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:18.046942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e39d-8583-4fab-8251-e5dca2355646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:18.048779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955e39d-8583-4fab-8251-e5dca2355646 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:18.063791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 967/1935] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:18.071430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e39d-8583-4fab-8251-e5dca2355646 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:18.094171 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e39d-8583-4fab-8251-e5dca2355646 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:18.106552 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e32dec22-bbbd-4bbb-bf5f-9c89a1a8ccde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a1952e07ff4faeb09f0146a9fbc3cb'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:18.108149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71044f49-82a8-4cb2-bdaa-b5b567d31a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:18.109366 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e32dec22-bbbd-4bbb-bf5f-9c89a1a8ccde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a1952e07ff4faeb09f0146a9fbc3cb'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:18.111168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71044f49-82a8-4cb2-bdaa-b5b567d31a47 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:18.111470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71044f49-82a8-4cb2-bdaa-b5b567d31a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:18.112109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71044f49-82a8-4cb2-bdaa-b5b567d31a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:18.113680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71044f49-82a8-4cb2-bdaa-b5b567d31a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:18.115793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71044f49-82a8-4cb2-bdaa-b5b567d31a47 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:18.120406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 969/1936] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:17 2022] DELETE /identity/v3/users/f6a1952e07ff4faeb09f0146a9fbc3cb => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:18.125010 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aa08d-511f-4f32-9395-932b269cfae8 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:18.125365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aa08d-511f-4f32-9395-932b269cfae8 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:18.125667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aa08d-511f-4f32-9395-932b269cfae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:18.165941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-257aa08d-511f-4f32-9395-932b269cfae8 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:18.167238 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-257aa08d-511f-4f32-9395-932b269cfae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:18.225626 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 968/1937] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:18 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:18.230354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71044f49-82a8-4cb2-bdaa-b5b567d31a47 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:18.232883 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-71044f49-82a8-4cb2-bdaa-b5b567d31a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:18.291333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 970/1938] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:18.317531 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257aa08d-511f-4f32-9395-932b269cfae8 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:18.319270 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-257aa08d-511f-4f32-9395-932b269cfae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:18.369807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71044f49-82a8-4cb2-bdaa-b5b567d31a47 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:18.375765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd2361-1d18-447d-82ba-9889e731414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:18.376561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2361-1d18-447d-82ba-9889e731414c admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:18.377746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2361-1d18-447d-82ba-9889e731414c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:18.378283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2361-1d18-447d-82ba-9889e731414c admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:18.379742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd2361-1d18-447d-82ba-9889e731414c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:18.382247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd2361-1d18-447d-82ba-9889e731414c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:18.390682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:18.452490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257aa08d-511f-4f32-9395-932b269cfae8 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:18.536495 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 969/1939] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:18 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:18.541153 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd2361-1d18-447d-82ba-9889e731414c admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:18.541305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c26b3-ee9a-4384-acf9-f3bf02e040a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:18.542083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c26b3-ee9a-4384-acf9-f3bf02e040a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:18.542315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c26b3-ee9a-4384-acf9-f3bf02e040a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:18.542592 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c26b3-ee9a-4384-acf9-f3bf02e040a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:18.555833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c26b3-ee9a-4384-acf9-f3bf02e040a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:18.557700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd2361-1d18-447d-82ba-9889e731414c admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:18.557826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c26b3-ee9a-4384-acf9-f3bf02e040a2 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:18.564581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234a2a-b930-4435-846b-378da6b756af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:18.565250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234a2a-b930-4435-846b-378da6b756af admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:18.565489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234a2a-b930-4435-846b-378da6b756af admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:18.565783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234a2a-b930-4435-846b-378da6b756af admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:18.566535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d234a2a-b930-4435-846b-378da6b756af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:18.569056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d234a2a-b930-4435-846b-378da6b756af admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:18.569213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 971/1940] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:18.581190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 970/1941] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:18.585504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c26b3-ee9a-4384-acf9-f3bf02e040a2 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:18.598307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c26b3-ee9a-4384-acf9-f3bf02e040a2 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:18.604645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2f330-8a04-4e60-85c5-f19bd1f1f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:18.605340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2f330-8a04-4e60-85c5-f19bd1f1f9bd admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:18.605716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2f330-8a04-4e60-85c5-f19bd1f1f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:18.606076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2f330-8a04-4e60-85c5-f19bd1f1f9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:18.606915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2f330-8a04-4e60-85c5-f19bd1f1f9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:18.608754 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2f330-8a04-4e60-85c5-f19bd1f1f9bd admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:18.633230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 972/1942] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:18.635103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234a2a-b930-4435-846b-378da6b756af admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:18.647045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2f330-8a04-4e60-85c5-f19bd1f1f9bd admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:18.649417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-87f2f330-8a04-4e60-85c5-f19bd1f1f9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:18.650827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234a2a-b930-4435-846b-378da6b756af admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:18.657863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b382a2c-accd-46ad-8e52-6122af8eb772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:18.658703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382a2c-accd-46ad-8e52-6122af8eb772 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:18.659164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382a2c-accd-46ad-8e52-6122af8eb772 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:18.659500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382a2c-accd-46ad-8e52-6122af8eb772 admin admin] PATH_INFO: `/v3/projects/09e3cb2fe3b94ac9a6974c66497c4e93/users/22a4a3b4cb3f4093a84a73726976e8ed/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:18.665433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2f330-8a04-4e60-85c5-f19bd1f1f9bd admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:18.683479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:18.684311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:18.684720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:18.685069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] PATH_INFO: `/v3/projects/683319fc649d4713b6f6906cafd4a84e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:18.686430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=683319fc649d4713b6f6906cafd4a84e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:18.688649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:18.694418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b382a2c-accd-46ad-8e52-6122af8eb772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e3cb2fe3b94ac9a6974c66497c4e93, user_id=22a4a3b4cb3f4093a84a73726976e8ed, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:18.699282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b382a2c-accd-46ad-8e52-6122af8eb772 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:18.835746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 971/1943] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:18 2022] PUT /identity/v3/projects/09e3cb2fe3b94ac9a6974c66497c4e93/users/22a4a3b4cb3f4093a84a73726976e8ed/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:18.842339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd758e45-9f83-4ed5-8eaf-911f718c16bf None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:18.842592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd758e45-9f83-4ed5-8eaf-911f718c16bf None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:18.842840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd758e45-9f83-4ed5-8eaf-911f718c16bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:18.866289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683319fc649d4713b6f6906cafd4a84e', 'request_id': 'req-5df383e1-19b7-4f00-a216-86a2de6081bc'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:18.908682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-cd758e45-9f83-4ed5-8eaf-911f718c16bf None None] MFA Rules not processed for user `22a4a3b4cb3f4093a84a73726976e8ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:18.910857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cd758e45-9f83-4ed5-8eaf-911f718c16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:19.010332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683319fc649d4713b6f6906cafd4a84e', 'request_id': 'req-5df383e1-19b7-4f00-a216-86a2de6081bc'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:19.017337 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683319fc649d4713b6f6906cafd4a84e', 'request_id': 'req-5df383e1-19b7-4f00-a216-86a2de6081bc'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:19.049933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] The token cache is being invalidate because project 683319fc649d4713b6f6906cafd4a84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:19.050211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:19.057159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:19.060701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 973/1944] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:18 2022] DELETE /identity/v3/projects/683319fc649d4713b6f6906cafd4a84e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:19.066570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:19.073783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:19.101023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 972/1945] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:19.108920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd758e45-9f83-4ed5-8eaf-911f718c16bf None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:19.112797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cd758e45-9f83-4ed5-8eaf-911f718c16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:19.203479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df383e1-19b7-4f00-a216-86a2de6081bc admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:19.209416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:19.209823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:19.210181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:19.210566 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] PATH_INFO: `/v3/users/396092fe03b04ce383bdc7a2071eddf3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:19.211948 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] RBAC: Authorizing `identity:delete_user(user_id=396092fe03b04ce383bdc7a2071eddf3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:19.214422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:19.250841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd758e45-9f83-4ed5-8eaf-911f718c16bf None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:19.256479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09452246-33fe-4117-982a-9c21aa0a72b0 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630af7d1b854d05a43719f2033856ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18bb4600f7eb4c81bc4215179fbd582c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:19.258503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09452246-33fe-4117-982a-9c21aa0a72b0 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:19.258969 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09452246-33fe-4117-982a-9c21aa0a72b0 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:19.259290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09452246-33fe-4117-982a-9c21aa0a72b0 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:19.259974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09452246-33fe-4117-982a-9c21aa0a72b0 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:19.260442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09452246-33fe-4117-982a-9c21aa0a72b0 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:19.262119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09452246-33fe-4117-982a-9c21aa0a72b0 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:19.275269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 973/1946] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:19.276244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09452246-33fe-4117-982a-9c21aa0a72b0 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:19.278137 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-09452246-33fe-4117-982a-9c21aa0a72b0 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:19.292642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09452246-33fe-4117-982a-9c21aa0a72b0 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:19.298197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4150ab-1d78-44eb-98e8-a397b61741fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:19.298902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4150ab-1d78-44eb-98e8-a397b61741fb admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:19.299444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4150ab-1d78-44eb-98e8-a397b61741fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:19.299793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4150ab-1d78-44eb-98e8-a397b61741fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:19.300505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4150ab-1d78-44eb-98e8-a397b61741fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:19.302850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4150ab-1d78-44eb-98e8-a397b61741fb admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:19.429439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 974/1947] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:19 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:19.430533 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4150ab-1d78-44eb-98e8-a397b61741fb admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:19.432309 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6d4150ab-1d78-44eb-98e8-a397b61741fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:19.501868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396092fe03b04ce383bdc7a2071eddf3'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:19.503188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4150ab-1d78-44eb-98e8-a397b61741fb admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:19.507978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d081-edc3-4e22-8816-0aaaa318a3fe tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630af7d1b854d05a43719f2033856ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18bb4600f7eb4c81bc4215179fbd582c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:19.508530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d081-edc3-4e22-8816-0aaaa318a3fe tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:19.508811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d081-edc3-4e22-8816-0aaaa318a3fe tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:19.509588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398d081-edc3-4e22-8816-0aaaa318a3fe tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:19.509788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398d081-edc3-4e22-8816-0aaaa318a3fe tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:19.511854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398d081-edc3-4e22-8816-0aaaa318a3fe tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:19.515916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396092fe03b04ce383bdc7a2071eddf3'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:19.523322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396092fe03b04ce383bdc7a2071eddf3'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:19.643860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396092fe03b04ce383bdc7a2071eddf3'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:19.644819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396092fe03b04ce383bdc7a2071eddf3'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:19.655501 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 974/1948] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:19 2022] DELETE /identity/v3/users/396092fe03b04ce383bdc7a2071eddf3 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:19.660030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:19.660528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 975/1949] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:19 2022] POST /identity/v3/projects => generated 354 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:19.661622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d081-edc3-4e22-8816-0aaaa318a3fe tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:19.663436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1398d081-edc3-4e22-8816-0aaaa318a3fe tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:19.665850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:19.763378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f4c8d-39ae-404f-99a3-7386815e247f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:19.767603 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398d081-edc3-4e22-8816-0aaaa318a3fe tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:19.770446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:19.771292 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:19.771777 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:19.772067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] PATH_INFO: `/v3/projects/c6018990e8cd4eaab079061a7f537057` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:19.773305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6018990e8cd4eaab079061a7f537057)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:19.773788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e520afd-2bb2-438e-81c6-1b8ba380ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:19.774709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e520afd-2bb2-438e-81c6-1b8ba380ab1c admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:19.775192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e520afd-2bb2-438e-81c6-1b8ba380ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:19.775584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:19.775906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e520afd-2bb2-438e-81c6-1b8ba380ab1c admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:19.780086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e520afd-2bb2-438e-81c6-1b8ba380ab1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:19.783175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e520afd-2bb2-438e-81c6-1b8ba380ab1c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:19.938945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6018990e8cd4eaab079061a7f537057', 'request_id': 'req-2af9ee1c-80d7-414b-9239-86d92d464bef'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:19.956321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 976/1950] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:19 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:19.956321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e520afd-2bb2-438e-81c6-1b8ba380ab1c admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:19.956986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-9e520afd-2bb2-438e-81c6-1b8ba380ab1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:20.049872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6018990e8cd4eaab079061a7f537057', 'request_id': 'req-2af9ee1c-80d7-414b-9239-86d92d464bef'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:20.066383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6018990e8cd4eaab079061a7f537057', 'request_id': 'req-2af9ee1c-80d7-414b-9239-86d92d464bef'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:20.099802 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] The token cache is being invalidate because project c6018990e8cd4eaab079061a7f537057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:20.101495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:20.103674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:20.107364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e520afd-2bb2-438e-81c6-1b8ba380ab1c admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:20.107814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 975/1951] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:19 2022] DELETE /identity/v3/projects/c6018990e8cd4eaab079061a7f537057 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:20.108720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:20.113228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:20.135949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:20.221478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710168da-8ccc-4909-bca3-e40b3c4ee485 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630af7d1b854d05a43719f2033856ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18bb4600f7eb4c81bc4215179fbd582c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:20.222714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710168da-8ccc-4909-bca3-e40b3c4ee485 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:20.223347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710168da-8ccc-4909-bca3-e40b3c4ee485 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:20.224012 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710168da-8ccc-4909-bca3-e40b3c4ee485 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:20.225540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710168da-8ccc-4909-bca3-e40b3c4ee485 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:20.225944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710168da-8ccc-4909-bca3-e40b3c4ee485 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:20.227629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710168da-8ccc-4909-bca3-e40b3c4ee485 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:20.244099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 977/1952] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:20.246887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710168da-8ccc-4909-bca3-e40b3c4ee485 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:20.251334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-710168da-8ccc-4909-bca3-e40b3c4ee485 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:20.259149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ee1c-80d7-414b-9239-86d92d464bef admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:20.264401 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db240fb-5ba3-4f1a-b35a-a06b7da929e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:20.265172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db240fb-5ba3-4f1a-b35a-a06b7da929e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:20.265521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db240fb-5ba3-4f1a-b35a-a06b7da929e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:20.266007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db240fb-5ba3-4f1a-b35a-a06b7da929e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:20.266644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db240fb-5ba3-4f1a-b35a-a06b7da929e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:20.268521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db240fb-5ba3-4f1a-b35a-a06b7da929e0 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:20.277831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710168da-8ccc-4909-bca3-e40b3c4ee485 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:20.285979 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 976/1953] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:20.286782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:20.287442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:20.287725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:20.288004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] PATH_INFO: `/v3/users/761cbdbaae574fd2a2eac47b23dd0d1b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:20.289665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] RBAC: Authorizing `identity:delete_user(user_id=761cbdbaae574fd2a2eac47b23dd0d1b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:20.291780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:20.297405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db240fb-5ba3-4f1a-b35a-a06b7da929e0 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:20.321172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db240fb-5ba3-4f1a-b35a-a06b7da929e0 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:20.324109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:20.329928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708a8bb-6d88-40ef-9598-66bd48774c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:20.330657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a8bb-6d88-40ef-9598-66bd48774c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:20.330945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a8bb-6d88-40ef-9598-66bd48774c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:20.331225 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a8bb-6d88-40ef-9598-66bd48774c2d admin admin] PATH_INFO: `/v3/projects/4e7e91996fd648d2a81aa102d57e5755/users/a3b8b0bd2d10423bba92fa807735dc3c/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:20.351443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708a8bb-6d88-40ef-9598-66bd48774c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7e91996fd648d2a81aa102d57e5755, user_id=a3b8b0bd2d10423bba92fa807735dc3c, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:20.353881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708a8bb-6d88-40ef-9598-66bd48774c2d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:20.494188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 977/1954] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:20 2022] PUT /identity/v3/projects/4e7e91996fd648d2a81aa102d57e5755/users/a3b8b0bd2d10423bba92fa807735dc3c/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:20.499130 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708a8bb-6d88-40ef-9598-66bd48774c2d admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:20.500893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4708a8bb-6d88-40ef-9598-66bd48774c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:20.588991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708a8bb-6d88-40ef-9598-66bd48774c2d admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:20.595170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1630af7d1b854d05a43719f2033856ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18bb4600f7eb4c81bc4215179fbd582c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:20.595825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:20.596107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:20.596455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] PATH_INFO: `/v3/projects/b12c8bb9517f4b0392f76f5f01959764` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:20.597663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b12c8bb9517f4b0392f76f5f01959764)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:20.599687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:20.636248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761cbdbaae574fd2a2eac47b23dd0d1b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:20.781706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761cbdbaae574fd2a2eac47b23dd0d1b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:20.801107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761cbdbaae574fd2a2eac47b23dd0d1b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:20.806967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12c8bb9517f4b0392f76f5f01959764', 'request_id': 'req-3237ede1-6837-48f0-97c8-ee9ae07ff191'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:20.810431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761cbdbaae574fd2a2eac47b23dd0d1b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:20.811451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761cbdbaae574fd2a2eac47b23dd0d1b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:20.819417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 978/1955] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:20 2022] DELETE /identity/v3/users/761cbdbaae574fd2a2eac47b23dd0d1b => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:20.823283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:20.824818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:20.916080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20456985-e023-431c-bbfb-65ea0a67773e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:20.922468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3e634-2433-440b-a4a1-d7002980b67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:20.923098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3e634-2433-440b-a4a1-d7002980b67d admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:20.923383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3e634-2433-440b-a4a1-d7002980b67d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:20.923665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3e634-2433-440b-a4a1-d7002980b67d admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:20.924365 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3e634-2433-440b-a4a1-d7002980b67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:20.928651 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3e634-2433-440b-a4a1-d7002980b67d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:20.940595 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 979/1956] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:20.946871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3e634-2433-440b-a4a1-d7002980b67d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:20.963726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3e634-2433-440b-a4a1-d7002980b67d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:20.973361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a201795-1a8c-458e-b132-daaff9f3b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:20.974509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a201795-1a8c-458e-b132-daaff9f3b999 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:20.975056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a201795-1a8c-458e-b132-daaff9f3b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:20.975505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a201795-1a8c-458e-b132-daaff9f3b999 admin admin] PATH_INFO: `/v3/projects/4e7e91996fd648d2a81aa102d57e5755/users/a3b8b0bd2d10423bba92fa807735dc3c/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:20.977984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a201795-1a8c-458e-b132-daaff9f3b999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7e91996fd648d2a81aa102d57e5755, user_id=a3b8b0bd2d10423bba92fa807735dc3c, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:20.985010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a201795-1a8c-458e-b132-daaff9f3b999 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:21.009664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12c8bb9517f4b0392f76f5f01959764', 'request_id': 'req-3237ede1-6837-48f0-97c8-ee9ae07ff191'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:21.011896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 980/1957] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:20 2022] PUT /identity/v3/projects/4e7e91996fd648d2a81aa102d57e5755/users/a3b8b0bd2d10423bba92fa807735dc3c/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:21.022709 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12c8bb9517f4b0392f76f5f01959764', 'request_id': 'req-3237ede1-6837-48f0-97c8-ee9ae07ff191'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:21.026974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ac530-c239-4b3d-a340-9f2ab40f4d8e None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:21.027376 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ac530-c239-4b3d-a340-9f2ab40f4d8e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:21.027787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ac530-c239-4b3d-a340-9f2ab40f4d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:21.042550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] The token cache is being invalidate because project b12c8bb9517f4b0392f76f5f01959764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:21.042851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:21.043690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:21.048324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 978/1958] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:20 2022] DELETE /identity/v3/projects/b12c8bb9517f4b0392f76f5f01959764 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:21.063721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-857ac530-c239-4b3d-a340-9f2ab40f4d8e None None] MFA Rules not processed for user `a3b8b0bd2d10423bba92fa807735dc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:21.065343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-857ac530-c239-4b3d-a340-9f2ab40f4d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:21.068833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:21.070557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:21.165301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237ede1-6837-48f0-97c8-ee9ae07ff191 tempest-VolumeQuotaClassesTest-166007804 tempest-VolumeQuotaClassesTest-166007804-project-admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:21.174372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 981/1959] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:21.187207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ac530-c239-4b3d-a340-9f2ab40f4d8e None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:21.189371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-857ac530-c239-4b3d-a340-9f2ab40f4d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:21.266774 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:21.268682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:21.268682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:21.268908 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ac530-c239-4b3d-a340-9f2ab40f4d8e None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:21.269004 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] PATH_INFO: `/v3/projects/ea1a20b915ae407ea2e21201cde35940` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:21.269820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1a20b915ae407ea2e21201cde35940)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:21.271826 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67542fc8-a185-4bc3-ba8e-a6a11d994625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:21.272157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:21.272450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542fc8-a185-4bc3-ba8e-a6a11d994625 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:21.273001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542fc8-a185-4bc3-ba8e-a6a11d994625 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:21.273284 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67542fc8-a185-4bc3-ba8e-a6a11d994625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:21.288251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67542fc8-a185-4bc3-ba8e-a6a11d994625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:21.290881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67542fc8-a185-4bc3-ba8e-a6a11d994625 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:21.307754 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 982/1960] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:21.483129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:21.484399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1a20b915ae407ea2e21201cde35940', 'request_id': 'req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:21.606428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1a20b915ae407ea2e21201cde35940', 'request_id': 'req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:21.617278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1a20b915ae407ea2e21201cde35940', 'request_id': 'req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:21.630240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] The token cache is being invalidate because project ea1a20b915ae407ea2e21201cde35940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:21.630675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:21.631837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:21.633816 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 979/1961] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:21 2022] DELETE /identity/v3/projects/ea1a20b915ae407ea2e21201cde35940 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:21.637475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67542fc8-a185-4bc3-ba8e-a6a11d994625 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:21.661309 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67542fc8-a185-4bc3-ba8e-a6a11d994625 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:21.673648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:21.685245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:21.863649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530c1b5-45b4-45ee-acdb-44c1afc5fc16 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:21.868702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb457e0-8f60-4224-be66-0adbc0d28a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:21.869623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb457e0-8f60-4224-be66-0adbc0d28a93 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:21.869934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb457e0-8f60-4224-be66-0adbc0d28a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:21.870225 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb457e0-8f60-4224-be66-0adbc0d28a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:21.872358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8cb457e0-8f60-4224-be66-0adbc0d28a93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:21.876661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:21.877386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:21.882327 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:21.882327 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] PATH_INFO: `/v3/users/d8fbc41c5c314abaa4b289054ed31337` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:21.882327 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8fbc41c5c314abaa4b289054ed31337)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:21.885482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:21.989997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb457e0-8f60-4224-be66-0adbc0d28a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:21.991498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb457e0-8f60-4224-be66-0adbc0d28a93 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:22.036737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 980/1962] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:22.086705 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb457e0-8f60-4224-be66-0adbc0d28a93 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:22.089102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8cb457e0-8f60-4224-be66-0adbc0d28a93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:22.120982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb457e0-8f60-4224-be66-0adbc0d28a93 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:22.158668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f6312-9fca-433b-8af0-77e847ae2d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:22.160597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6312-9fca-433b-8af0-77e847ae2d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:22.160886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6312-9fca-433b-8af0-77e847ae2d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:22.164581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6312-9fca-433b-8af0-77e847ae2d0d admin admin] PATH_INFO: `/v3/users/08df1135397c40bb911711012b430609` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:22.172978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f6312-9fca-433b-8af0-77e847ae2d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=08df1135397c40bb911711012b430609)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:22.175036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f6312-9fca-433b-8af0-77e847ae2d0d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:22.182331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8fbc41c5c314abaa4b289054ed31337'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.298073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8fbc41c5c314abaa4b289054ed31337'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.324646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8fbc41c5c314abaa4b289054ed31337'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.337519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8fbc41c5c314abaa4b289054ed31337'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.338600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8fbc41c5c314abaa4b289054ed31337'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.349199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 983/1963] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:21 2022] DELETE /identity/v3/users/d8fbc41c5c314abaa4b289054ed31337 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:22.350370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:22.354869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:22.473082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a90c33-3f19-4ca9-bdc0-50c9a6802cbe admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:22.481875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:22.483156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:22.483657 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:22.484106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] PATH_INFO: `/v3/projects/e5c3ef532de94b13a688cd0213c41f22` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:22.486387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c3ef532de94b13a688cd0213c41f22)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:22.491235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:22.544701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4f5f6312-9fca-433b-8af0-77e847ae2d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08df1135397c40bb911711012b430609'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.580264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4f5f6312-9fca-433b-8af0-77e847ae2d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08df1135397c40bb911711012b430609'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.596901 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4f5f6312-9fca-433b-8af0-77e847ae2d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08df1135397c40bb911711012b430609'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.667366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c3ef532de94b13a688cd0213c41f22', 'request_id': 'req-d8ed3f20-d341-4b59-9dcf-36200e210dce'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.674932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c3ef532de94b13a688cd0213c41f22', 'request_id': 'req-d8ed3f20-d341-4b59-9dcf-36200e210dce'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.682707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c3ef532de94b13a688cd0213c41f22', 'request_id': 'req-d8ed3f20-d341-4b59-9dcf-36200e210dce'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.692379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4f5f6312-9fca-433b-8af0-77e847ae2d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08df1135397c40bb911711012b430609'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.693003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-4f5f6312-9fca-433b-8af0-77e847ae2d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08df1135397c40bb911711012b430609'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.702745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 981/1964] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:22 2022] DELETE /identity/v3/users/08df1135397c40bb911711012b430609 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:22.714119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dcfa0-de9f-44d5-9092-f1c76ae8d6c3 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:22.714630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dcfa0-de9f-44d5-9092-f1c76ae8d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:22.715102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dcfa0-de9f-44d5-9092-f1c76ae8d6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:22.741868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ef1dcfa0-de9f-44d5-9092-f1c76ae8d6c3 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:22.743645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ef1dcfa0-de9f-44d5-9092-f1c76ae8d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:22.770273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:22.790307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] The token cache is being invalidate because project e5c3ef532de94b13a688cd0213c41f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:22.790307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.794086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:22.796403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 984/1965] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:22 2022] DELETE /identity/v3/projects/e5c3ef532de94b13a688cd0213c41f22 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:22.800705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:22.802395 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:22.872107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 982/1966] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:22.892743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dcfa0-de9f-44d5-9092-f1c76ae8d6c3 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:22.898447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ef1dcfa0-de9f-44d5-9092-f1c76ae8d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:22.911187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed3f20-d341-4b59-9dcf-36200e210dce admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:22.916695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:22.917360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:22.917824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:22.918088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] PATH_INFO: `/v3/users/c3c85e4e0d1e4c20880e9703ccd85bf6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:22.920261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c85e4e0d1e4c20880e9703ccd85bf6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:22.922351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:22.985176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dcfa0-de9f-44d5-9092-f1c76ae8d6c3 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:22.989661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ed577-5a68-42ce-98c4-ef819f9ee288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:22.990576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ed577-5a68-42ce-98c4-ef819f9ee288 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:22.990576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ed577-5a68-42ce-98c4-ef819f9ee288 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:22.990914 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ed577-5a68-42ce-98c4-ef819f9ee288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:23.001468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ed577-5a68-42ce-98c4-ef819f9ee288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:23.006127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ed577-5a68-42ce-98c4-ef819f9ee288 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:23.013865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 983/1967] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:23.014891 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ed577-5a68-42ce-98c4-ef819f9ee288 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:23.017261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7f2ed577-5a68-42ce-98c4-ef819f9ee288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:23.031281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ed577-5a68-42ce-98c4-ef819f9ee288 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:23.036884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900a1b2-66a9-4409-846c-35a3350531d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:23.037538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900a1b2-66a9-4409-846c-35a3350531d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:23.037980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900a1b2-66a9-4409-846c-35a3350531d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:23.038265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900a1b2-66a9-4409-846c-35a3350531d3 admin admin] PATH_INFO: `/v3/users/22a4a3b4cb3f4093a84a73726976e8ed` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:23.039625 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900a1b2-66a9-4409-846c-35a3350531d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a4a3b4cb3f4093a84a73726976e8ed)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:23.042608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900a1b2-66a9-4409-846c-35a3350531d3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:23.127129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c85e4e0d1e4c20880e9703ccd85bf6'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:23.184123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c85e4e0d1e4c20880e9703ccd85bf6'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:23.207653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c85e4e0d1e4c20880e9703ccd85bf6'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:23.216925 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c85e4e0d1e4c20880e9703ccd85bf6'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:23.217803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c85e4e0d1e4c20880e9703ccd85bf6'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:23.226541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 985/1968] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:22 2022] DELETE /identity/v3/users/c3c85e4e0d1e4c20880e9703ccd85bf6 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:23.265552 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5900a1b2-66a9-4409-846c-35a3350531d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a4a3b4cb3f4093a84a73726976e8ed'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:23.317233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5900a1b2-66a9-4409-846c-35a3350531d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a4a3b4cb3f4093a84a73726976e8ed'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:23.364356 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5900a1b2-66a9-4409-846c-35a3350531d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a4a3b4cb3f4093a84a73726976e8ed'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:23.521649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5900a1b2-66a9-4409-846c-35a3350531d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a4a3b4cb3f4093a84a73726976e8ed'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:23.522474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5900a1b2-66a9-4409-846c-35a3350531d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a4a3b4cb3f4093a84a73726976e8ed'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:23.538500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 984/1969] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:23 2022] DELETE /identity/v3/users/22a4a3b4cb3f4093a84a73726976e8ed => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:23.538660 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:23.540237 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:23.544607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:23.554005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5def0ba-4639-4f90-9417-1270cbc1a866 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:23.554296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5def0ba-4639-4f90-9417-1270cbc1a866 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:23.554572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5def0ba-4639-4f90-9417-1270cbc1a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:23.601811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a5def0ba-4639-4f90-9417-1270cbc1a866 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:23.602992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a5def0ba-4639-4f90-9417-1270cbc1a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:23.657735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c430510-eaf6-414a-94b3-a9c79a1f4def admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:23.777400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 985/1970] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:23.778671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5def0ba-4639-4f90-9417-1270cbc1a866 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:23.782435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a5def0ba-4639-4f90-9417-1270cbc1a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:23.799330 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:23.800010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:23.807493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:23.807493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] PATH_INFO: `/v3/projects/053f57e4898144ac8e9ebae63c355cf5` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:23.807493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=053f57e4898144ac8e9ebae63c355cf5)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:23.807493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:23.818839 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5def0ba-4639-4f90-9417-1270cbc1a866 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:23.832444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:23.833121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:23.833408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:23.834867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] PATH_INFO: `/v3/projects/8348be33950d49ae945ac87889ad8e2c` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:23.836873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8348be33950d49ae945ac87889ad8e2c)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:23.841004 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:24.002037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053f57e4898144ac8e9ebae63c355cf5', 'request_id': 'req-a6da4621-10cf-4125-aa00-459eadcea5c7'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.010078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053f57e4898144ac8e9ebae63c355cf5', 'request_id': 'req-a6da4621-10cf-4125-aa00-459eadcea5c7'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.014182 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8348be33950d49ae945ac87889ad8e2c', 'request_id': 'req-a73adf28-36ed-4f11-9de0-c01214d98252'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.018425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053f57e4898144ac8e9ebae63c355cf5', 'request_id': 'req-a6da4621-10cf-4125-aa00-459eadcea5c7'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.152030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8348be33950d49ae945ac87889ad8e2c', 'request_id': 'req-a73adf28-36ed-4f11-9de0-c01214d98252'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.159229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8348be33950d49ae945ac87889ad8e2c', 'request_id': 'req-a73adf28-36ed-4f11-9de0-c01214d98252'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.171428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] The token cache is being invalidate because project 8348be33950d49ae945ac87889ad8e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:24.171796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.179092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.179092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 986/1971] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:23 2022] DELETE /identity/v3/projects/8348be33950d49ae945ac87889ad8e2c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:24.179092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:24.179092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:24.237173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73adf28-36ed-4f11-9de0-c01214d98252 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:24.240873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386420a-f0cd-4d47-8810-d22d692ae08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:24.241510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386420a-f0cd-4d47-8810-d22d692ae08e service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:24.241855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386420a-f0cd-4d47-8810-d22d692ae08e service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:24.242129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386420a-f0cd-4d47-8810-d22d692ae08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:24.244270 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3386420a-f0cd-4d47-8810-d22d692ae08e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:24.272161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] The token cache is being invalidate because project 053f57e4898144ac8e9ebae63c355cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:24.272710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.273126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.274703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 986/1972] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:23 2022] DELETE /identity/v3/projects/053f57e4898144ac8e9ebae63c355cf5 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:24.279627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:24.281050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:24.316760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386420a-f0cd-4d47-8810-d22d692ae08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:24.318550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386420a-f0cd-4d47-8810-d22d692ae08e service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:24.330568 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 987/1973] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:24.331454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386420a-f0cd-4d47-8810-d22d692ae08e service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:24.336121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3386420a-f0cd-4d47-8810-d22d692ae08e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:24.350982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386420a-f0cd-4d47-8810-d22d692ae08e service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:24.362060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138632d9-540b-4516-9c12-aba0a9ba4d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:24.368201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138632d9-540b-4516-9c12-aba0a9ba4d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:24.368201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138632d9-540b-4516-9c12-aba0a9ba4d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:24.368201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138632d9-540b-4516-9c12-aba0a9ba4d70 admin admin] PATH_INFO: `/v3/users/1630af7d1b854d05a43719f2033856ef` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:24.368201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138632d9-540b-4516-9c12-aba0a9ba4d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1630af7d1b854d05a43719f2033856ef)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:24.368740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da4621-10cf-4125-aa00-459eadcea5c7 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:24.369722 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138632d9-540b-4516-9c12-aba0a9ba4d70 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:24.373956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:24.374618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:24.374963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:24.375185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] PATH_INFO: `/v3/projects/7a6cb504795141cbbab97936701b9dc1` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:24.376642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6cb504795141cbbab97936701b9dc1)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:24.378694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:24.667835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6cb504795141cbbab97936701b9dc1', 'request_id': 'req-49c6e27a-8298-45d8-a018-977a55f17e35'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.675702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-138632d9-540b-4516-9c12-aba0a9ba4d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1630af7d1b854d05a43719f2033856ef'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.682238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6cb504795141cbbab97936701b9dc1', 'request_id': 'req-49c6e27a-8298-45d8-a018-977a55f17e35'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.696154 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6cb504795141cbbab97936701b9dc1', 'request_id': 'req-49c6e27a-8298-45d8-a018-977a55f17e35'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.705997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-138632d9-540b-4516-9c12-aba0a9ba4d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1630af7d1b854d05a43719f2033856ef'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.722561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-138632d9-540b-4516-9c12-aba0a9ba4d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1630af7d1b854d05a43719f2033856ef'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.800245 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] The token cache is being invalidate because project 7a6cb504795141cbbab97936701b9dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:24.800645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.801677 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-49c6e27a-8298-45d8-a018-977a55f17e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.809136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 987/1974] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:24 2022] DELETE /identity/v3/projects/7a6cb504795141cbbab97936701b9dc1 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:24.809136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095aa91-0f6a-4858-b57b-d16b21b5e188 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:24.809136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095aa91-0f6a-4858-b57b-d16b21b5e188 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:24.809136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095aa91-0f6a-4858-b57b-d16b21b5e188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:24.868126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-6095aa91-0f6a-4858-b57b-d16b21b5e188 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:24.868348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6095aa91-0f6a-4858-b57b-d16b21b5e188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:24.889865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-138632d9-540b-4516-9c12-aba0a9ba4d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1630af7d1b854d05a43719f2033856ef'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.890969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-138632d9-540b-4516-9c12-aba0a9ba4d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1630af7d1b854d05a43719f2033856ef'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:24.908395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 988/1975] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:24 2022] DELETE /identity/v3/users/1630af7d1b854d05a43719f2033856ef => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:24.913422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce748bc-7034-401c-8c03-24852db9b3fd None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:24.913818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce748bc-7034-401c-8c03-24852db9b3fd None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:24.914103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce748bc-7034-401c-8c03-24852db9b3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:24.988926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-dce748bc-7034-401c-8c03-24852db9b3fd None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:24.988926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-dce748bc-7034-401c-8c03-24852db9b3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:25.011493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 988/1976] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:25.012523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095aa91-0f6a-4858-b57b-d16b21b5e188 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:25.017481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6095aa91-0f6a-4858-b57b-d16b21b5e188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:25.049484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095aa91-0f6a-4858-b57b-d16b21b5e188 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:25.160482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 989/1977] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:25.162013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454ed1-f068-4c33-a062-a2aa70d42bcd None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:25.162453 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454ed1-f068-4c33-a062-a2aa70d42bcd None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:25.162597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454ed1-f068-4c33-a062-a2aa70d42bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:25.208230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:25.209493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:25.210658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:25.210955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] PATH_INFO: `/v3/projects/09e3cb2fe3b94ac9a6974c66497c4e93` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:25.213792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e3cb2fe3b94ac9a6974c66497c4e93)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:25.215426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:25.222376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-15454ed1-f068-4c33-a062-a2aa70d42bcd None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:25.224245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-15454ed1-f068-4c33-a062-a2aa70d42bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:25.235250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 990/1978] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:25.239898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17cc9-2974-4243-8b17-5140ec993600 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:25.245261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17cc9-2974-4243-8b17-5140ec993600 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:25.245261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17cc9-2974-4243-8b17-5140ec993600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:25.271810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a7d17cc9-2974-4243-8b17-5140ec993600 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:25.273833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a7d17cc9-2974-4243-8b17-5140ec993600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:25.287276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 991/1979] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:25.288711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d17cc9-2974-4243-8b17-5140ec993600 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:25.301101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d17cc9-2974-4243-8b17-5140ec993600 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:25.306010 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a250289-14b8-4bc9-bd34-c36d59d1c230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:25.307943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a250289-14b8-4bc9-bd34-c36d59d1c230 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:25.307943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a250289-14b8-4bc9-bd34-c36d59d1c230 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:25.307943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a250289-14b8-4bc9-bd34-c36d59d1c230 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:25.307943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a250289-14b8-4bc9-bd34-c36d59d1c230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:25.308638 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a250289-14b8-4bc9-bd34-c36d59d1c230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:25.309832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a250289-14b8-4bc9-bd34-c36d59d1c230 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:25.322565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 992/1980] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:25.323425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a250289-14b8-4bc9-bd34-c36d59d1c230 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:25.335003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a250289-14b8-4bc9-bd34-c36d59d1c230 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:25.340356 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5167-524b-4949-ab53-57544a891dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:25.341885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5167-524b-4949-ab53-57544a891dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:25.342153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5167-524b-4949-ab53-57544a891dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:25.342429 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5167-524b-4949-ab53-57544a891dd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:25.343100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd5167-524b-4949-ab53-57544a891dd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:25.346247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd5167-524b-4949-ab53-57544a891dd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:25.346247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd5167-524b-4949-ab53-57544a891dd4 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:25.371755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 993/1981] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:25.374067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e3cb2fe3b94ac9a6974c66497c4e93', 'request_id': 'req-5558081e-aed4-4fe8-9554-aba95a257e24'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:25.380534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5167-524b-4949-ab53-57544a891dd4 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:25.384689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e3cb2fe3b94ac9a6974c66497c4e93', 'request_id': 'req-5558081e-aed4-4fe8-9554-aba95a257e24'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:25.389894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5167-524b-4949-ab53-57544a891dd4 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:25.394725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e3cb2fe3b94ac9a6974c66497c4e93', 'request_id': 'req-5558081e-aed4-4fe8-9554-aba95a257e24'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:25.460333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44da0c7-e314-4681-986b-118241abee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:25.460959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44da0c7-e314-4681-986b-118241abee07 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:25.461242 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44da0c7-e314-4681-986b-118241abee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:25.461522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44da0c7-e314-4681-986b-118241abee07 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:25.462200 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44da0c7-e314-4681-986b-118241abee07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:25.464120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44da0c7-e314-4681-986b-118241abee07 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:25.511568 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] The token cache is being invalidate because project 09e3cb2fe3b94ac9a6974c66497c4e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:25.511969 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:25.512761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:25.514943 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 989/1982] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:25 2022] DELETE /identity/v3/projects/09e3cb2fe3b94ac9a6974c66497c4e93 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:25.515825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:25.517133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:25.530423 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558081e-aed4-4fe8-9554-aba95a257e24 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:25.535048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad068-21a2-468e-9872-14cd0f2e08a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:25.535647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad068-21a2-468e-9872-14cd0f2e08a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:25.535926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad068-21a2-468e-9872-14cd0f2e08a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:25.536202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ad068-21a2-468e-9872-14cd0f2e08a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:25.536922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ad068-21a2-468e-9872-14cd0f2e08a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:25.538888 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ad068-21a2-468e-9872-14cd0f2e08a3 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:25.616181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 994/1983] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:25 2022] POST /identity/v3/projects => generated 373 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:25.617067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44da0c7-e314-4681-986b-118241abee07 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:25.621044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c44da0c7-e314-4681-986b-118241abee07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:25.675361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 990/1984] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:25 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:25.675361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad068-21a2-468e-9872-14cd0f2e08a3 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:25.676980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a08ad068-21a2-468e-9872-14cd0f2e08a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:25.700827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44da0c7-e314-4681-986b-118241abee07 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:25.761754 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ad068-21a2-468e-9872-14cd0f2e08a3 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:25.762304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:25.763324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:25.763625 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:25.764053 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] PATH_INFO: `/v3/users/a3b8b0bd2d10423bba92fa807735dc3c` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:25.765683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b8b0bd2d10423bba92fa807735dc3c)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:25.767269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:25.767697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:25.767936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:25.768225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:25.768509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] PATH_INFO: `/v3/projects/18bb4600f7eb4c81bc4215179fbd582c` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:25.769995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=18bb4600f7eb4c81bc4215179fbd582c)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:25.772438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:25.801298 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:DELETE=11,keystone:SELECT=89 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:26.004521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b8b0bd2d10423bba92fa807735dc3c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:26.011159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18bb4600f7eb4c81bc4215179fbd582c', 'request_id': 'req-b5290673-3850-4e88-891a-380af9cdad3d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:26.018806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18bb4600f7eb4c81bc4215179fbd582c', 'request_id': 'req-b5290673-3850-4e88-891a-380af9cdad3d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:26.019426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b8b0bd2d10423bba92fa807735dc3c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:26.025547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18bb4600f7eb4c81bc4215179fbd582c', 'request_id': 'req-b5290673-3850-4e88-891a-380af9cdad3d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:26.026668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b8b0bd2d10423bba92fa807735dc3c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:26.127793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] The token cache is being invalidate because project 18bb4600f7eb4c81bc4215179fbd582c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:26.128543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:26.129210 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:26.134443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 991/1985] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:25 2022] DELETE /identity/v3/projects/18bb4600f7eb4c81bc4215179fbd582c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:26.134443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:26.134443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:26.177542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b8b0bd2d10423bba92fa807735dc3c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:26.178306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b8b0bd2d10423bba92fa807735dc3c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:26.185078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 995/1986] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:25 2022] DELETE /identity/v3/users/a3b8b0bd2d10423bba92fa807735dc3c => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:26.186333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:26.187471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:26.212035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5290673-3850-4e88-891a-380af9cdad3d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:26.264792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e2d72-ec84-4f56-aa39-b36c158e254f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:26.270375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d3070-6432-4f43-9e6f-ad3573e189a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:26.271165 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d3070-6432-4f43-9e6f-ad3573e189a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.271547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d3070-6432-4f43-9e6f-ad3573e189a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.271917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d3070-6432-4f43-9e6f-ad3573e189a9 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.272953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d3070-6432-4f43-9e6f-ad3573e189a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:26.274809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d3070-6432-4f43-9e6f-ad3573e189a9 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:26.285226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e06955-d0c8-4dae-951e-f4f4e80ab4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:26.291258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06955-d0c8-4dae-951e-f4f4e80ab4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.291258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06955-d0c8-4dae-951e-f4f4e80ab4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.291258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06955-d0c8-4dae-951e-f4f4e80ab4b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.291258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e06955-d0c8-4dae-951e-f4f4e80ab4b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:26.291258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e06955-d0c8-4dae-951e-f4f4e80ab4b8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:26.404978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 992/1988] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:26 2022] POST /identity/v3/users => generated 287 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:26.405608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 996/1988] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:26 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:26.406352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae5fe0-561e-42ee-8523-fb65603383fa None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.406644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae5fe0-561e-42ee-8523-fb65603383fa None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.406929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae5fe0-561e-42ee-8523-fb65603383fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.411602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e06955-d0c8-4dae-951e-f4f4e80ab4b8 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:26.414671 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e9e06955-d0c8-4dae-951e-f4f4e80ab4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:26.429959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e06955-d0c8-4dae-951e-f4f4e80ab4b8 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:26.430164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-13ae5fe0-561e-42ee-8523-fb65603383fa None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:26.433278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-13ae5fe0-561e-42ee-8523-fb65603383fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:26.436054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3871e-8b39-4033-b3b6-3ad127b3e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:26.436680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3871e-8b39-4033-b3b6-3ad127b3e180 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.436960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3871e-8b39-4033-b3b6-3ad127b3e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.437227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3871e-8b39-4033-b3b6-3ad127b3e180 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.438234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3871e-8b39-4033-b3b6-3ad127b3e180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:26.439970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3871e-8b39-4033-b3b6-3ad127b3e180 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:26.443502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 997/1989] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:26.448800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae5fe0-561e-42ee-8523-fb65603383fa None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:26.460674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae5fe0-561e-42ee-8523-fb65603383fa None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:26.467225 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cb8fe-ae35-4af4-92a5-e91159de5fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:26.467573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 993/1990] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:26.473487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cb8fe-ae35-4af4-92a5-e91159de5fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.473487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cb8fe-ae35-4af4-92a5-e91159de5fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.473663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b265e-3b29-4557-a04d-892bc8486517 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.473738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cb8fe-ae35-4af4-92a5-e91159de5fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.473824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b265e-3b29-4557-a04d-892bc8486517 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.473824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b265e-3b29-4557-a04d-892bc8486517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.473951 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cb8fe-ae35-4af4-92a5-e91159de5fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:26.473951 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cb8fe-ae35-4af4-92a5-e91159de5fd9 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:26.486186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 998/1991] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:26.487603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cb8fe-ae35-4af4-92a5-e91159de5fd9 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:26.492489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-253b265e-3b29-4557-a04d-892bc8486517 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:26.494993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:26.496127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-253b265e-3b29-4557-a04d-892bc8486517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:26.502427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cb8fe-ae35-4af4-92a5-e91159de5fd9 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:26.506296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 994/1992] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:26.507199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b265e-3b29-4557-a04d-892bc8486517 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:26.511991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92416db-f765-4e55-8fc9-3b36e92c8932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:26.512921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92416db-f765-4e55-8fc9-3b36e92c8932 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.513897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92416db-f765-4e55-8fc9-3b36e92c8932 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.515731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92416db-f765-4e55-8fc9-3b36e92c8932 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.515731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92416db-f765-4e55-8fc9-3b36e92c8932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:26.518023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92416db-f765-4e55-8fc9-3b36e92c8932 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:26.520614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b265e-3b29-4557-a04d-892bc8486517 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:26.527009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920fa4e-1d8d-402c-8bdc-cf1fb9390025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:26.527641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920fa4e-1d8d-402c-8bdc-cf1fb9390025 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.527915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920fa4e-1d8d-402c-8bdc-cf1fb9390025 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.529135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920fa4e-1d8d-402c-8bdc-cf1fb9390025 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.530181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920fa4e-1d8d-402c-8bdc-cf1fb9390025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:26.538642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920fa4e-1d8d-402c-8bdc-cf1fb9390025 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:26.538775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 999/1993] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:26.538775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92416db-f765-4e55-8fc9-3b36e92c8932 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:26.543843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92416db-f765-4e55-8fc9-3b36e92c8932 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:26.544516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 995/1994] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:26.545504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920fa4e-1d8d-402c-8bdc-cf1fb9390025 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:26.552769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8d5c3-1309-402e-85cd-e3d7aa8224ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:26.553419 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8d5c3-1309-402e-85cd-e3d7aa8224ae admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.554195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8d5c3-1309-402e-85cd-e3d7aa8224ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.554195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8d5c3-1309-402e-85cd-e3d7aa8224ae admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.554649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8d5c3-1309-402e-85cd-e3d7aa8224ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:26.554964 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8d5c3-1309-402e-85cd-e3d7aa8224ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:26.556404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920fa4e-1d8d-402c-8bdc-cf1fb9390025 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:26.556586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8d5c3-1309-402e-85cd-e3d7aa8224ae admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:26.561854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c54a1a-973e-40a6-8bbd-8a3fc8b61243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:26.562626 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c54a1a-973e-40a6-8bbd-8a3fc8b61243 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.562927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c54a1a-973e-40a6-8bbd-8a3fc8b61243 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.563203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c54a1a-973e-40a6-8bbd-8a3fc8b61243 admin admin] PATH_INFO: `/v3/projects/f081966d9a4d459a96528103e1f8cca8/users/486eb8faf5d043adabc9454c5f3d2632/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.574412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1000/1995] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:26.575383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8d5c3-1309-402e-85cd-e3d7aa8224ae admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:26.581899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c54a1a-973e-40a6-8bbd-8a3fc8b61243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f081966d9a4d459a96528103e1f8cca8, user_id=486eb8faf5d043adabc9454c5f3d2632, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:26.584655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c54a1a-973e-40a6-8bbd-8a3fc8b61243 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:26.590046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8d5c3-1309-402e-85cd-e3d7aa8224ae admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:26.596070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c711ef-611b-4761-8f7b-38ebbeb803f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:26.596791 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c711ef-611b-4761-8f7b-38ebbeb803f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.597065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c711ef-611b-4761-8f7b-38ebbeb803f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.597337 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c711ef-611b-4761-8f7b-38ebbeb803f7 admin admin] PATH_INFO: `/v3/projects/3b0c43acc2234b04985d1e9e04db8879/users/92ab635a1ad247c6a41ca94018fd6b9c/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.614941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c711ef-611b-4761-8f7b-38ebbeb803f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0c43acc2234b04985d1e9e04db8879, user_id=92ab635a1ad247c6a41ca94018fd6b9c, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:26.621932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c711ef-611b-4761-8f7b-38ebbeb803f7 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:26.709765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 996/1996] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:26 2022] PUT /identity/v3/projects/f081966d9a4d459a96528103e1f8cca8/users/486eb8faf5d043adabc9454c5f3d2632/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:26.710660 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c54a1a-973e-40a6-8bbd-8a3fc8b61243 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:26.775375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1001/1997] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:26 2022] PUT /identity/v3/projects/3b0c43acc2234b04985d1e9e04db8879/users/92ab635a1ad247c6a41ca94018fd6b9c/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:26.783297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c54a1a-973e-40a6-8bbd-8a3fc8b61243 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:26.783912 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1508d-6a70-4804-920c-dfc7c074639f None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.784490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1508d-6a70-4804-920c-dfc7c074639f None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.795207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1508d-6a70-4804-920c-dfc7c074639f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.830656 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f9e1508d-6a70-4804-920c-dfc7c074639f None None] MFA Rules not processed for user `486eb8faf5d043adabc9454c5f3d2632`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:26.831995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f9e1508d-6a70-4804-920c-dfc7c074639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:26.846519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a76db-6ca0-48b4-8213-894d1c119be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:26.847136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a76db-6ca0-48b4-8213-894d1c119be8 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.847416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a76db-6ca0-48b4-8213-894d1c119be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.847759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a76db-6ca0-48b4-8213-894d1c119be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.848405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a76db-6ca0-48b4-8213-894d1c119be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:26.850400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a76db-6ca0-48b4-8213-894d1c119be8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:26.908044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1002/1998] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:26.909070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1508d-6a70-4804-920c-dfc7c074639f None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:26.911026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f9e1508d-6a70-4804-920c-dfc7c074639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:26.925127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1508d-6a70-4804-920c-dfc7c074639f None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:26.930329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:26.931079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.931420 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.932115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] PATH_INFO: `/v3/projects/4e7e91996fd648d2a81aa102d57e5755` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:26.933413 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7e91996fd648d2a81aa102d57e5755)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:26.935532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:26.969072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 997/1999] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:26 2022] POST /identity/v3/projects => generated 389 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:26.970834 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530973e-688c-4413-accc-659143599897 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:26.971124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530973e-688c-4413-accc-659143599897 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:26.974104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530973e-688c-4413-accc-659143599897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.002460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-d530973e-688c-4413-accc-659143599897 None None] MFA Rules not processed for user `92ab635a1ad247c6a41ca94018fd6b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:27.003689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d530973e-688c-4413-accc-659143599897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:27.038053 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7e91996fd648d2a81aa102d57e5755', 'request_id': 'req-721058aa-16e0-4c4e-a61d-3c0a0b77c645'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:27.069045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 998/2000] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:27.070118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530973e-688c-4413-accc-659143599897 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.071468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d530973e-688c-4413-accc-659143599897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:27.111717 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7e91996fd648d2a81aa102d57e5755', 'request_id': 'req-721058aa-16e0-4c4e-a61d-3c0a0b77c645'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:27.117999 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7e91996fd648d2a81aa102d57e5755', 'request_id': 'req-721058aa-16e0-4c4e-a61d-3c0a0b77c645'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:27.126298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530973e-688c-4413-accc-659143599897 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.130175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] The token cache is being invalidate because project 4e7e91996fd648d2a81aa102d57e5755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:27.130470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:27.131138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:27.132653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1003/2001] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:26 2022] DELETE /identity/v3/projects/4e7e91996fd648d2a81aa102d57e5755 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:27.133618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.134933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:27.183298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85863d1a-be7d-4f6d-b079-81d5f4b2186b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.183923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85863d1a-be7d-4f6d-b079-81d5f4b2186b service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.184204 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85863d1a-be7d-4f6d-b079-81d5f4b2186b service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.184524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85863d1a-be7d-4f6d-b079-81d5f4b2186b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.186778 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-85863d1a-be7d-4f6d-b079-81d5f4b2186b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:27.205262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721058aa-16e0-4c4e-a61d-3c0a0b77c645 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.210533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9154f1-788a-4e73-9156-6528d62f6621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.211346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9154f1-788a-4e73-9156-6528d62f6621 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.211635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9154f1-788a-4e73-9156-6528d62f6621 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.211915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9154f1-788a-4e73-9156-6528d62f6621 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.212558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9154f1-788a-4e73-9156-6528d62f6621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:27.214900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9154f1-788a-4e73-9156-6528d62f6621 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:27.252219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85863d1a-be7d-4f6d-b079-81d5f4b2186b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:27.253737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85863d1a-be7d-4f6d-b079-81d5f4b2186b service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:27.257931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:27.263633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 999/2002] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:27.264681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85863d1a-be7d-4f6d-b079-81d5f4b2186b service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.265986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-85863d1a-be7d-4f6d-b079-81d5f4b2186b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:27.283360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85863d1a-be7d-4f6d-b079-81d5f4b2186b service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.296215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c0435-932a-47d5-8820-9e8d3a0f6dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.296215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0435-932a-47d5-8820-9e8d3a0f6dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.296215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0435-932a-47d5-8820-9e8d3a0f6dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.296215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c0435-932a-47d5-8820-9e8d3a0f6dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.296656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c0435-932a-47d5-8820-9e8d3a0f6dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:27.296656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c0435-932a-47d5-8820-9e8d3a0f6dc8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:27.325656 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1004/2003] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:27 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:27.327269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee451763-23df-49b4-9f25-753c42d9c358 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.327938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee451763-23df-49b4-9f25-753c42d9c358 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.328240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee451763-23df-49b4-9f25-753c42d9c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.351150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ee451763-23df-49b4-9f25-753c42d9c358 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:27.352412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ee451763-23df-49b4-9f25-753c42d9c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:27.361504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1005/2004] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:27.362401 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee451763-23df-49b4-9f25-753c42d9c358 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.370731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ee451763-23df-49b4-9f25-753c42d9c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:27.375815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee451763-23df-49b4-9f25-753c42d9c358 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.380553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.381289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.381600 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.381884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] PATH_INFO: `/v3/users/486eb8faf5d043adabc9454c5f3d2632` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.383045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=486eb8faf5d043adabc9454c5f3d2632)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:27.386165 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:27.406934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1000/2005] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:27 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:27.407807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c0435-932a-47d5-8820-9e8d3a0f6dc8 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.477205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c0435-932a-47d5-8820-9e8d3a0f6dc8 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.482408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183e8c0-8592-43bc-a943-c39d68d123a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.483202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183e8c0-8592-43bc-a943-c39d68d123a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.483554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183e8c0-8592-43bc-a943-c39d68d123a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.483993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183e8c0-8592-43bc-a943-c39d68d123a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.484874 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183e8c0-8592-43bc-a943-c39d68d123a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:27.486599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183e8c0-8592-43bc-a943-c39d68d123a7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:27.498185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1001/2006] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:27.499489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b87e-d422-4abb-9e67-af05b44513e8 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.499773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b87e-d422-4abb-9e67-af05b44513e8 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.500051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b87e-d422-4abb-9e67-af05b44513e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.523132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-e5f8b87e-d422-4abb-9e67-af05b44513e8 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:27.524445 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e5f8b87e-d422-4abb-9e67-af05b44513e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:27.533141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1002/2007] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:27.534123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8b87e-d422-4abb-9e67-af05b44513e8 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.543700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8b87e-d422-4abb-9e67-af05b44513e8 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.549015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827a5f8-81bc-4f66-9731-4111b792a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.549560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827a5f8-81bc-4f66-9731-4111b792a1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.549903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827a5f8-81bc-4f66-9731-4111b792a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.550177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827a5f8-81bc-4f66-9731-4111b792a1e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.550852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827a5f8-81bc-4f66-9731-4111b792a1e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:27.553204 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827a5f8-81bc-4f66-9731-4111b792a1e7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:27.629357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486eb8faf5d043adabc9454c5f3d2632'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:27.641781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486eb8faf5d043adabc9454c5f3d2632'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:27.649873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486eb8faf5d043adabc9454c5f3d2632'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:27.658297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1003/2008] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:27 2022] POST /identity/v3/users => generated 302 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:27.659321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827a5f8-81bc-4f66-9731-4111b792a1e7 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.669814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827a5f8-81bc-4f66-9731-4111b792a1e7 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.674549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72c2b9-3a4b-46f8-b33a-9a19f2bfea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.675130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72c2b9-3a4b-46f8-b33a-9a19f2bfea47 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.675413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72c2b9-3a4b-46f8-b33a-9a19f2bfea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.675688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72c2b9-3a4b-46f8-b33a-9a19f2bfea47 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.676356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72c2b9-3a4b-46f8-b33a-9a19f2bfea47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:27.678090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72c2b9-3a4b-46f8-b33a-9a19f2bfea47 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:27.688190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1004/2009] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:27.689091 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72c2b9-3a4b-46f8-b33a-9a19f2bfea47 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.699182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72c2b9-3a4b-46f8-b33a-9a19f2bfea47 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.704794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c0943-3c7e-4405-8e93-b0bdfe28e6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.705391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c0943-3c7e-4405-8e93-b0bdfe28e6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.705786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c0943-3c7e-4405-8e93-b0bdfe28e6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.706067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c0943-3c7e-4405-8e93-b0bdfe28e6f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.706718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c0943-3c7e-4405-8e93-b0bdfe28e6f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:27.707022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c0943-3c7e-4405-8e93-b0bdfe28e6f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:27.708618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c0943-3c7e-4405-8e93-b0bdfe28e6f2 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:27.721389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1005/2010] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:27.722353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c0943-3c7e-4405-8e93-b0bdfe28e6f2 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.742348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c0943-3c7e-4405-8e93-b0bdfe28e6f2 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.742348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84b0d-1fb0-4907-be86-d01e3e28265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.742348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84b0d-1fb0-4907-be86-d01e3e28265f admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.742348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84b0d-1fb0-4907-be86-d01e3e28265f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.742833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a84b0d-1fb0-4907-be86-d01e3e28265f admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.742833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a84b0d-1fb0-4907-be86-d01e3e28265f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:27.742833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a84b0d-1fb0-4907-be86-d01e3e28265f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:27.753913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1006/2011] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:27.753913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84b0d-1fb0-4907-be86-d01e3e28265f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.761033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a84b0d-1fb0-4907-be86-d01e3e28265f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.765727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2ee00-c468-47ba-a5e0-ec9a09f724ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.766347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2ee00-c468-47ba-a5e0-ec9a09f724ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.766624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2ee00-c468-47ba-a5e0-ec9a09f724ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.766977 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2ee00-c468-47ba-a5e0-ec9a09f724ab admin admin] PATH_INFO: `/v3/projects/18be9d816eb34189af664447e4a87720/users/760c89d538d14f6e95310480204fbb12/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.782100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2ee00-c468-47ba-a5e0-ec9a09f724ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=18be9d816eb34189af664447e4a87720, user_id=760c89d538d14f6e95310480204fbb12, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:27.784909 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2ee00-c468-47ba-a5e0-ec9a09f724ab admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:27.812314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486eb8faf5d043adabc9454c5f3d2632'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:27.812874 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486eb8faf5d043adabc9454c5f3d2632'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:27.819652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1006/2012] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:27 2022] DELETE /identity/v3/users/486eb8faf5d043adabc9454c5f3d2632 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:27.820417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.821804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:27.885718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47986e-cd43-4ef7-bb15-9e70d695b562 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.890876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87061e-e98b-4112-8918-9ede8467f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.891531 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87061e-e98b-4112-8918-9ede8467f087 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.891816 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87061e-e98b-4112-8918-9ede8467f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.892096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87061e-e98b-4112-8918-9ede8467f087 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:27.892747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87061e-e98b-4112-8918-9ede8467f087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:27.894728 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87061e-e98b-4112-8918-9ede8467f087 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:27.912192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1007/2013] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:27 2022] PUT /identity/v3/projects/18be9d816eb34189af664447e4a87720/users/760c89d538d14f6e95310480204fbb12/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:27.916034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2ee00-c468-47ba-a5e0-ec9a09f724ab admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:27.918288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:27.920398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-dba2ee00-c468-47ba-a5e0-ec9a09f724ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:27.988806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2ee00-c468-47ba-a5e0-ec9a09f724ab admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:27.993718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778244-9eb1-488a-8816-d8f974557d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:27.994395 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778244-9eb1-488a-8816-d8f974557d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:27.994683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778244-9eb1-488a-8816-d8f974557d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:27.994972 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778244-9eb1-488a-8816-d8f974557d3c admin admin] PATH_INFO: `/v3/projects/60ccfe28d0f949859269c51d2fbb7cee/users/0cedc72f7a7349f58adb751497ef64ae/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.003533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1007/2014] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:27 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:28.003533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a4e85-e0c2-46ce-b64d-c303f5d8f8d4 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.003533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a4e85-e0c2-46ce-b64d-c303f5d8f8d4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.003533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a4e85-e0c2-46ce-b64d-c303f5d8f8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.015359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d778244-9eb1-488a-8816-d8f974557d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ccfe28d0f949859269c51d2fbb7cee, user_id=0cedc72f7a7349f58adb751497ef64ae, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.018262 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d778244-9eb1-488a-8816-d8f974557d3c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.030478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f64a4e85-e0c2-46ce-b64d-c303f5d8f8d4 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:28.031755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f64a4e85-e0c2-46ce-b64d-c303f5d8f8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:28.094074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1008/2015] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:27 2022] PUT /identity/v3/projects/60ccfe28d0f949859269c51d2fbb7cee/users/0cedc72f7a7349f58adb751497ef64ae/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:28.095324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d34744-e9a7-4e5f-8a28-99efb0017111 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.095668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d34744-e9a7-4e5f-8a28-99efb0017111 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.096009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d34744-e9a7-4e5f-8a28-99efb0017111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.103963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1008/2016] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:28.104874 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a4e85-e0c2-46ce-b64d-c303f5d8f8d4 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.115288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a4e85-e0c2-46ce-b64d-c303f5d8f8d4 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.139834 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b7d34744-e9a7-4e5f-8a28-99efb0017111 None None] MFA Rules not processed for user `760c89d538d14f6e95310480204fbb12`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:28.141315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b7d34744-e9a7-4e5f-8a28-99efb0017111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:28.179251 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e6230-f5af-4cf8-8b50-35c058346300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.180379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6230-f5af-4cf8-8b50-35c058346300 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.180664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6230-f5af-4cf8-8b50-35c058346300 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.180939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e6230-f5af-4cf8-8b50-35c058346300 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.181610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e6230-f5af-4cf8-8b50-35c058346300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.183888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e6230-f5af-4cf8-8b50-35c058346300 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.217644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1009/2017] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:28.217644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d34744-e9a7-4e5f-8a28-99efb0017111 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.229531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d34744-e9a7-4e5f-8a28-99efb0017111 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.235654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c40cbe-08a1-4036-a8fa-bba27382cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.236412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40cbe-08a1-4036-a8fa-bba27382cfaf admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.236775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40cbe-08a1-4036-a8fa-bba27382cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.237127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c40cbe-08a1-4036-a8fa-bba27382cfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.237814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c40cbe-08a1-4036-a8fa-bba27382cfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.239426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c40cbe-08a1-4036-a8fa-bba27382cfaf admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.250305 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1010/2018] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:28.251547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c40cbe-08a1-4036-a8fa-bba27382cfaf admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.254337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-82c40cbe-08a1-4036-a8fa-bba27382cfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:28.276209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1009/2019] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:28 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:28.276209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e6230-f5af-4cf8-8b50-35c058346300 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.276209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ff2e6230-f5af-4cf8-8b50-35c058346300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:28.285725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e6230-f5af-4cf8-8b50-35c058346300 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.290830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e86ef-442a-415d-9466-4eafa9827904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.291566 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e86ef-442a-415d-9466-4eafa9827904 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.291947 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e86ef-442a-415d-9466-4eafa9827904 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.292365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e86ef-442a-415d-9466-4eafa9827904 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.293245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e86ef-442a-415d-9466-4eafa9827904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.296074 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e86ef-442a-415d-9466-4eafa9827904 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.328868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c40cbe-08a1-4036-a8fa-bba27382cfaf admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.333041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2465157-adcd-49f3-b684-59e63d6ce9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.333805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2465157-adcd-49f3-b684-59e63d6ce9de service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.334086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2465157-adcd-49f3-b684-59e63d6ce9de service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.334360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2465157-adcd-49f3-b684-59e63d6ce9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.348137 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2465157-adcd-49f3-b684-59e63d6ce9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.349637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2465157-adcd-49f3-b684-59e63d6ce9de service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.365771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1011/2020] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:28.366924 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2465157-adcd-49f3-b684-59e63d6ce9de service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.381103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2465157-adcd-49f3-b684-59e63d6ce9de service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.386614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046edfed-8b85-4577-ae75-cc990067fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.387417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046edfed-8b85-4577-ae75-cc990067fe33 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.388337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046edfed-8b85-4577-ae75-cc990067fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.388815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046edfed-8b85-4577-ae75-cc990067fe33 admin admin] PATH_INFO: `/v3/projects/60ccfe28d0f949859269c51d2fbb7cee/users/0cedc72f7a7349f58adb751497ef64ae/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.391345 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046edfed-8b85-4577-ae75-cc990067fe33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ccfe28d0f949859269c51d2fbb7cee, user_id=0cedc72f7a7349f58adb751497ef64ae, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.394747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046edfed-8b85-4577-ae75-cc990067fe33 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.401881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1010/2021] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:28 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:28.403614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e86ef-442a-415d-9466-4eafa9827904 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.413274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1012/2022] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:28 2022] PUT /identity/v3/projects/60ccfe28d0f949859269c51d2fbb7cee/users/0cedc72f7a7349f58adb751497ef64ae/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:28.423421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046edfed-8b85-4577-ae75-cc990067fe33 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.487040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e86ef-442a-415d-9466-4eafa9827904 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.489762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046edfed-8b85-4577-ae75-cc990067fe33 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.492213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db944c4b-4e90-47f8-b808-656db3a75b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.492831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db944c4b-4e90-47f8-b808-656db3a75b7d admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.493118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db944c4b-4e90-47f8-b808-656db3a75b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.493390 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db944c4b-4e90-47f8-b808-656db3a75b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.494077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db944c4b-4e90-47f8-b808-656db3a75b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.495668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db944c4b-4e90-47f8-b808-656db3a75b7d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.496512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a159-fede-463f-a8a9-9bff288f3070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.498683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a159-fede-463f-a8a9-9bff288f3070 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.499110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a159-fede-463f-a8a9-9bff288f3070 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.499490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a159-fede-463f-a8a9-9bff288f3070 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.500224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052a159-fede-463f-a8a9-9bff288f3070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.502528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052a159-fede-463f-a8a9-9bff288f3070 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.508971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1011/2023] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:28.510594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4d37b-bb4c-41ab-8e0c-d93afd71562a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.511022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4d37b-bb4c-41ab-8e0c-d93afd71562a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.511420 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4d37b-bb4c-41ab-8e0c-d93afd71562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.541938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-9ae4d37b-bb4c-41ab-8e0c-d93afd71562a None None] MFA Rules not processed for user `0cedc72f7a7349f58adb751497ef64ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:28.543404 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9ae4d37b-bb4c-41ab-8e0c-d93afd71562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:28.634287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1012/2024] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:28 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:28.635234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4d37b-bb4c-41ab-8e0c-d93afd71562a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.647116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4d37b-bb4c-41ab-8e0c-d93afd71562a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.659881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1013/2025] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:28 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:28.660815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a159-fede-463f-a8a9-9bff288f3070 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.663939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2052a159-fede-463f-a8a9-9bff288f3070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:28.666072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a3bb6-b07d-49a3-84e1-6ef409cb4677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.666606 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a3bb6-b07d-49a3-84e1-6ef409cb4677 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.666889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a3bb6-b07d-49a3-84e1-6ef409cb4677 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.667161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a3bb6-b07d-49a3-84e1-6ef409cb4677 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.668749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a3bb6-b07d-49a3-84e1-6ef409cb4677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.670939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828a3bb6-b07d-49a3-84e1-6ef409cb4677 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.694384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1013/2026] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:28.694384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a3bb6-b07d-49a3-84e1-6ef409cb4677 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.707623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a3bb6-b07d-49a3-84e1-6ef409cb4677 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.713844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755117c-1be2-45d8-8a29-7fb2bfcc2d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.714457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755117c-1be2-45d8-8a29-7fb2bfcc2d67 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.714740 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755117c-1be2-45d8-8a29-7fb2bfcc2d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.715012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755117c-1be2-45d8-8a29-7fb2bfcc2d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.716420 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755117c-1be2-45d8-8a29-7fb2bfcc2d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.718902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755117c-1be2-45d8-8a29-7fb2bfcc2d67 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.733759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1014/2027] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:28.733759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755117c-1be2-45d8-8a29-7fb2bfcc2d67 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.742339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755117c-1be2-45d8-8a29-7fb2bfcc2d67 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.748360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a159-fede-463f-a8a9-9bff288f3070 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.749257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8030a4e-2995-40da-98b7-a0b332f2388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.749998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8030a4e-2995-40da-98b7-a0b332f2388d admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.750314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8030a4e-2995-40da-98b7-a0b332f2388d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.750713 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8030a4e-2995-40da-98b7-a0b332f2388d admin admin] PATH_INFO: `/v3/projects/ce0ae730e61748d5bbd26714402b5c14/users/b13340a6f8824040b232ee6cf8cdc745/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.753207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0893-d1bb-4497-9eac-42f14e61adf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.753909 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0893-d1bb-4497-9eac-42f14e61adf9 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.754189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0893-d1bb-4497-9eac-42f14e61adf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.771215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8030a4e-2995-40da-98b7-a0b332f2388d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0ae730e61748d5bbd26714402b5c14, user_id=b13340a6f8824040b232ee6cf8cdc745, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.772110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0893-d1bb-4497-9eac-42f14e61adf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.774316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8030a4e-2995-40da-98b7-a0b332f2388d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.794831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d0893-d1bb-4497-9eac-42f14e61adf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.796493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d0893-d1bb-4497-9eac-42f14e61adf9 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.807924 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1014/2028] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:28.808707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0893-d1bb-4497-9eac-42f14e61adf9 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.821625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0893-d1bb-4497-9eac-42f14e61adf9 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:28.830562 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdc696-355b-4f72-8745-d20b97fbe4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:28.831781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdc696-355b-4f72-8745-d20b97fbe4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.832142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdc696-355b-4f72-8745-d20b97fbe4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.832487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdc696-355b-4f72-8745-d20b97fbe4f5 admin admin] PATH_INFO: `/v3/projects/3824c83614ed4798b63fea09c6831cf4/users/354497fc8af046dba1bee01835626975/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.870523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdc696-355b-4f72-8745-d20b97fbe4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3824c83614ed4798b63fea09c6831cf4, user_id=354497fc8af046dba1bee01835626975, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:28.872109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1015/2029] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:28 2022] PUT /identity/v3/projects/ce0ae730e61748d5bbd26714402b5c14/users/b13340a6f8824040b232ee6cf8cdc745/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:28.875191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdc696-355b-4f72-8745-d20b97fbe4f5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:28.898478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd4d7-eb5c-4599-a0a6-91e162894ccf None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:28.898478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd4d7-eb5c-4599-a0a6-91e162894ccf None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:28.898478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bd4d7-eb5c-4599-a0a6-91e162894ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:28.933357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2a8bd4d7-eb5c-4599-a0a6-91e162894ccf None None] MFA Rules not processed for user `b13340a6f8824040b232ee6cf8cdc745`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:28.934838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2a8bd4d7-eb5c-4599-a0a6-91e162894ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:28.980525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1015/2030] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:28 2022] PUT /identity/v3/projects/3824c83614ed4798b63fea09c6831cf4/users/354497fc8af046dba1bee01835626975/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:28.982092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdc696-355b-4f72-8745-d20b97fbe4f5 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:28.986698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-19cdc696-355b-4f72-8745-d20b97fbe4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:29.035151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1016/2031] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:29.035938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bd4d7-eb5c-4599-a0a6-91e162894ccf None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:29.037322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2a8bd4d7-eb5c-4599-a0a6-91e162894ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:29.064394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdc696-355b-4f72-8745-d20b97fbe4f5 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:29.068827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b32947-483e-4dd6-a595-ffbc6dd68c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:29.069443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b32947-483e-4dd6-a595-ffbc6dd68c58 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.069898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b32947-483e-4dd6-a595-ffbc6dd68c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.070183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b32947-483e-4dd6-a595-ffbc6dd68c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.071959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e1b32947-483e-4dd6-a595-ffbc6dd68c58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:29.107817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bd4d7-eb5c-4599-a0a6-91e162894ccf None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:29.137335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b32947-483e-4dd6-a595-ffbc6dd68c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:29.139704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b32947-483e-4dd6-a595-ffbc6dd68c58 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:29.149311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1016/2032] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:29.150263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b32947-483e-4dd6-a595-ffbc6dd68c58 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:29.166748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:29.167406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.167818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.168137 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] PATH_INFO: `/v3/projects/f081966d9a4d459a96528103e1f8cca8` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.169594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f081966d9a4d459a96528103e1f8cca8)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:29.171700 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:29.212138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:29.218143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b32947-483e-4dd6-a595-ffbc6dd68c58 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:29.223196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e095a-58a1-49ce-a0f2-f24d30d13639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:29.223803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e095a-58a1-49ce-a0f2-f24d30d13639 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.224089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e095a-58a1-49ce-a0f2-f24d30d13639 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.224367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e095a-58a1-49ce-a0f2-f24d30d13639 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.225018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e095a-58a1-49ce-a0f2-f24d30d13639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:29.226816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e095a-58a1-49ce-a0f2-f24d30d13639 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:29.237461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1017/2033] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:29.238963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e095a-58a1-49ce-a0f2-f24d30d13639 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:29.249527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e095a-58a1-49ce-a0f2-f24d30d13639 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:29.253469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622c2e2-8aa0-45d7-973e-c0d2eb548886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:29.254226 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622c2e2-8aa0-45d7-973e-c0d2eb548886 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.254504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622c2e2-8aa0-45d7-973e-c0d2eb548886 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.254776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622c2e2-8aa0-45d7-973e-c0d2eb548886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.290147 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f081966d9a4d459a96528103e1f8cca8', 'request_id': 'req-213def44-cc9e-47b9-bceb-8204f70965b8'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:29.319080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622c2e2-8aa0-45d7-973e-c0d2eb548886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:29.320533 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622c2e2-8aa0-45d7-973e-c0d2eb548886 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:29.330924 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1018/2034] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:29.331752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622c2e2-8aa0-45d7-973e-c0d2eb548886 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:29.343920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622c2e2-8aa0-45d7-973e-c0d2eb548886 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:29.410614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520307-b04a-40aa-b6cc-2813674f8c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:29.417812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520307-b04a-40aa-b6cc-2813674f8c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.417812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520307-b04a-40aa-b6cc-2813674f8c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.417812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6520307-b04a-40aa-b6cc-2813674f8c77 admin admin] PATH_INFO: `/v3/projects/3824c83614ed4798b63fea09c6831cf4/users/354497fc8af046dba1bee01835626975/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.417812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6520307-b04a-40aa-b6cc-2813674f8c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3824c83614ed4798b63fea09c6831cf4, user_id=354497fc8af046dba1bee01835626975, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:29.417812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6520307-b04a-40aa-b6cc-2813674f8c77 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:29.426496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f081966d9a4d459a96528103e1f8cca8', 'request_id': 'req-213def44-cc9e-47b9-bceb-8204f70965b8'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:29.428187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1019/2035] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:29 2022] PUT /identity/v3/projects/3824c83614ed4798b63fea09c6831cf4/users/354497fc8af046dba1bee01835626975/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:29.429124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520307-b04a-40aa-b6cc-2813674f8c77 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:29.431917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f081966d9a4d459a96528103e1f8cca8', 'request_id': 'req-213def44-cc9e-47b9-bceb-8204f70965b8'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:29.449735 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] The token cache is being invalidate because project f081966d9a4d459a96528103e1f8cca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:29.450841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:29.451659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-213def44-cc9e-47b9-bceb-8204f70965b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:29.458363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1017/2036] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:29 2022] DELETE /identity/v3/projects/f081966d9a4d459a96528103e1f8cca8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:29.464274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a634-10d3-40d7-8b3b-cfeae14b2cc9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.464599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a634-10d3-40d7-8b3b-cfeae14b2cc9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.464918 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a634-10d3-40d7-8b3b-cfeae14b2cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.502143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f178a634-10d3-40d7-8b3b-cfeae14b2cc9 None None] MFA Rules not processed for user `354497fc8af046dba1bee01835626975`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:29.503537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f178a634-10d3-40d7-8b3b-cfeae14b2cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:29.524507 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6520307-b04a-40aa-b6cc-2813674f8c77 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:29.531115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75862517-773a-4e47-bc6f-18823ef621fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:29.531769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75862517-773a-4e47-bc6f-18823ef621fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.532211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75862517-773a-4e47-bc6f-18823ef621fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.532501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75862517-773a-4e47-bc6f-18823ef621fa admin admin] PATH_INFO: `/v3/users/b13340a6f8824040b232ee6cf8cdc745` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.533749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75862517-773a-4e47-bc6f-18823ef621fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13340a6f8824040b232ee6cf8cdc745)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:29.535829 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75862517-773a-4e47-bc6f-18823ef621fa admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:29.583579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1018/2037] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:29.585079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98dbf-976f-46f7-8abe-9e0deb905fa9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.585443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98dbf-976f-46f7-8abe-9e0deb905fa9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.585820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce98dbf-976f-46f7-8abe-9e0deb905fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.590882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:29.611863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-4ce98dbf-976f-46f7-8abe-9e0deb905fa9 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:29.613520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4ce98dbf-976f-46f7-8abe-9e0deb905fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:29.622665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1019/2038] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:29.623707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce98dbf-976f-46f7-8abe-9e0deb905fa9 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:29.625636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4ce98dbf-976f-46f7-8abe-9e0deb905fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:29.701110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce98dbf-976f-46f7-8abe-9e0deb905fa9 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:29.706692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46683033-7094-4197-9c73-dd3d1c4aeb74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:29.713533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46683033-7094-4197-9c73-dd3d1c4aeb74 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.713533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46683033-7094-4197-9c73-dd3d1c4aeb74 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.713533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46683033-7094-4197-9c73-dd3d1c4aeb74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.723520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46683033-7094-4197-9c73-dd3d1c4aeb74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:29.725865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46683033-7094-4197-9c73-dd3d1c4aeb74 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:29.737498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1020/2039] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:29.741920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f412270-6fac-41f8-b056-6d6727e1da4a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.741920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f412270-6fac-41f8-b056-6d6727e1da4a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.741920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f412270-6fac-41f8-b056-6d6727e1da4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.772016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-7f412270-6fac-41f8-b056-6d6727e1da4a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:29.773331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7f412270-6fac-41f8-b056-6d6727e1da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:29.797796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-75862517-773a-4e47-bc6f-18823ef621fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13340a6f8824040b232ee6cf8cdc745'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:29.805803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1021/2040] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:29.823391 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f412270-6fac-41f8-b056-6d6727e1da4a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:29.849748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f412270-6fac-41f8-b056-6d6727e1da4a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:29.858808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7bcd1-c3c0-40df-bd2b-49773057e234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:29.859728 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7bcd1-c3c0-40df-bd2b-49773057e234 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.860168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7bcd1-c3c0-40df-bd2b-49773057e234 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.860435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7bcd1-c3c0-40df-bd2b-49773057e234 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.863141 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7bcd1-c3c0-40df-bd2b-49773057e234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:29.863141 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7bcd1-c3c0-40df-bd2b-49773057e234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:29.863451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7bcd1-c3c0-40df-bd2b-49773057e234 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:29.895353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1022/2041] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:29.898327 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-75862517-773a-4e47-bc6f-18823ef621fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13340a6f8824040b232ee6cf8cdc745'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:29.925563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7bcd1-c3c0-40df-bd2b-49773057e234 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:29.936192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-75862517-773a-4e47-bc6f-18823ef621fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13340a6f8824040b232ee6cf8cdc745'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:29.940661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7bcd1-c3c0-40df-bd2b-49773057e234 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:29.948535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-75862517-773a-4e47-bc6f-18823ef621fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13340a6f8824040b232ee6cf8cdc745'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:29.948656 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bc79a-0cb1-4d86-8aca-459fae0ebd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:29.949803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bc79a-0cb1-4d86-8aca-459fae0ebd23 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.951085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bc79a-0cb1-4d86-8aca-459fae0ebd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.951085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bc79a-0cb1-4d86-8aca-459fae0ebd23 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.952056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bc79a-0cb1-4d86-8aca-459fae0ebd23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:29.953484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-75862517-773a-4e47-bc6f-18823ef621fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13340a6f8824040b232ee6cf8cdc745'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:29.961449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bc79a-0cb1-4d86-8aca-459fae0ebd23 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:29.968410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1020/2042] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:29 2022] DELETE /identity/v3/users/b13340a6f8824040b232ee6cf8cdc745 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:29.973316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc960d-b2bb-4de7-873d-ed5fd850aead None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:29.973902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc960d-b2bb-4de7-873d-ed5fd850aead None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:29.974104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc960d-b2bb-4de7-873d-ed5fd850aead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:29.997895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-eabc960d-b2bb-4de7-873d-ed5fd850aead None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:29.999339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-eabc960d-b2bb-4de7-873d-ed5fd850aead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:30.084879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1021/2043] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:30.084879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc960d-b2bb-4de7-873d-ed5fd850aead None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:30.094242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-eabc960d-b2bb-4de7-873d-ed5fd850aead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:30.105360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc960d-b2bb-4de7-873d-ed5fd850aead None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:30.111997 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb2813-e80d-4d8e-94a9-119fdd77c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:30.112914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb2813-e80d-4d8e-94a9-119fdd77c37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:30.112914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb2813-e80d-4d8e-94a9-119fdd77c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:30.113177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb2813-e80d-4d8e-94a9-119fdd77c37e admin admin] PATH_INFO: `/v3/users/760c89d538d14f6e95310480204fbb12` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:30.114509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb2813-e80d-4d8e-94a9-119fdd77c37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=760c89d538d14f6e95310480204fbb12)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:30.116457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb2813-e80d-4d8e-94a9-119fdd77c37e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:30.194632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1023/2044] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:29 2022] POST /identity/v3/projects => generated 375 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:30.194632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bc79a-0cb1-4d86-8aca-459fae0ebd23 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:30.194632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c74bc79a-0cb1-4d86-8aca-459fae0ebd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:30.260172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bc79a-0cb1-4d86-8aca-459fae0ebd23 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:30.264377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27f460-d540-4a8d-9a0a-c24a97213db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:30.264995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27f460-d540-4a8d-9a0a-c24a97213db5 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:30.265271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27f460-d540-4a8d-9a0a-c24a97213db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:30.265539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27f460-d540-4a8d-9a0a-c24a97213db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:30.336765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27f460-d540-4a8d-9a0a-c24a97213db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:30.338276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27f460-d540-4a8d-9a0a-c24a97213db5 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:30.349483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1024/2045] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:30.350327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27f460-d540-4a8d-9a0a-c24a97213db5 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:30.351679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-db27f460-d540-4a8d-9a0a-c24a97213db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:30.365145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27f460-d540-4a8d-9a0a-c24a97213db5 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:30.369956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642c18d-84ad-4bc0-ae17-7fd08e2774ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:30.370589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642c18d-84ad-4bc0-ae17-7fd08e2774ba admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:30.370893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642c18d-84ad-4bc0-ae17-7fd08e2774ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:30.371172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642c18d-84ad-4bc0-ae17-7fd08e2774ba admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:30.371830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642c18d-84ad-4bc0-ae17-7fd08e2774ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:30.374446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642c18d-84ad-4bc0-ae17-7fd08e2774ba admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:30.434062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0feb2813-e80d-4d8e-94a9-119fdd77c37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760c89d538d14f6e95310480204fbb12'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:30.517770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1025/2046] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:30 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:30.522395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642c18d-84ad-4bc0-ae17-7fd08e2774ba admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:30.535594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642c18d-84ad-4bc0-ae17-7fd08e2774ba admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:30.536065 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0feb2813-e80d-4d8e-94a9-119fdd77c37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760c89d538d14f6e95310480204fbb12'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:30.540930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec3856-2887-4c77-b395-9543bcbeb5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:30.541636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3856-2887-4c77-b395-9543bcbeb5ac admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:30.541931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3856-2887-4c77-b395-9543bcbeb5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:30.542212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec3856-2887-4c77-b395-9543bcbeb5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:30.542871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec3856-2887-4c77-b395-9543bcbeb5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:30.546838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec3856-2887-4c77-b395-9543bcbeb5ac admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:30.554982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0feb2813-e80d-4d8e-94a9-119fdd77c37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760c89d538d14f6e95310480204fbb12'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:30.558347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1026/2047] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:37:30.563457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec3856-2887-4c77-b395-9543bcbeb5ac admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:30.565723 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0feb2813-e80d-4d8e-94a9-119fdd77c37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760c89d538d14f6e95310480204fbb12'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:30.566658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0feb2813-e80d-4d8e-94a9-119fdd77c37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760c89d538d14f6e95310480204fbb12'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:30.574064 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1022/2048] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:30 2022] DELETE /identity/v3/users/760c89d538d14f6e95310480204fbb12 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:30.579575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc35c5-0f5b-4810-be85-bd545aed99f2 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:30.579863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc35c5-0f5b-4810-be85-bd545aed99f2 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:30.580138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc35c5-0f5b-4810-be85-bd545aed99f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:30.583349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec3856-2887-4c77-b395-9543bcbeb5ac admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:30.603183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-eecc35c5-0f5b-4810-be85-bd545aed99f2 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:30.604426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-eecc35c5-0f5b-4810-be85-bd545aed99f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:30.672335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5153c-e3c9-4d04-ab4f-0e26df2c96d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:30.673740 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5153c-e3c9-4d04-ab4f-0e26df2c96d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:30.674283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5153c-e3c9-4d04-ab4f-0e26df2c96d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:30.674737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5153c-e3c9-4d04-ab4f-0e26df2c96d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:30.678935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5153c-e3c9-4d04-ab4f-0e26df2c96d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:30.678935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5153c-e3c9-4d04-ab4f-0e26df2c96d6 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:30.691449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1027/2049] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:37:30.695443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5153c-e3c9-4d04-ab4f-0e26df2c96d6 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:30.698867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f2c5153c-e3c9-4d04-ab4f-0e26df2c96d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:30.720614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5153c-e3c9-4d04-ab4f-0e26df2c96d6 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:30.724902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1023/2050] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:30.728293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791760e-fc1e-4bde-8fa7-e30517b1149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:30.732776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791760e-fc1e-4bde-8fa7-e30517b1149c admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:30.732776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791760e-fc1e-4bde-8fa7-e30517b1149c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:30.732776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791760e-fc1e-4bde-8fa7-e30517b1149c admin admin] PATH_INFO: `/v3/projects/70d6041c5cba45018ec4ab183a1178da/users/2ccdf34da088401e982a558a316b6d53/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:30.736878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc35c5-0f5b-4810-be85-bd545aed99f2 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:30.740579 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-eecc35c5-0f5b-4810-be85-bd545aed99f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:30.754490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791760e-fc1e-4bde-8fa7-e30517b1149c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d6041c5cba45018ec4ab183a1178da, user_id=2ccdf34da088401e982a558a316b6d53, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:30.758198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791760e-fc1e-4bde-8fa7-e30517b1149c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:30.831406 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc35c5-0f5b-4810-be85-bd545aed99f2 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:30.835592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbf1b5-9093-4c71-a6cf-f192497012c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:30.836220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf1b5-9093-4c71-a6cf-f192497012c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:30.836504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf1b5-9093-4c71-a6cf-f192497012c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:30.836872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbf1b5-9093-4c71-a6cf-f192497012c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:30.847540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf1b5-9093-4c71-a6cf-f192497012c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:30.849021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbf1b5-9093-4c71-a6cf-f192497012c8 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:30.861543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1024/2051] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:30.948252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1028/2052] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:30 2022] PUT /identity/v3/projects/70d6041c5cba45018ec4ab183a1178da/users/2ccdf34da088401e982a558a316b6d53/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:30.961298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52073333-70d3-4097-b5e3-cd89df88a857 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:30.961560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52073333-70d3-4097-b5e3-cd89df88a857 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:30.961873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52073333-70d3-4097-b5e3-cd89df88a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:31.002743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791760e-fc1e-4bde-8fa7-e30517b1149c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:31.005383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4791760e-fc1e-4bde-8fa7-e30517b1149c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:31.024177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-52073333-70d3-4097-b5e3-cd89df88a857 None None] MFA Rules not processed for user `2ccdf34da088401e982a558a316b6d53`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:31.025861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-52073333-70d3-4097-b5e3-cd89df88a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:31.093057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791760e-fc1e-4bde-8fa7-e30517b1149c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:31.102580 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:31.103479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:31.103962 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:31.107696 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] PATH_INFO: `/v3/projects/ce0ae730e61748d5bbd26714402b5c14` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:31.110342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0ae730e61748d5bbd26714402b5c14)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:31.115269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:31.236945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1025/2053] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:31.246464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52073333-70d3-4097-b5e3-cd89df88a857 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:31.248456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-52073333-70d3-4097-b5e3-cd89df88a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:31.311144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52073333-70d3-4097-b5e3-cd89df88a857 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:31.314903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf5464-a1b3-4f61-80cf-7870c6a05b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:31.315560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5464-a1b3-4f61-80cf-7870c6a05b48 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:31.315839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5464-a1b3-4f61-80cf-7870c6a05b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:31.316113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5464-a1b3-4f61-80cf-7870c6a05b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:31.325197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf5464-a1b3-4f61-80cf-7870c6a05b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:31.326729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf5464-a1b3-4f61-80cf-7870c6a05b48 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:31.336318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1026/2054] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:31.639916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:31.669696 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0ae730e61748d5bbd26714402b5c14', 'request_id': 'req-da327e68-0d1c-47f6-9d64-b8d47b0e0505'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:31.909889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0ae730e61748d5bbd26714402b5c14', 'request_id': 'req-da327e68-0d1c-47f6-9d64-b8d47b0e0505'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:31.916409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0ae730e61748d5bbd26714402b5c14', 'request_id': 'req-da327e68-0d1c-47f6-9d64-b8d47b0e0505'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:31.929362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] The token cache is being invalidate because project ce0ae730e61748d5bbd26714402b5c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:31.929753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:31.930448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:31.932080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1029/2055] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:31 2022] DELETE /identity/v3/projects/ce0ae730e61748d5bbd26714402b5c14 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:31.937368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126b554-9cec-4513-9de9-8c8d4762a9dc None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:31.937830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126b554-9cec-4513-9de9-8c8d4762a9dc None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:31.938022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126b554-9cec-4513-9de9-8c8d4762a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:31.955894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:31.957349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:31.966658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-c126b554-9cec-4513-9de9-8c8d4762a9dc None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:31.968875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c126b554-9cec-4513-9de9-8c8d4762a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:32.043386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327e68-0d1c-47f6-9d64-b8d47b0e0505 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:32.049562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:32.050297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:32.050579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:32.050853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] PATH_INFO: `/v3/projects/18be9d816eb34189af664447e4a87720` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:32.052125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18be9d816eb34189af664447e4a87720)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:32.054497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:32.055707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1027/2056] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:32.065708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b9f5-b1e7-492f-86bb-ea918353595a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:32.065994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b9f5-b1e7-492f-86bb-ea918353595a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:32.066301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b9f5-b1e7-492f-86bb-ea918353595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:32.090523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-8541b9f5-b1e7-492f-86bb-ea918353595a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:32.091768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8541b9f5-b1e7-492f-86bb-ea918353595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:32.101333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1028/2057] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:32.105732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541b9f5-b1e7-492f-86bb-ea918353595a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:32.116578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541b9f5-b1e7-492f-86bb-ea918353595a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:32.121421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfe615-a749-4681-b3ec-3f2f6896980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:32.122805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfe615-a749-4681-b3ec-3f2f6896980f admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:32.123310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfe615-a749-4681-b3ec-3f2f6896980f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:32.123720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfe615-a749-4681-b3ec-3f2f6896980f admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:32.124397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfe615-a749-4681-b3ec-3f2f6896980f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:32.124711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfe615-a749-4681-b3ec-3f2f6896980f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:32.126380 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfe615-a749-4681-b3ec-3f2f6896980f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:32.144765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1029/2058] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:32.149225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfe615-a749-4681-b3ec-3f2f6896980f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:32.159679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfe615-a749-4681-b3ec-3f2f6896980f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:32.164371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0d689-1c4f-4794-b155-fdd9ed002459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:32.164962 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0d689-1c4f-4794-b155-fdd9ed002459 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:32.165243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0d689-1c4f-4794-b155-fdd9ed002459 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:32.165519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0d689-1c4f-4794-b155-fdd9ed002459 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:32.166192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0d689-1c4f-4794-b155-fdd9ed002459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:32.168106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0d689-1c4f-4794-b155-fdd9ed002459 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:32.247657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18be9d816eb34189af664447e4a87720', 'request_id': 'req-a5791ea3-0dee-48c2-b578-1a18afab2ef3'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:32.296813 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1030/2059] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:32 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:32.298069 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0d689-1c4f-4794-b155-fdd9ed002459 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:32.380946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0d689-1c4f-4794-b155-fdd9ed002459 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:32.381166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18be9d816eb34189af664447e4a87720', 'request_id': 'req-a5791ea3-0dee-48c2-b578-1a18afab2ef3'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:32.386898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2a577-d4a8-4ec7-bce7-bcbc15c3a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:32.388282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2a577-d4a8-4ec7-bce7-bcbc15c3a5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:32.388718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2a577-d4a8-4ec7-bce7-bcbc15c3a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:32.389151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2a577-d4a8-4ec7-bce7-bcbc15c3a5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:32.390086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2a577-d4a8-4ec7-bce7-bcbc15c3a5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:32.395485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2a577-d4a8-4ec7-bce7-bcbc15c3a5f4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:32.395628 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18be9d816eb34189af664447e4a87720', 'request_id': 'req-a5791ea3-0dee-48c2-b578-1a18afab2ef3'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:32.408766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] The token cache is being invalidate because project 18be9d816eb34189af664447e4a87720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:32.409060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:32.409830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:32.411348 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1030/2060] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:31 2022] DELETE /identity/v3/projects/18be9d816eb34189af664447e4a87720 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:32.415172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:32.416485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:32.496198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5791ea3-0dee-48c2-b578-1a18afab2ef3 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:32.502110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:32.502765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:32.503045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:32.503315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] PATH_INFO: `/v3/users/354497fc8af046dba1bee01835626975` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:32.504515 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=354497fc8af046dba1bee01835626975)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:32.506588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:32.529524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:32.538707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1031/2061] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:32 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:32.543414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2a577-d4a8-4ec7-bce7-bcbc15c3a5f4 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:32.548354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-19c2a577-d4a8-4ec7-bce7-bcbc15c3a5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:32.564509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2a577-d4a8-4ec7-bce7-bcbc15c3a5f4 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:32.574451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be454bd8-56af-43da-912a-252ee5614959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:32.574451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be454bd8-56af-43da-912a-252ee5614959 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:32.574451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be454bd8-56af-43da-912a-252ee5614959 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:32.574451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be454bd8-56af-43da-912a-252ee5614959 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:32.574889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be454bd8-56af-43da-912a-252ee5614959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:32.574889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be454bd8-56af-43da-912a-252ee5614959 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:32.592077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1032/2062] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:32.594588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be454bd8-56af-43da-912a-252ee5614959 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:32.614848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be454bd8-56af-43da-912a-252ee5614959 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:32.617198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e7954-dd49-47a5-915b-ba67224978f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:32.617848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e7954-dd49-47a5-915b-ba67224978f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:32.618126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e7954-dd49-47a5-915b-ba67224978f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:32.618398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e7954-dd49-47a5-915b-ba67224978f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:32.619071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e7954-dd49-47a5-915b-ba67224978f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:32.620690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e7954-dd49-47a5-915b-ba67224978f6 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:32.636239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1033/2063] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:32.642359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e7954-dd49-47a5-915b-ba67224978f6 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:32.652129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e7954-dd49-47a5-915b-ba67224978f6 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:32.658029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b223e10-8c08-44cb-9f52-e7a524d1736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:32.658693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b223e10-8c08-44cb-9f52-e7a524d1736a admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:32.659082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b223e10-8c08-44cb-9f52-e7a524d1736a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:32.659291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b223e10-8c08-44cb-9f52-e7a524d1736a admin admin] PATH_INFO: `/v3/projects/0140a5425e974f4096de79d05046c97d/users/47a12d33069942bdafefa68b2fdea3a5/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:32.682365 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b223e10-8c08-44cb-9f52-e7a524d1736a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0140a5425e974f4096de79d05046c97d, user_id=47a12d33069942bdafefa68b2fdea3a5, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:32.686167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b223e10-8c08-44cb-9f52-e7a524d1736a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:32.756066 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1034/2064] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:32 2022] PUT /identity/v3/projects/0140a5425e974f4096de79d05046c97d/users/47a12d33069942bdafefa68b2fdea3a5/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:32.769128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2b2f4-4a44-4c8a-aca6-31f877aaa50f None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:32.769605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2b2f4-4a44-4c8a-aca6-31f877aaa50f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:32.769933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2b2f4-4a44-4c8a-aca6-31f877aaa50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:32.772452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '354497fc8af046dba1bee01835626975'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:32.786428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '354497fc8af046dba1bee01835626975'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:32.798469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '354497fc8af046dba1bee01835626975'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:32.802371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b4b2b2f4-4a44-4c8a-aca6-31f877aaa50f None None] MFA Rules not processed for user `47a12d33069942bdafefa68b2fdea3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:32.808561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b4b2b2f4-4a44-4c8a-aca6-31f877aaa50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:32.880530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1035/2065] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:32.903378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '354497fc8af046dba1bee01835626975'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:32.904805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '354497fc8af046dba1bee01835626975'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:32.911513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1031/2066] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:32 2022] DELETE /identity/v3/users/354497fc8af046dba1bee01835626975 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:33.021764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2b2f4-4a44-4c8a-aca6-31f877aaa50f None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:33.023445 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b4b2b2f4-4a44-4c8a-aca6-31f877aaa50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:33.097450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2b2f4-4a44-4c8a-aca6-31f877aaa50f None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:33.149135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660038e-4461-4e2c-9d25-5cf2b16794c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:33.149781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660038e-4461-4e2c-9d25-5cf2b16794c4 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:33.150057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660038e-4461-4e2c-9d25-5cf2b16794c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:33.150358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660038e-4461-4e2c-9d25-5cf2b16794c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:33.152140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2660038e-4461-4e2c-9d25-5cf2b16794c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:33.229546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660038e-4461-4e2c-9d25-5cf2b16794c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:33.230876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660038e-4461-4e2c-9d25-5cf2b16794c4 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:33.241348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1036/2067] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:33.265963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:33.267768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:33.358695 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934794f9-435a-46f9-a26d-c03484d5fab2 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:33.363307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df548b-93e3-4d17-b59a-a2e9623f5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:33.365675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df548b-93e3-4d17-b59a-a2e9623f5712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:33.365675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df548b-93e3-4d17-b59a-a2e9623f5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:33.365675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df548b-93e3-4d17-b59a-a2e9623f5712 admin admin] PATH_INFO: `/v3/users/47a12d33069942bdafefa68b2fdea3a5` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:33.365675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df548b-93e3-4d17-b59a-a2e9623f5712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a12d33069942bdafefa68b2fdea3a5)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:33.367541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df548b-93e3-4d17-b59a-a2e9623f5712 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:33.432256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660038e-4461-4e2c-9d25-5cf2b16794c4 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:33.434558 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2660038e-4461-4e2c-9d25-5cf2b16794c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:33.455151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660038e-4461-4e2c-9d25-5cf2b16794c4 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:33.460399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:33.461149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:33.461502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:33.461895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] PATH_INFO: `/v3/projects/3824c83614ed4798b63fea09c6831cf4` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:33.463684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3824c83614ed4798b63fea09c6831cf4)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:33.474545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:33.559806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-97df548b-93e3-4d17-b59a-a2e9623f5712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a12d33069942bdafefa68b2fdea3a5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:33.572749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-97df548b-93e3-4d17-b59a-a2e9623f5712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a12d33069942bdafefa68b2fdea3a5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:33.582276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-97df548b-93e3-4d17-b59a-a2e9623f5712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a12d33069942bdafefa68b2fdea3a5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:33.597816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3824c83614ed4798b63fea09c6831cf4', 'request_id': 'req-0e9cc107-8f1a-447a-8d67-0055129a6fce'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:33.603833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3824c83614ed4798b63fea09c6831cf4', 'request_id': 'req-0e9cc107-8f1a-447a-8d67-0055129a6fce'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:33.610755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3824c83614ed4798b63fea09c6831cf4', 'request_id': 'req-0e9cc107-8f1a-447a-8d67-0055129a6fce'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:33.652190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-97df548b-93e3-4d17-b59a-a2e9623f5712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a12d33069942bdafefa68b2fdea3a5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:33.652805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-97df548b-93e3-4d17-b59a-a2e9623f5712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a12d33069942bdafefa68b2fdea3a5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:33.659610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1032/2068] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:33 2022] DELETE /identity/v3/users/47a12d33069942bdafefa68b2fdea3a5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:33.663885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43ce90-1428-40b9-94e2-5777001f301c None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:33.664201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43ce90-1428-40b9-94e2-5777001f301c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:33.664517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43ce90-1428-40b9-94e2-5777001f301c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:33.683883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-1e43ce90-1428-40b9-94e2-5777001f301c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:33.685797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1e43ce90-1428-40b9-94e2-5777001f301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:33.760581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1033/2069] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:33.760898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] The token cache is being invalidate because project 3824c83614ed4798b63fea09c6831cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:33.761440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:33.762963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:33.766734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1037/2070] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:33 2022] DELETE /identity/v3/projects/3824c83614ed4798b63fea09c6831cf4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:33.771364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23422f-4b86-4bf5-af26-9a875d35d712 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:33.771826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23422f-4b86-4bf5-af26-9a875d35d712 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:33.772262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23422f-4b86-4bf5-af26-9a875d35d712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:33.773678 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:33.785061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:33.825383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-9d23422f-4b86-4bf5-af26-9a875d35d712 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:33.828137 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9d23422f-4b86-4bf5-af26-9a875d35d712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:33.837461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1034/2071] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:33.847396 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c291ee-eb11-4ec6-b612-fb1d9a6a148a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:33.847840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c291ee-eb11-4ec6-b612-fb1d9a6a148a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:33.857012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c291ee-eb11-4ec6-b612-fb1d9a6a148a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:33.861664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cc107-8f1a-447a-8d67-0055129a6fce admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:33.906415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-38c291ee-eb11-4ec6-b612-fb1d9a6a148a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:33.907738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-38c291ee-eb11-4ec6-b612-fb1d9a6a148a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:33.921430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1035/2072] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:33.922506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7cfeb-fbf5-460d-b009-54064b064dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:33.923373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7cfeb-fbf5-460d-b009-54064b064dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:33.923659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7cfeb-fbf5-460d-b009-54064b064dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:33.923933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7cfeb-fbf5-460d-b009-54064b064dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:33.925551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c291ee-eb11-4ec6-b612-fb1d9a6a148a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:33.925888 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5dd7cfeb-fbf5-460d-b009-54064b064dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:33.940696 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c291ee-eb11-4ec6-b612-fb1d9a6a148a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:33.941954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7cfeb-fbf5-460d-b009-54064b064dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:33.943068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7cfeb-fbf5-460d-b009-54064b064dd6 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:33.946260 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042881a-cbbd-44ea-ba14-5b5a3073ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:33.947233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042881a-cbbd-44ea-ba14-5b5a3073ef39 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:33.947359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042881a-cbbd-44ea-ba14-5b5a3073ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:33.947807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042881a-cbbd-44ea-ba14-5b5a3073ef39 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:33.948562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042881a-cbbd-44ea-ba14-5b5a3073ef39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:33.948971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042881a-cbbd-44ea-ba14-5b5a3073ef39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:33.950879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042881a-cbbd-44ea-ba14-5b5a3073ef39 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:33.954494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1038/2073] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:33.963289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1036/2074] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:33.968268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7cfeb-fbf5-460d-b009-54064b064dd6 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:33.980103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7cfeb-fbf5-460d-b009-54064b064dd6 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:33.983513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:33.989332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed58a8-d263-42ed-9c1d-0687526fa177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:33.990232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed58a8-d263-42ed-9c1d-0687526fa177 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:33.991937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed58a8-d263-42ed-9c1d-0687526fa177 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:33.992321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed58a8-d263-42ed-9c1d-0687526fa177 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:33.993047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed58a8-d263-42ed-9c1d-0687526fa177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:33.995501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed58a8-d263-42ed-9c1d-0687526fa177 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:34.024304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:34.154366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1039/2075] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:33 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:34.158583 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042881a-cbbd-44ea-ba14-5b5a3073ef39 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:34.168842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042881a-cbbd-44ea-ba14-5b5a3073ef39 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:34.227117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa7a32-693d-41f5-895d-a21da86bf683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:34.227794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa7a32-693d-41f5-895d-a21da86bf683 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:34.228072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa7a32-693d-41f5-895d-a21da86bf683 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:34.228343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa7a32-693d-41f5-895d-a21da86bf683 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:34.228976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa7a32-693d-41f5-895d-a21da86bf683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:34.231168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa7a32-693d-41f5-895d-a21da86bf683 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:34.410251 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1037/2076] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:34 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:34.414544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed58a8-d263-42ed-9c1d-0687526fa177 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:34.425374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed58a8-d263-42ed-9c1d-0687526fa177 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:34.440411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5ed5a-a8ca-4fba-819b-d48b762ae38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:34.441308 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5ed5a-a8ca-4fba-819b-d48b762ae38b admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:34.441612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5ed5a-a8ca-4fba-819b-d48b762ae38b admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:34.441896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5ed5a-a8ca-4fba-819b-d48b762ae38b admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:34.442647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5ed5a-a8ca-4fba-819b-d48b762ae38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:34.446009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5ed5a-a8ca-4fba-819b-d48b762ae38b admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:34.474335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1040/2077] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:34.478228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa7a32-693d-41f5-895d-a21da86bf683 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:34.490135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa7a32-693d-41f5-895d-a21da86bf683 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:34.495523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd0ef3-f232-464d-810f-202ceae4ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:34.496140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd0ef3-f232-464d-810f-202ceae4ac15 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:34.496421 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd0ef3-f232-464d-810f-202ceae4ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:34.497339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd0ef3-f232-464d-810f-202ceae4ac15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:34.498062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd0ef3-f232-464d-810f-202ceae4ac15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:34.499692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd0ef3-f232-464d-810f-202ceae4ac15 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:34.518289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1038/2078] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:34.521052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5ed5a-a8ca-4fba-819b-d48b762ae38b admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:34.533112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5ed5a-a8ca-4fba-819b-d48b762ae38b admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:34.538222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58b466-565c-4302-8747-bbd33957a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:34.538887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b466-565c-4302-8747-bbd33957a67f admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:34.539347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b466-565c-4302-8747-bbd33957a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:34.539589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58b466-565c-4302-8747-bbd33957a67f admin admin] PATH_INFO: `/v3/projects/4c83c79c011b4c3f8b09ff9e43ec1b51/users/682838c60086457caaad4f24cd0b9124/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:34.557077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58b466-565c-4302-8747-bbd33957a67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c83c79c011b4c3f8b09ff9e43ec1b51, user_id=682838c60086457caaad4f24cd0b9124, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:34.562686 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58b466-565c-4302-8747-bbd33957a67f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:34.648407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd0ef3-f232-464d-810f-202ceae4ac15 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:34.654879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bcfd0ef3-f232-464d-810f-202ceae4ac15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:34.684299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd0ef3-f232-464d-810f-202ceae4ac15 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:34.692154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:34.693029 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:34.693777 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:34.694396 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] PATH_INFO: `/v3/projects/0140a5425e974f4096de79d05046c97d` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:34.696344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0140a5425e974f4096de79d05046c97d)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:34.699921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:34.710030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1041/2079] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:34 2022] PUT /identity/v3/projects/4c83c79c011b4c3f8b09ff9e43ec1b51/users/682838c60086457caaad4f24cd0b9124/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:34.723069 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b36052-132e-4498-8fdc-1baff0740fb3 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:34.723411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b36052-132e-4498-8fdc-1baff0740fb3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:34.723694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b36052-132e-4498-8fdc-1baff0740fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:34.777265 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-05b36052-132e-4498-8fdc-1baff0740fb3 None None] MFA Rules not processed for user `682838c60086457caaad4f24cd0b9124`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:34.780102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-05b36052-132e-4498-8fdc-1baff0740fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:34.867358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1042/2080] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:34.872543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b36052-132e-4498-8fdc-1baff0740fb3 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:34.928495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0140a5425e974f4096de79d05046c97d', 'request_id': 'req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:35.003102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b36052-132e-4498-8fdc-1baff0740fb3 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:35.015042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0140a5425e974f4096de79d05046c97d', 'request_id': 'req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:35.025993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0140a5425e974f4096de79d05046c97d', 'request_id': 'req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:35.048671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] The token cache is being invalidate because project 0140a5425e974f4096de79d05046c97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:35.049526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:35.050481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a4a8046e-1643-4bf4-af82-22eb3ee8aca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:35.052411 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1039/2081] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:34 2022] DELETE /identity/v3/projects/0140a5425e974f4096de79d05046c97d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:35.058065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea174b-3ea7-4c4c-aecc-b5a07118c55a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:35.058333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea174b-3ea7-4c4c-aecc-b5a07118c55a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:35.058622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea174b-3ea7-4c4c-aecc-b5a07118c55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:35.089054 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-21ea174b-3ea7-4c4c-aecc-b5a07118c55a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:35.091195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-21ea174b-3ea7-4c4c-aecc-b5a07118c55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:35.106567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2417017-0443-431b-8d40-e55003f32f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:35.106567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2417017-0443-431b-8d40-e55003f32f55 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:35.107150 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2417017-0443-431b-8d40-e55003f32f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:35.107523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2417017-0443-431b-8d40-e55003f32f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:35.108598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2417017-0443-431b-8d40-e55003f32f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:35.111194 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2417017-0443-431b-8d40-e55003f32f55 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:35.163239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1040/2082] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:35.171819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cfbb9-e29f-4436-9b69-4d7e4b62d688 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:35.172528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cfbb9-e29f-4436-9b69-4d7e4b62d688 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:35.172528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cfbb9-e29f-4436-9b69-4d7e4b62d688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:35.193814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-c35cfbb9-e29f-4436-9b69-4d7e4b62d688 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:35.195178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c35cfbb9-e29f-4436-9b69-4d7e4b62d688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:35.204797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1041/2083] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:35.216228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cfbb9-e29f-4436-9b69-4d7e4b62d688 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:35.224083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1043/2084] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:34 2022] POST /identity/v3/projects => generated 387 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:37:35.225066 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2417017-0443-431b-8d40-e55003f32f55 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:35.227045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c2417017-0443-431b-8d40-e55003f32f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:35.231646 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cfbb9-e29f-4436-9b69-4d7e4b62d688 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:35.312893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387f647-f5f0-4abd-a037-f4a24198ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:35.313743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387f647-f5f0-4abd-a037-f4a24198ef67 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:35.314027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387f647-f5f0-4abd-a037-f4a24198ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:35.314300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387f647-f5f0-4abd-a037-f4a24198ef67 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:35.314896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2417017-0443-431b-8d40-e55003f32f55 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:35.315153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387f647-f5f0-4abd-a037-f4a24198ef67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:35.315662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387f647-f5f0-4abd-a037-f4a24198ef67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:35.317241 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387f647-f5f0-4abd-a037-f4a24198ef67 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:35.320819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21db0d8-accd-48b9-9c2c-9077fdfad17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:35.321453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db0d8-accd-48b9-9c2c-9077fdfad17e admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:35.321789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db0d8-accd-48b9-9c2c-9077fdfad17e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:35.322126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db0d8-accd-48b9-9c2c-9077fdfad17e admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:35.322777 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21db0d8-accd-48b9-9c2c-9077fdfad17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:35.325761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21db0d8-accd-48b9-9c2c-9077fdfad17e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:35.338178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1042/2085] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:35.339195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387f647-f5f0-4abd-a037-f4a24198ef67 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:35.351434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387f647-f5f0-4abd-a037-f4a24198ef67 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:35.360265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de1c6a-8010-4611-b6e0-6bca56040154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:35.361014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de1c6a-8010-4611-b6e0-6bca56040154 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:35.361356 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de1c6a-8010-4611-b6e0-6bca56040154 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:35.361733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de1c6a-8010-4611-b6e0-6bca56040154 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:35.362451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de1c6a-8010-4611-b6e0-6bca56040154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:35.364583 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de1c6a-8010-4611-b6e0-6bca56040154 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:35.472850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1044/2086] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:35 2022] POST /identity/v3/users => generated 300 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:35.473748 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21db0d8-accd-48b9-9c2c-9077fdfad17e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:35.475426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c21db0d8-accd-48b9-9c2c-9077fdfad17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:35.481196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1043/2087] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:35 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:35.482712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de1c6a-8010-4611-b6e0-6bca56040154 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:35.490149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21db0d8-accd-48b9-9c2c-9077fdfad17e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:35.495797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:35.565923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:35.566926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:35.566926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:35.567166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] PATH_INFO: `/v3/users/92ab635a1ad247c6a41ca94018fd6b9c` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:35.568779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ab635a1ad247c6a41ca94018fd6b9c)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:35.571249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de1c6a-8010-4611-b6e0-6bca56040154 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:35.579259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:35.585456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6bc1-70b8-41ea-b6e7-090a9272d090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:35.586125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6bc1-70b8-41ea-b6e7-090a9272d090 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:35.586410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6bc1-70b8-41ea-b6e7-090a9272d090 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:35.586689 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c6bc1-70b8-41ea-b6e7-090a9272d090 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:35.587463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c6bc1-70b8-41ea-b6e7-090a9272d090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:35.589202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c6bc1-70b8-41ea-b6e7-090a9272d090 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:35.604875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1044/2088] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:35.604875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6bc1-70b8-41ea-b6e7-090a9272d090 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:35.616758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c6bc1-70b8-41ea-b6e7-090a9272d090 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:35.625051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1e50-29bb-43c1-b21b-fb23222f35c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:35.625051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1e50-29bb-43c1-b21b-fb23222f35c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:35.625051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1e50-29bb-43c1-b21b-fb23222f35c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:35.625051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1e50-29bb-43c1-b21b-fb23222f35c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:35.626297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb1e50-29bb-43c1-b21b-fb23222f35c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:35.627672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb1e50-29bb-43c1-b21b-fb23222f35c2 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:35.863200 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1045/2089] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:35 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:35.864185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1e50-29bb-43c1-b21b-fb23222f35c2 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:35.873036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ab635a1ad247c6a41ca94018fd6b9c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:35.877880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1e50-29bb-43c1-b21b-fb23222f35c2 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:35.886870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cef089-813a-4b57-91c3-bd916d1f996e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:35.888384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef089-813a-4b57-91c3-bd916d1f996e admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:35.888537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef089-813a-4b57-91c3-bd916d1f996e admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:35.888905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cef089-813a-4b57-91c3-bd916d1f996e admin admin] PATH_INFO: `/v3/projects/1d1175e4dd794bfc981a5fd3ef2d1669/users/1a270382462f4007ad74f4f0aa0907a3/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:35.927378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cef089-813a-4b57-91c3-bd916d1f996e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1175e4dd794bfc981a5fd3ef2d1669, user_id=1a270382462f4007ad74f4f0aa0907a3, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:35.932580 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cef089-813a-4b57-91c3-bd916d1f996e admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:35.978157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ab635a1ad247c6a41ca94018fd6b9c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:36.001283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ab635a1ad247c6a41ca94018fd6b9c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:36.010669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ab635a1ad247c6a41ca94018fd6b9c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:36.011428 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ab635a1ad247c6a41ca94018fd6b9c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:36.015557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:36.022999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1045/2090] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:35 2022] DELETE /identity/v3/users/92ab635a1ad247c6a41ca94018fd6b9c => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:36.024223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:36.026141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:36.091782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1046/2091] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:35 2022] PUT /identity/v3/projects/1d1175e4dd794bfc981a5fd3ef2d1669/users/1a270382462f4007ad74f4f0aa0907a3/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:36.099620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37f766-8e10-4b8b-87a0-303bed1f30be None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:36.100149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37f766-8e10-4b8b-87a0-303bed1f30be None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:36.104020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37f766-8e10-4b8b-87a0-303bed1f30be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:36.161886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-5a37f766-8e10-4b8b-87a0-303bed1f30be None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:36.163564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5a37f766-8e10-4b8b-87a0-303bed1f30be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:36.168241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f64533-4e2d-4098-aa54-eafa8b647fb7 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:36.285195 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8d441-9528-42f5-bbe4-479cb3759b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:36.286149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8d441-9528-42f5-bbe4-479cb3759b03 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:36.286525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8d441-9528-42f5-bbe4-479cb3759b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:36.286929 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8d441-9528-42f5-bbe4-479cb3759b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:36.287726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8d441-9528-42f5-bbe4-479cb3759b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:36.289436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8d441-9528-42f5-bbe4-479cb3759b03 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:36.293438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1047/2092] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:36.295087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37f766-8e10-4b8b-87a0-303bed1f30be None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:36.298626 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5a37f766-8e10-4b8b-87a0-303bed1f30be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:36.301471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1046/2093] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:36.307573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8d441-9528-42f5-bbe4-479cb3759b03 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:36.307573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-78c8d441-9528-42f5-bbe4-479cb3759b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:36.318882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37f766-8e10-4b8b-87a0-303bed1f30be None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:36.327015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0a698-c1a0-493a-b643-c7e328415889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:36.328342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a698-c1a0-493a-b643-c7e328415889 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:36.328636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a698-c1a0-493a-b643-c7e328415889 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:36.328919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a698-c1a0-493a-b643-c7e328415889 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:36.329798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0a698-c1a0-493a-b643-c7e328415889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:36.333086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0a698-c1a0-493a-b643-c7e328415889 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:36.348636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1048/2094] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:36.348636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0a698-c1a0-493a-b643-c7e328415889 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:36.367870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0a698-c1a0-493a-b643-c7e328415889 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:36.374127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39e9b3-aa17-4ad6-91af-81712112df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:36.375304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39e9b3-aa17-4ad6-91af-81712112df61 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:36.375600 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39e9b3-aa17-4ad6-91af-81712112df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:36.375880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39e9b3-aa17-4ad6-91af-81712112df61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:36.376596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39e9b3-aa17-4ad6-91af-81712112df61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:36.378270 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39e9b3-aa17-4ad6-91af-81712112df61 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:36.386592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8d441-9528-42f5-bbe4-479cb3759b03 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:36.390532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1049/2095] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:36.392195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39e9b3-aa17-4ad6-91af-81712112df61 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:36.392802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6ce1b-8799-4587-8b9e-8137f32b9453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:36.393831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6ce1b-8799-4587-8b9e-8137f32b9453 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:36.394417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6ce1b-8799-4587-8b9e-8137f32b9453 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:36.394777 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6ce1b-8799-4587-8b9e-8137f32b9453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:36.403397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39e9b3-aa17-4ad6-91af-81712112df61 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:36.408399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6ce1b-8799-4587-8b9e-8137f32b9453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:36.411797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bac78b-79e8-48ee-8667-0d4cd9132d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:36.411797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bac78b-79e8-48ee-8667-0d4cd9132d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:36.411797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bac78b-79e8-48ee-8667-0d4cd9132d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:36.411797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bac78b-79e8-48ee-8667-0d4cd9132d1b admin admin] PATH_INFO: `/v3/projects/1d1175e4dd794bfc981a5fd3ef2d1669/users/1a270382462f4007ad74f4f0aa0907a3/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:36.412193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6ce1b-8799-4587-8b9e-8137f32b9453 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:36.413337 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bac78b-79e8-48ee-8667-0d4cd9132d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1175e4dd794bfc981a5fd3ef2d1669, user_id=1a270382462f4007ad74f4f0aa0907a3, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:36.416940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bac78b-79e8-48ee-8667-0d4cd9132d1b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:36.424717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1047/2096] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:36.425434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6ce1b-8799-4587-8b9e-8137f32b9453 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:36.437872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6ce1b-8799-4587-8b9e-8137f32b9453 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:36.446636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1050/2097] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:36 2022] PUT /identity/v3/projects/1d1175e4dd794bfc981a5fd3ef2d1669/users/1a270382462f4007ad74f4f0aa0907a3/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:36.459815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac230f3-37fb-4ca6-bea4-fc5545ccd959 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:36.460168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac230f3-37fb-4ca6-bea4-fc5545ccd959 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:36.460677 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac230f3-37fb-4ca6-bea4-fc5545ccd959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:36.505223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:36.514866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0ac230f3-37fb-4ca6-bea4-fc5545ccd959 None None] MFA Rules not processed for user `1a270382462f4007ad74f4f0aa0907a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:36.517671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0ac230f3-37fb-4ca6-bea4-fc5545ccd959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:36.536342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b47c4-18a8-4fda-adfb-6fe4e0cd13d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:36.537065 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b47c4-18a8-4fda-adfb-6fe4e0cd13d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:36.537386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b47c4-18a8-4fda-adfb-6fe4e0cd13d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:36.537706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b47c4-18a8-4fda-adfb-6fe4e0cd13d2 admin admin] PATH_INFO: `/v3/projects/b51a4bb204bd4d2893324932c2bcc85f/users/971d7c560ded4ebcb671386041f234a3/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:36.556650 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b47c4-18a8-4fda-adfb-6fe4e0cd13d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51a4bb204bd4d2893324932c2bcc85f, user_id=971d7c560ded4ebcb671386041f234a3, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:36.562598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b47c4-18a8-4fda-adfb-6fe4e0cd13d2 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:36.634419 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1051/2098] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:36.648792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac230f3-37fb-4ca6-bea4-fc5545ccd959 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:36.651645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0ac230f3-37fb-4ca6-bea4-fc5545ccd959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:36.701976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1048/2099] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:36 2022] PUT /identity/v3/projects/b51a4bb204bd4d2893324932c2bcc85f/users/971d7c560ded4ebcb671386041f234a3/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:36.714706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4e040-1366-48de-abd4-f61947ed3d83 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:36.715039 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4e040-1366-48de-abd4-f61947ed3d83 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:36.716889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4e040-1366-48de-abd4-f61947ed3d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:36.759080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac230f3-37fb-4ca6-bea4-fc5545ccd959 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:36.777086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-96c4e040-1366-48de-abd4-f61947ed3d83 None None] MFA Rules not processed for user `971d7c560ded4ebcb671386041f234a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:36.779070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-96c4e040-1366-48de-abd4-f61947ed3d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:36.852244 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650da801-d1b8-4ce0-b909-3644f311969e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:36.854452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650da801-d1b8-4ce0-b909-3644f311969e service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:36.858439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650da801-d1b8-4ce0-b909-3644f311969e service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:36.859083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650da801-d1b8-4ce0-b909-3644f311969e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:36.985564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1049/2100] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:37.006693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650da801-d1b8-4ce0-b909-3644f311969e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:37.008318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650da801-d1b8-4ce0-b909-3644f311969e service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:37.019472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1052/2101] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:37.100094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4e040-1366-48de-abd4-f61947ed3d83 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:37.101520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650da801-d1b8-4ce0-b909-3644f311969e service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:37.103795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-650da801-d1b8-4ce0-b909-3644f311969e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:37.104901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-96c4e040-1366-48de-abd4-f61947ed3d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:37.131475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4e040-1366-48de-abd4-f61947ed3d83 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:37.143519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afeeb62-cd86-418a-b5a2-7d8b14f58109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:37.144781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afeeb62-cd86-418a-b5a2-7d8b14f58109 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:37.146137 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afeeb62-cd86-418a-b5a2-7d8b14f58109 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:37.155371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afeeb62-cd86-418a-b5a2-7d8b14f58109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:37.167946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afeeb62-cd86-418a-b5a2-7d8b14f58109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:37.170573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afeeb62-cd86-418a-b5a2-7d8b14f58109 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:37.186707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1050/2102] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:37.238514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:37.275538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650da801-d1b8-4ce0-b909-3644f311969e service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:37.284604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:37.285428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:37.286034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:37.286445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] PATH_INFO: `/v3/projects/3b0c43acc2234b04985d1e9e04db8879` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:37.288031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0c43acc2234b04985d1e9e04db8879)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:37.291435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:37.492140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0c43acc2234b04985d1e9e04db8879', 'request_id': 'req-e08c208d-9de1-41df-84e3-d4e122e95518'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:37.564224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:37.598954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0c43acc2234b04985d1e9e04db8879', 'request_id': 'req-e08c208d-9de1-41df-84e3-d4e122e95518'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:37.613073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0c43acc2234b04985d1e9e04db8879', 'request_id': 'req-e08c208d-9de1-41df-84e3-d4e122e95518'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:37.635361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] The token cache is being invalidate because project 3b0c43acc2234b04985d1e9e04db8879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:37.637938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:37.648188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:37.655775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1053/2103] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:37 2022] DELETE /identity/v3/projects/3b0c43acc2234b04985d1e9e04db8879 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:37.663645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afeeb62-cd86-418a-b5a2-7d8b14f58109 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:37.688783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afeeb62-cd86-418a-b5a2-7d8b14f58109 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:37.761476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:37.762950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:37.763516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:37.764330 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] PATH_INFO: `/v3/users/0cedc72f7a7349f58adb751497ef64ae` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:37.766975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cedc72f7a7349f58adb751497ef64ae)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:37.770465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:38.062959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cedc72f7a7349f58adb751497ef64ae'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:38.178341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cedc72f7a7349f58adb751497ef64ae'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:38.193522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cedc72f7a7349f58adb751497ef64ae'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:38.202149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cedc72f7a7349f58adb751497ef64ae'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:38.202939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cedc72f7a7349f58adb751497ef64ae'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:38.209083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1051/2104] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:37 2022] DELETE /identity/v3/users/0cedc72f7a7349f58adb751497ef64ae => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:38.511164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:38.512714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:38.526885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c208d-9de1-41df-84e3-d4e122e95518 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:38.609072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b34f65-38df-4baa-a54f-b2592d2db0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:38.610049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34f65-38df-4baa-a54f-b2592d2db0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:38.610495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34f65-38df-4baa-a54f-b2592d2db0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:38.610925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b34f65-38df-4baa-a54f-b2592d2db0ff admin admin] PATH_INFO: `/v3/users/682838c60086457caaad4f24cd0b9124` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:38.612674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b34f65-38df-4baa-a54f-b2592d2db0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=682838c60086457caaad4f24cd0b9124)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:38.615246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b34f65-38df-4baa-a54f-b2592d2db0ff admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:38.670089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:38.780825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:38.783435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:38.799634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3199e1-8f09-4e4a-b3fe-a074fcb436c8 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:38.805717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:38.806368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:38.806650 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:38.806924 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] PATH_INFO: `/v3/projects/60ccfe28d0f949859269c51d2fbb7cee` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:38.810825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ccfe28d0f949859269c51d2fbb7cee)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:38.816063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:38.937903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c1b34f65-38df-4baa-a54f-b2592d2db0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682838c60086457caaad4f24cd0b9124'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:38.964882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ccfe28d0f949859269c51d2fbb7cee', 'request_id': 'req-306f71fc-bef0-4568-b239-e95651174d73'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:38.965519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c1b34f65-38df-4baa-a54f-b2592d2db0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682838c60086457caaad4f24cd0b9124'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:38.965689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ccfe28d0f949859269c51d2fbb7cee', 'request_id': 'req-306f71fc-bef0-4568-b239-e95651174d73'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:38.970198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c1b34f65-38df-4baa-a54f-b2592d2db0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682838c60086457caaad4f24cd0b9124'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:38.977024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ccfe28d0f949859269c51d2fbb7cee', 'request_id': 'req-306f71fc-bef0-4568-b239-e95651174d73'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:39.098510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c1b34f65-38df-4baa-a54f-b2592d2db0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682838c60086457caaad4f24cd0b9124'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:39.099353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c1b34f65-38df-4baa-a54f-b2592d2db0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682838c60086457caaad4f24cd0b9124'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:39.108593 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1054/2105] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:38 2022] DELETE /identity/v3/users/682838c60086457caaad4f24cd0b9124 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:39.114806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd709f4-f702-43f8-b65a-09f672526abe None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:39.115184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd709f4-f702-43f8-b65a-09f672526abe None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:39.116210 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd709f4-f702-43f8-b65a-09f672526abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:39.139101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-1dd709f4-f702-43f8-b65a-09f672526abe None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:39.149185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1dd709f4-f702-43f8-b65a-09f672526abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:39.175952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] The token cache is being invalidate because project 60ccfe28d0f949859269c51d2fbb7cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:39.176772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:39.177564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-306f71fc-bef0-4568-b239-e95651174d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:39.183477 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1052/2106] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:38 2022] DELETE /identity/v3/projects/60ccfe28d0f949859269c51d2fbb7cee => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:39.185206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed85b6-0ef8-40ca-8261-1d8612c22d3c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:39.185615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed85b6-0ef8-40ca-8261-1d8612c22d3c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:39.185999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed85b6-0ef8-40ca-8261-1d8612c22d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:39.233291 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-83ed85b6-0ef8-40ca-8261-1d8612c22d3c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:39.235659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-83ed85b6-0ef8-40ca-8261-1d8612c22d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:39.244704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:39.248129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1055/2107] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:39.257348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1053/2108] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:39.271975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82586a-e26d-43ef-af95-2df7e825f211 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:39.272301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82586a-e26d-43ef-af95-2df7e825f211 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:39.272535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82586a-e26d-43ef-af95-2df7e825f211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:39.277110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed85b6-0ef8-40ca-8261-1d8612c22d3c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:39.282159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-83ed85b6-0ef8-40ca-8261-1d8612c22d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:39.313508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-5e82586a-e26d-43ef-af95-2df7e825f211 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:39.314832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5e82586a-e26d-43ef-af95-2df7e825f211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:39.325357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1056/2109] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:39.330710 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82586a-e26d-43ef-af95-2df7e825f211 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:39.359216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82586a-e26d-43ef-af95-2df7e825f211 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:39.378150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a0afb-3f62-4dc7-857c-cee2a8d67561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:39.378830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a0afb-3f62-4dc7-857c-cee2a8d67561 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:39.379123 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a0afb-3f62-4dc7-857c-cee2a8d67561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:39.379384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a0afb-3f62-4dc7-857c-cee2a8d67561 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:39.380062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a0afb-3f62-4dc7-857c-cee2a8d67561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:39.382750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a0afb-3f62-4dc7-857c-cee2a8d67561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:39.383500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a0afb-3f62-4dc7-857c-cee2a8d67561 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:39.397884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed85b6-0ef8-40ca-8261-1d8612c22d3c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:39.405264 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82b836-b9cf-4c8b-a596-21e06debc5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:39.405933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b836-b9cf-4c8b-a596-21e06debc5ba service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:39.406223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b836-b9cf-4c8b-a596-21e06debc5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:39.406482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b836-b9cf-4c8b-a596-21e06debc5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:39.417422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1057/2110] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:39.418728 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a0afb-3f62-4dc7-857c-cee2a8d67561 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:39.418845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82b836-b9cf-4c8b-a596-21e06debc5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:39.420416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82b836-b9cf-4c8b-a596-21e06debc5ba service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:39.432759 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1054/2111] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:39.435800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a0afb-3f62-4dc7-857c-cee2a8d67561 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:39.446388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0fa96-7aef-4030-adc3-802080a35f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:39.453659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0fa96-7aef-4030-adc3-802080a35f46 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:39.453659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0fa96-7aef-4030-adc3-802080a35f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:39.453659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0fa96-7aef-4030-adc3-802080a35f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:39.453659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0fa96-7aef-4030-adc3-802080a35f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:39.453659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0fa96-7aef-4030-adc3-802080a35f46 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:39.676230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1058/2112] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:39 2022] POST /identity/v3/projects => generated 409 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:39.681280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82b836-b9cf-4c8b-a596-21e06debc5ba service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:39.694264 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82b836-b9cf-4c8b-a596-21e06debc5ba service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:39.808440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0c131-0a98-4666-a3aa-0f63af415030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:39.809828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c131-0a98-4666-a3aa-0f63af415030 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:39.809912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c131-0a98-4666-a3aa-0f63af415030 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:39.810183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0c131-0a98-4666-a3aa-0f63af415030 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:39.810948 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0c131-0a98-4666-a3aa-0f63af415030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:39.813430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0c131-0a98-4666-a3aa-0f63af415030 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:39.948702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4a0ea-8320-434b-9d25-99aa049fe49a None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:39.950451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4a0ea-8320-434b-9d25-99aa049fe49a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:39.951037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4a0ea-8320-434b-9d25-99aa049fe49a None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:39.953779 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1059/2113] 10.222.0.74 () {54 vars in 921 bytes} [Wed Aug 31 00:37:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 00:37:39.967073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1055/2114] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:39 2022] POST /identity/v3/users => generated 305 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:37:39.971844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4a0ea-8320-434b-9d25-99aa049fe49a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:39.984172 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bf6f3-c33b-40a5-b263-597adeb9a209 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:39.985165 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bf6f3-c33b-40a5-b263-597adeb9a209 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:39.987190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bf6f3-c33b-40a5-b263-597adeb9a209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:40.009098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4a0ea-8320-434b-9d25-99aa049fe49a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:40.016078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc7505-1979-4710-91bd-a64ce613b371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:40.016898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc7505-1979-4710-91bd-a64ce613b371 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:40.017402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc7505-1979-4710-91bd-a64ce613b371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:40.017924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc7505-1979-4710-91bd-a64ce613b371 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:40.018794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc7505-1979-4710-91bd-a64ce613b371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:40.021739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc7505-1979-4710-91bd-a64ce613b371 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:40.025306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-3b0bf6f3-c33b-40a5-b263-597adeb9a209 None None] MFA Rules not processed for user `5f8c004b9fe2402fbe94cfd7c2bf949e`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:40.029923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-3b0bf6f3-c33b-40a5-b263-597adeb9a209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:40.039107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1060/2115] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:40.043605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc7505-1979-4710-91bd-a64ce613b371 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:40.072153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc7505-1979-4710-91bd-a64ce613b371 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:40.089173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253619e9-8c32-4af2-a7e4-3fee77f8f43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:40.089915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253619e9-8c32-4af2-a7e4-3fee77f8f43a admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:40.090461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253619e9-8c32-4af2-a7e4-3fee77f8f43a admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:40.090888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253619e9-8c32-4af2-a7e4-3fee77f8f43a admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:40.091944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253619e9-8c32-4af2-a7e4-3fee77f8f43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:40.094037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253619e9-8c32-4af2-a7e4-3fee77f8f43a admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:40.107302 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1061/2116] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:40.108014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253619e9-8c32-4af2-a7e4-3fee77f8f43a admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:40.110110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-253619e9-8c32-4af2-a7e4-3fee77f8f43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:40.151315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253619e9-8c32-4af2-a7e4-3fee77f8f43a admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:40.151614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1056/2117] 10.222.0.74 () {58 vars in 1018 bytes} [Wed Aug 31 00:37:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:40.153737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:40.155081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:40.155465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:40.155813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] PATH_INFO: `/v3/projects/4c83c79c011b4c3f8b09ff9e43ec1b51` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:40.156018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bf6f3-c33b-40a5-b263-597adeb9a209 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:40.157418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c83c79c011b4c3f8b09ff9e43ec1b51)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:40.159407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:40.174769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bf6f3-c33b-40a5-b263-597adeb9a209 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:40.202033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f1d9f-d793-452d-96a3-3f061781da78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:40.203954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f1d9f-d793-452d-96a3-3f061781da78 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:40.206835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f1d9f-d793-452d-96a3-3f061781da78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:40.206835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f1d9f-d793-452d-96a3-3f061781da78 admin admin] PATH_INFO: `/v3/projects/13ef2e0cd4214b87a80a6be408e72368/users/7fee97ae9cca49ba8bd1c7faad702927/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:40.224244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f1d9f-d793-452d-96a3-3f061781da78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ef2e0cd4214b87a80a6be408e72368, user_id=7fee97ae9cca49ba8bd1c7faad702927, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:40.227075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f1d9f-d793-452d-96a3-3f061781da78 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:40.358921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1057/2118] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:40 2022] PUT /identity/v3/projects/13ef2e0cd4214b87a80a6be408e72368/users/7fee97ae9cca49ba8bd1c7faad702927/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:40.359870 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f1d9f-d793-452d-96a3-3f061781da78 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:40.361961 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b05f1d9f-d793-452d-96a3-3f061781da78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:40.377861 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c83c79c011b4c3f8b09ff9e43ec1b51', 'request_id': 'req-adf12527-6716-4b58-8c13-0bad20380fce'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:40.389817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:40.441040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f1d9f-d793-452d-96a3-3f061781da78 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:40.449023 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c83c79c011b4c3f8b09ff9e43ec1b51', 'request_id': 'req-adf12527-6716-4b58-8c13-0bad20380fce'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:40.456407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c83c79c011b4c3f8b09ff9e43ec1b51', 'request_id': 'req-adf12527-6716-4b58-8c13-0bad20380fce'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:40.470521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] The token cache is being invalidate because project 4c83c79c011b4c3f8b09ff9e43ec1b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:40.470812 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:40.471493 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:40.473343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1062/2119] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:40 2022] DELETE /identity/v3/projects/4c83c79c011b4c3f8b09ff9e43ec1b51 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:40.474220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:40.475561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:40.521994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d3453-adec-4263-974b-76daa39a71a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:40.522620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3453-adec-4263-974b-76daa39a71a8 service placement] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:40.522905 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3453-adec-4263-974b-76daa39a71a8 service placement] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:40.523628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3453-adec-4263-974b-76daa39a71a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:40.526258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-452d3453-adec-4263-974b-76daa39a71a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:40.547454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d3453-adec-4263-974b-76daa39a71a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:40.549525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d3453-adec-4263-974b-76daa39a71a8 service placement] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:40.549742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12527-6716-4b58-8c13-0bad20380fce admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:40.558770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:40.559727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:40.560079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:40.560475 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] PATH_INFO: `/v3/users/8911babcd58647fdb6c861cc4e42b020` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:40.561834 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8911babcd58647fdb6c861cc4e42b020)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:40.563933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:40.565134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1058/2120] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:40.567037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d849dfc-4632-40dd-a8b7-17903dab50cb None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:40.572507 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d849dfc-4632-40dd-a8b7-17903dab50cb None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:40.572507 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d849dfc-4632-40dd-a8b7-17903dab50cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:40.608543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-6d849dfc-4632-40dd-a8b7-17903dab50cb None None] MFA Rules not processed for user `7fee97ae9cca49ba8bd1c7faad702927`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:40.609986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6d849dfc-4632-40dd-a8b7-17903dab50cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:40.707060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1059/2121] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:40 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:40.707060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d849dfc-4632-40dd-a8b7-17903dab50cb None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:40.711485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6d849dfc-4632-40dd-a8b7-17903dab50cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:40.732543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d849dfc-4632-40dd-a8b7-17903dab50cb None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:40.740193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:40.741168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:40.741665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:40.742128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] PATH_INFO: `/v3/users/1a270382462f4007ad74f4f0aa0907a3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:40.743944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a270382462f4007ad74f4f0aa0907a3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:40.748218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:40.768738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8911babcd58647fdb6c861cc4e42b020'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:40.784294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8911babcd58647fdb6c861cc4e42b020'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:40.791532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8911babcd58647fdb6c861cc4e42b020'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:40.961341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8911babcd58647fdb6c861cc4e42b020'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:40.961341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8911babcd58647fdb6c861cc4e42b020'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:40.961341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1063/2122] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:40 2022] DELETE /identity/v3/users/8911babcd58647fdb6c861cc4e42b020 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:40.961341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:40.961341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:41.042084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7b511-741c-48e5-9684-5caaea7696ad admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:41.048483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bcd7c-a30a-4c2f-abd9-6f104ab6703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:41.049279 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bcd7c-a30a-4c2f-abd9-6f104ab6703c admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:41.049664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bcd7c-a30a-4c2f-abd9-6f104ab6703c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:41.050005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bcd7c-a30a-4c2f-abd9-6f104ab6703c admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:41.050735 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bcd7c-a30a-4c2f-abd9-6f104ab6703c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:41.052905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bcd7c-a30a-4c2f-abd9-6f104ab6703c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:41.178201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:41.194491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a270382462f4007ad74f4f0aa0907a3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:41.225312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1064/2123] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:40 2022] POST /identity/v3/projects => generated 409 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:41.229392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bcd7c-a30a-4c2f-abd9-6f104ab6703c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:41.323240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bcd7c-a30a-4c2f-abd9-6f104ab6703c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:41.326637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a270382462f4007ad74f4f0aa0907a3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:41.344289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2f597-7c0c-4aad-91f6-6e1a1c99ab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:41.345451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2f597-7c0c-4aad-91f6-6e1a1c99ab97 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:41.346003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2f597-7c0c-4aad-91f6-6e1a1c99ab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:41.346761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a270382462f4007ad74f4f0aa0907a3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:41.347801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2f597-7c0c-4aad-91f6-6e1a1c99ab97 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:41.349298 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2f597-7c0c-4aad-91f6-6e1a1c99ab97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:41.353482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2f597-7c0c-4aad-91f6-6e1a1c99ab97 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:41.362436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a270382462f4007ad74f4f0aa0907a3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:41.366500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a270382462f4007ad74f4f0aa0907a3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:41.376616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1060/2124] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:40 2022] DELETE /identity/v3/users/1a270382462f4007ad74f4f0aa0907a3 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:41.377555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:41.379485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:41.454073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1065/2125] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:41 2022] POST /identity/v3/users => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:37:41.459293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2f597-7c0c-4aad-91f6-6e1a1c99ab97 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:41.463369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-34f2f597-7c0c-4aad-91f6-6e1a1c99ab97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:41.493775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2f597-7c0c-4aad-91f6-6e1a1c99ab97 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:41.500010 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b7202-8677-49ec-b93b-dcebb33568fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:41.500543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b020e7e-0b26-446e-b9ff-55690d1d3729 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:41.500687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b7202-8677-49ec-b93b-dcebb33568fd admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:41.500974 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b7202-8677-49ec-b93b-dcebb33568fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:41.501296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b7202-8677-49ec-b93b-dcebb33568fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:41.502011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b7202-8677-49ec-b93b-dcebb33568fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:41.503619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b7202-8677-49ec-b93b-dcebb33568fd admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:41.506637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:41.507359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:41.507708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:41.508050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] PATH_INFO: `/v3/projects/1c5beb77685e4581a68367dbb599b385` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:41.509277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5beb77685e4581a68367dbb599b385)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:41.511422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:41.520436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1066/2126] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:41.521561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b7202-8677-49ec-b93b-dcebb33568fd admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:41.551711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b7202-8677-49ec-b93b-dcebb33568fd admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:41.557326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:41.559366 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9525d-dbd3-4d31-9a65-6b197ce4e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:41.560289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9525d-dbd3-4d31-9a65-6b197ce4e884 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:41.560570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9525d-dbd3-4d31-9a65-6b197ce4e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:41.560842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9525d-dbd3-4d31-9a65-6b197ce4e884 admin admin] PATH_INFO: `/v3/projects/fe5677224eec4756ae4dcd2065d3f8cb/users/d4c8af9c51ec4ca388e9763c0b61dce1/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:41.579180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9525d-dbd3-4d31-9a65-6b197ce4e884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5677224eec4756ae4dcd2065d3f8cb, user_id=d4c8af9c51ec4ca388e9763c0b61dce1, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:41.583214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9525d-dbd3-4d31-9a65-6b197ce4e884 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:41.714875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1067/2127] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:41 2022] PUT /identity/v3/projects/fe5677224eec4756ae4dcd2065d3f8cb/users/d4c8af9c51ec4ca388e9763c0b61dce1/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:41.719404 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9525d-dbd3-4d31-9a65-6b197ce4e884 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:41.736230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5beb77685e4581a68367dbb599b385', 'request_id': 'req-def604b8-f93b-4d39-9a63-1a6a4d521006'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:41.751313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5beb77685e4581a68367dbb599b385', 'request_id': 'req-def604b8-f93b-4d39-9a63-1a6a4d521006'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:41.767643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5beb77685e4581a68367dbb599b385', 'request_id': 'req-def604b8-f93b-4d39-9a63-1a6a4d521006'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:41.827381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9525d-dbd3-4d31-9a65-6b197ce4e884 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:41.918839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] The token cache is being invalidate because project 1c5beb77685e4581a68367dbb599b385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:41.919400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:41.920741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-def604b8-f93b-4d39-9a63-1a6a4d521006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:41.922432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b031cf-3ef0-45a6-8a20-bfe4cbcedffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:41.923068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b031cf-3ef0-45a6-8a20-bfe4cbcedffc admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:41.923416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b031cf-3ef0-45a6-8a20-bfe4cbcedffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:41.923825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b031cf-3ef0-45a6-8a20-bfe4cbcedffc admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:41.926156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b031cf-3ef0-45a6-8a20-bfe4cbcedffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:41.926902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1061/2128] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:41 2022] DELETE /identity/v3/projects/1c5beb77685e4581a68367dbb599b385 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:41.928005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b031cf-3ef0-45a6-8a20-bfe4cbcedffc admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:41.928833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62522-3e7f-4325-9c4b-70a5abdf217f None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:41.929434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62522-3e7f-4325-9c4b-70a5abdf217f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:41.929737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62522-3e7f-4325-9c4b-70a5abdf217f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:41.941178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1068/2129] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:41.945402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b031cf-3ef0-45a6-8a20-bfe4cbcedffc admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:41.947322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-29b031cf-3ef0-45a6-8a20-bfe4cbcedffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:41.957846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-e2f62522-3e7f-4325-9c4b-70a5abdf217f None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:41.959083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e2f62522-3e7f-4325-9c4b-70a5abdf217f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:41.962009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b031cf-3ef0-45a6-8a20-bfe4cbcedffc admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:41.968104 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304624fb-4816-49d7-80dd-db8d6eaf9353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:41.968781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304624fb-4816-49d7-80dd-db8d6eaf9353 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:41.969066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304624fb-4816-49d7-80dd-db8d6eaf9353 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:41.969349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304624fb-4816-49d7-80dd-db8d6eaf9353 admin admin] PATH_INFO: `/v3/projects/fe5677224eec4756ae4dcd2065d3f8cb/users/d4c8af9c51ec4ca388e9763c0b61dce1/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:41.971228 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1062/2130] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:41.971341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304624fb-4816-49d7-80dd-db8d6eaf9353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5677224eec4756ae4dcd2065d3f8cb, user_id=d4c8af9c51ec4ca388e9763c0b61dce1, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:41.974335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304624fb-4816-49d7-80dd-db8d6eaf9353 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:41.979194 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196c160-ea4c-414e-98de-82a5b03e504a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:41.979608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196c160-ea4c-414e-98de-82a5b03e504a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:41.980119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196c160-ea4c-414e-98de-82a5b03e504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:41.986600 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1069/2131] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:41 2022] PUT /identity/v3/projects/fe5677224eec4756ae4dcd2065d3f8cb/users/d4c8af9c51ec4ca388e9763c0b61dce1/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:41.998409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cba904-b1be-4b7c-b79f-15cf1aeba8e4 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.003038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cba904-b1be-4b7c-b79f-15cf1aeba8e4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.003038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cba904-b1be-4b7c-b79f-15cf1aeba8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.003681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-c196c160-ea4c-414e-98de-82a5b03e504a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:42.003681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c196c160-ea4c-414e-98de-82a5b03e504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:42.030237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-42cba904-b1be-4b7c-b79f-15cf1aeba8e4 None None] MFA Rules not processed for user `d4c8af9c51ec4ca388e9763c0b61dce1`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:42.031572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-42cba904-b1be-4b7c-b79f-15cf1aeba8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:42.086458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1063/2132] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:42.086458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196c160-ea4c-414e-98de-82a5b03e504a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:42.088268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c196c160-ea4c-414e-98de-82a5b03e504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:42.108921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196c160-ea4c-414e-98de-82a5b03e504a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:42.129318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:42.129318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.129318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.129318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] PATH_INFO: `/v3/projects/1d1175e4dd794bfc981a5fd3ef2d1669` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.130183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1175e4dd794bfc981a5fd3ef2d1669)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:42.130964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:42.139015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1070/2133] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:41 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:42.139938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cba904-b1be-4b7c-b79f-15cf1aeba8e4 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:42.154186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cba904-b1be-4b7c-b79f-15cf1aeba8e4 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:42.166771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee441-4cf5-4ffd-a0f2-50af9fb65739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:42.168164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee441-4cf5-4ffd-a0f2-50af9fb65739 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.168885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee441-4cf5-4ffd-a0f2-50af9fb65739 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.169406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee441-4cf5-4ffd-a0f2-50af9fb65739 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.170369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee441-4cf5-4ffd-a0f2-50af9fb65739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:42.170738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee441-4cf5-4ffd-a0f2-50af9fb65739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:42.172968 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee441-4cf5-4ffd-a0f2-50af9fb65739 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:42.188598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1071/2134] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:42.189623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee441-4cf5-4ffd-a0f2-50af9fb65739 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:42.191437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-432ee441-4cf5-4ffd-a0f2-50af9fb65739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:42.254975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee441-4cf5-4ffd-a0f2-50af9fb65739 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:42.258916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b9b94-24f7-4b9f-bf80-1664b6a9a1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:42.259562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9b94-24f7-4b9f-bf80-1664b6a9a1fe service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.259806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9b94-24f7-4b9f-bf80-1664b6a9a1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.260160 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9b94-24f7-4b9f-bf80-1664b6a9a1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.270836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b9b94-24f7-4b9f-bf80-1664b6a9a1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:42.272308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b9b94-24f7-4b9f-bf80-1664b6a9a1fe service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:42.283802 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1072/2135] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:42 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:42.284453 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b9b94-24f7-4b9f-bf80-1664b6a9a1fe service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:42.286432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1175e4dd794bfc981a5fd3ef2d1669', 'request_id': 'req-2980fdee-40d8-44a8-ae05-9e6067446fd0'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:42.300360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1175e4dd794bfc981a5fd3ef2d1669', 'request_id': 'req-2980fdee-40d8-44a8-ae05-9e6067446fd0'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:42.303107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b9b94-24f7-4b9f-bf80-1664b6a9a1fe service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:42.314220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1175e4dd794bfc981a5fd3ef2d1669', 'request_id': 'req-2980fdee-40d8-44a8-ae05-9e6067446fd0'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:42.384763 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca078535-d611-4c38-8d59-42b53dcf9417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:42.385325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca078535-d611-4c38-8d59-42b53dcf9417 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.385652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca078535-d611-4c38-8d59-42b53dcf9417 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.385938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca078535-d611-4c38-8d59-42b53dcf9417 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.386662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca078535-d611-4c38-8d59-42b53dcf9417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:42.389913 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca078535-d611-4c38-8d59-42b53dcf9417 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:42.439013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] The token cache is being invalidate because project 1d1175e4dd794bfc981a5fd3ef2d1669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:42.439309 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:42.440100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2980fdee-40d8-44a8-ae05-9e6067446fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:42.442276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1064/2136] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:42 2022] DELETE /identity/v3/projects/1d1175e4dd794bfc981a5fd3ef2d1669 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:42.447802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e73bf9-181e-49de-9898-a8348d1c045d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.448088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e73bf9-181e-49de-9898-a8348d1c045d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.448373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e73bf9-181e-49de-9898-a8348d1c045d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.471384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-83e73bf9-181e-49de-9898-a8348d1c045d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:42.472659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-83e73bf9-181e-49de-9898-a8348d1c045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:42.483399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1065/2137] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:42.491852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383e1f1-0979-489b-b4b9-673957b5892d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.492142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383e1f1-0979-489b-b4b9-673957b5892d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.492612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383e1f1-0979-489b-b4b9-673957b5892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.515903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-1383e1f1-0979-489b-b4b9-673957b5892d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:42.517173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1383e1f1-0979-489b-b4b9-673957b5892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:42.525479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1066/2138] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:42.530367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383e1f1-0979-489b-b4b9-673957b5892d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:42.540994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383e1f1-0979-489b-b4b9-673957b5892d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:42.549250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1073/2139] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:42 2022] POST /identity/v3/projects => generated 377 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:42.550760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca078535-d611-4c38-8d59-42b53dcf9417 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:42.551412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009cbb-95c9-4bd7-9146-0f70dde9aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:42.552427 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009cbb-95c9-4bd7-9146-0f70dde9aa90 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.552756 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009cbb-95c9-4bd7-9146-0f70dde9aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.552865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ca078535-d611-4c38-8d59-42b53dcf9417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:42.553116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14009cbb-95c9-4bd7-9146-0f70dde9aa90 admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.553904 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14009cbb-95c9-4bd7-9146-0f70dde9aa90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:42.554276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14009cbb-95c9-4bd7-9146-0f70dde9aa90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:42.556066 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14009cbb-95c9-4bd7-9146-0f70dde9aa90 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:42.572617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1067/2140] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:37:42.574005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009cbb-95c9-4bd7-9146-0f70dde9aa90 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:42.586094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14009cbb-95c9-4bd7-9146-0f70dde9aa90 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:42.626078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca078535-d611-4c38-8d59-42b53dcf9417 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:42.630991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02cc32-48ab-49b0-9bd2-3a6eab2e9be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:42.631603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02cc32-48ab-49b0-9bd2-3a6eab2e9be8 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.631886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02cc32-48ab-49b0-9bd2-3a6eab2e9be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.632161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02cc32-48ab-49b0-9bd2-3a6eab2e9be8 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.632793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02cc32-48ab-49b0-9bd2-3a6eab2e9be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:42.634795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02cc32-48ab-49b0-9bd2-3a6eab2e9be8 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:42.647598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906a496-d61b-4ef7-945b-324c5e7a26c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:42.648202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a496-d61b-4ef7-945b-324c5e7a26c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.648480 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a496-d61b-4ef7-945b-324c5e7a26c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.648754 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906a496-d61b-4ef7-945b-324c5e7a26c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.649388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906a496-d61b-4ef7-945b-324c5e7a26c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:42.651372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906a496-d61b-4ef7-945b-324c5e7a26c0 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:42.721914 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1074/2141] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:42 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:42.726374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02cc32-48ab-49b0-9bd2-3a6eab2e9be8 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:42.736950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02cc32-48ab-49b0-9bd2-3a6eab2e9be8 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:42.754692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02153c0c-5d18-4bee-8fc0-1c953fa63727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:42.755796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02153c0c-5d18-4bee-8fc0-1c953fa63727 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.757609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02153c0c-5d18-4bee-8fc0-1c953fa63727 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.758799 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02153c0c-5d18-4bee-8fc0-1c953fa63727 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.760083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02153c0c-5d18-4bee-8fc0-1c953fa63727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:42.761553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02153c0c-5d18-4bee-8fc0-1c953fa63727 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:42.767905 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1068/2142] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:42 2022] POST /identity/v3/projects => generated 361 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:42.772647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906a496-d61b-4ef7-945b-324c5e7a26c0 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:42.785804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1075/2143] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:37:42.787554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02153c0c-5d18-4bee-8fc0-1c953fa63727 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:42.804311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02153c0c-5d18-4bee-8fc0-1c953fa63727 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:42.862864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906a496-d61b-4ef7-945b-324c5e7a26c0 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:42.867899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775899e-52f8-4839-8e61-77b5e67ff794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:42.868505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775899e-52f8-4839-8e61-77b5e67ff794 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.868788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775899e-52f8-4839-8e61-77b5e67ff794 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.869081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775899e-52f8-4839-8e61-77b5e67ff794 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.869750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775899e-52f8-4839-8e61-77b5e67ff794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:42.872486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775899e-52f8-4839-8e61-77b5e67ff794 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:42.889903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f13515-7342-4bea-8020-c9b07d41959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:42.890521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f13515-7342-4bea-8020-c9b07d41959b admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.890803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f13515-7342-4bea-8020-c9b07d41959b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.891106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f13515-7342-4bea-8020-c9b07d41959b admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.903362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f13515-7342-4bea-8020-c9b07d41959b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:42.903362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f13515-7342-4bea-8020-c9b07d41959b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:42.905544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1076/2144] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:42.906478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f13515-7342-4bea-8020-c9b07d41959b admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:42.908183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-00f13515-7342-4bea-8020-c9b07d41959b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:42.967168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f13515-7342-4bea-8020-c9b07d41959b admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:42.970868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac9a6f-b19c-48c3-b155-163abf6a6db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:42.971476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9a6f-b19c-48c3-b155-163abf6a6db1 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:42.971760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9a6f-b19c-48c3-b155-163abf6a6db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:42.972035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9a6f-b19c-48c3-b155-163abf6a6db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:42.973818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-07ac9a6f-b19c-48c3-b155-163abf6a6db1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:43.037314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac9a6f-b19c-48c3-b155-163abf6a6db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:43.038812 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac9a6f-b19c-48c3-b155-163abf6a6db1 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:43.048622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1077/2145] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:42 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:43.049414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac9a6f-b19c-48c3-b155-163abf6a6db1 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:43.060380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac9a6f-b19c-48c3-b155-163abf6a6db1 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:43.066003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e9248-8cec-4185-9c23-7e8e432f3d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:43.066668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9248-8cec-4185-9c23-7e8e432f3d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:43.066951 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9248-8cec-4185-9c23-7e8e432f3d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:43.067226 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e9248-8cec-4185-9c23-7e8e432f3d3f admin admin] PATH_INFO: `/v3/projects/f454504491ce483d91ae9309c5f112ce/users/27bdf2e33c1948139879b511aaffa372/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:43.083868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1069/2146] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:42 2022] POST /identity/v3/users => generated 281 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:43.084474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e9248-8cec-4185-9c23-7e8e432f3d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f454504491ce483d91ae9309c5f112ce, user_id=27bdf2e33c1948139879b511aaffa372, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:43.087667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e9248-8cec-4185-9c23-7e8e432f3d3f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:43.088371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775899e-52f8-4839-8e61-77b5e67ff794 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:43.112364 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775899e-52f8-4839-8e61-77b5e67ff794 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:43.119206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a06f50-704b-46aa-a2d8-b3b8da50fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:43.120019 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a06f50-704b-46aa-a2d8-b3b8da50fedc admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:43.120303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a06f50-704b-46aa-a2d8-b3b8da50fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:43.120817 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a06f50-704b-46aa-a2d8-b3b8da50fedc admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:43.121733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a06f50-704b-46aa-a2d8-b3b8da50fedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:43.123323 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a06f50-704b-46aa-a2d8-b3b8da50fedc admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:43.134953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1070/2147] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:43.143331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a06f50-704b-46aa-a2d8-b3b8da50fedc admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:43.154648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a06f50-704b-46aa-a2d8-b3b8da50fedc admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:43.159869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:43.164719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fb152-f176-40c9-9f73-97cf939929cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:43.165399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fb152-f176-40c9-9f73-97cf939929cb admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:43.166000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fb152-f176-40c9-9f73-97cf939929cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:43.167126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fb152-f176-40c9-9f73-97cf939929cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:43.167250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fb152-f176-40c9-9f73-97cf939929cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:43.168929 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fb152-f176-40c9-9f73-97cf939929cb admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:43.179840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1071/2148] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:43.184041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fb152-f176-40c9-9f73-97cf939929cb admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:43.193782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1078/2149] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:43 2022] PUT /identity/v3/projects/f454504491ce483d91ae9309c5f112ce/users/27bdf2e33c1948139879b511aaffa372/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:43.195204 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fb152-f176-40c9-9f73-97cf939929cb admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:43.211114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13294-4a19-437a-81d2-0d921e7a842a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:43.211394 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13294-4a19-437a-81d2-0d921e7a842a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:43.211668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13294-4a19-437a-81d2-0d921e7a842a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:43.239506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-32e13294-4a19-437a-81d2-0d921e7a842a None None] MFA Rules not processed for user `27bdf2e33c1948139879b511aaffa372`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:43.240717 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-32e13294-4a19-437a-81d2-0d921e7a842a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:43.252078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6164a-cafc-4ef1-a989-f48964302d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:43.252736 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6164a-cafc-4ef1-a989-f48964302d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:43.253011 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6164a-cafc-4ef1-a989-f48964302d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:43.253285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6164a-cafc-4ef1-a989-f48964302d36 admin admin] PATH_INFO: `/v3/projects/1985b8d404fb4c4a9c2bf5494ffa808b/users/ec0499c8348440bb864dfd5861021a8e/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:43.270563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6164a-cafc-4ef1-a989-f48964302d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1985b8d404fb4c4a9c2bf5494ffa808b, user_id=ec0499c8348440bb864dfd5861021a8e, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:43.273248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6164a-cafc-4ef1-a989-f48964302d36 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:43.289374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:43.312273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1079/2150] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:43.316660 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13294-4a19-437a-81d2-0d921e7a842a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:43.328163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13294-4a19-437a-81d2-0d921e7a842a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:43.332738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240134a-fc26-4297-8264-6d3edad78b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:43.333329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240134a-fc26-4297-8264-6d3edad78b89 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:43.333632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240134a-fc26-4297-8264-6d3edad78b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:43.333906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240134a-fc26-4297-8264-6d3edad78b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:43.334529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240134a-fc26-4297-8264-6d3edad78b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:43.336476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240134a-fc26-4297-8264-6d3edad78b89 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:43.375915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1072/2151] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:43 2022] PUT /identity/v3/projects/1985b8d404fb4c4a9c2bf5494ffa808b/users/ec0499c8348440bb864dfd5861021a8e/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:43.388733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ca70d-e059-4b60-993f-602e605760cd None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:43.389416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ca70d-e059-4b60-993f-602e605760cd None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:43.389985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ca70d-e059-4b60-993f-602e605760cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:43.432979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-c54ca70d-e059-4b60-993f-602e605760cd None None] MFA Rules not processed for user `ec0499c8348440bb864dfd5861021a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:43.433967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1080/2152] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:43 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:37:43.435529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c54ca70d-e059-4b60-993f-602e605760cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:43.439198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240134a-fc26-4297-8264-6d3edad78b89 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:43.508431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240134a-fc26-4297-8264-6d3edad78b89 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:43.513429 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb558ce0-982d-4b02-a4d0-ca0681079519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:43.513727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1073/2153] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:43.514269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558ce0-982d-4b02-a4d0-ca0681079519 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:43.514554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558ce0-982d-4b02-a4d0-ca0681079519 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:43.514824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb558ce0-982d-4b02-a4d0-ca0681079519 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:43.515450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb558ce0-982d-4b02-a4d0-ca0681079519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:43.517474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb558ce0-982d-4b02-a4d0-ca0681079519 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:43.671650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1081/2154] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:43 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:43.679492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ca70d-e059-4b60-993f-602e605760cd None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:43.701493 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb558ce0-982d-4b02-a4d0-ca0681079519 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:43.709457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ca70d-e059-4b60-993f-602e605760cd None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:43.717076 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452df75-a09c-43a5-8665-3d897f8aebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:43.717818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452df75-a09c-43a5-8665-3d897f8aebe4 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:43.718102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452df75-a09c-43a5-8665-3d897f8aebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:43.718821 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3452df75-a09c-43a5-8665-3d897f8aebe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:43.719014 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452df75-a09c-43a5-8665-3d897f8aebe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:43.721083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3452df75-a09c-43a5-8665-3d897f8aebe4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:43.733348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1074/2155] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:43.737500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452df75-a09c-43a5-8665-3d897f8aebe4 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:43.748702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3452df75-a09c-43a5-8665-3d897f8aebe4 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:43.754671 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdf5bf-41e8-43fe-a4b3-055637b6f4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:43.755659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf5bf-41e8-43fe-a4b3-055637b6f4c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:43.756232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf5bf-41e8-43fe-a4b3-055637b6f4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:43.756664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdf5bf-41e8-43fe-a4b3-055637b6f4c7 admin admin] PATH_INFO: `/v3/projects/5bcea9e3873b4b85bb0978fd892f847a/users/814ba749810e42f1b7f2f4356c5a7983/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:43.779043 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdf5bf-41e8-43fe-a4b3-055637b6f4c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bcea9e3873b4b85bb0978fd892f847a, user_id=814ba749810e42f1b7f2f4356c5a7983, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:43.782536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdf5bf-41e8-43fe-a4b3-055637b6f4c7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:43.893291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb558ce0-982d-4b02-a4d0-ca0681079519 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:43.904963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f464cf6-5d00-4da5-abe3-3310c4e767af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:43.905690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f464cf6-5d00-4da5-abe3-3310c4e767af service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:43.905973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f464cf6-5d00-4da5-abe3-3310c4e767af service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:43.906276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f464cf6-5d00-4da5-abe3-3310c4e767af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:43.916642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f464cf6-5d00-4da5-abe3-3310c4e767af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:43.919919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f464cf6-5d00-4da5-abe3-3310c4e767af service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:43.932366 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1082/2156] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:43.948570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f464cf6-5d00-4da5-abe3-3310c4e767af service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:43.955886 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1075/2157] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:43 2022] PUT /identity/v3/projects/5bcea9e3873b4b85bb0978fd892f847a/users/814ba749810e42f1b7f2f4356c5a7983/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:43.962272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdf5bf-41e8-43fe-a4b3-055637b6f4c7 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:43.969031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f464cf6-5d00-4da5-abe3-3310c4e767af service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:44.039530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdf5bf-41e8-43fe-a4b3-055637b6f4c7 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:44.043795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:44.044483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:44.044774 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:44.045043 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] PATH_INFO: `/v3/users/ec0499c8348440bb864dfd5861021a8e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:44.045157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97301a9-a87a-4e0e-8529-0ee581f5bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:44.045761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97301a9-a87a-4e0e-8529-0ee581f5bea8 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:44.046040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97301a9-a87a-4e0e-8529-0ee581f5bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:44.046298 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0499c8348440bb864dfd5861021a8e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:44.046395 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97301a9-a87a-4e0e-8529-0ee581f5bea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:44.047316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97301a9-a87a-4e0e-8529-0ee581f5bea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:44.048259 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:44.048635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97301a9-a87a-4e0e-8529-0ee581f5bea8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:44.060197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1076/2158] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:44.064411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97301a9-a87a-4e0e-8529-0ee581f5bea8 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:44.077019 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97301a9-a87a-4e0e-8529-0ee581f5bea8 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:44.082783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc9e54-49f7-48c0-8d1a-c0ea0ff3d98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:44.083453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc9e54-49f7-48c0-8d1a-c0ea0ff3d98f admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:44.083730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc9e54-49f7-48c0-8d1a-c0ea0ff3d98f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:44.084009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc9e54-49f7-48c0-8d1a-c0ea0ff3d98f admin admin] PATH_INFO: `/v3/projects/5bcea9e3873b4b85bb0978fd892f847a/users/814ba749810e42f1b7f2f4356c5a7983/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:44.085985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc9e54-49f7-48c0-8d1a-c0ea0ff3d98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bcea9e3873b4b85bb0978fd892f847a, user_id=814ba749810e42f1b7f2f4356c5a7983, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:44.088660 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc9e54-49f7-48c0-8d1a-c0ea0ff3d98f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:44.104855 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1077/2159] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:44 2022] PUT /identity/v3/projects/5bcea9e3873b4b85bb0978fd892f847a/users/814ba749810e42f1b7f2f4356c5a7983/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:44.123350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839f1ba-aeb4-49c9-b14a-701d79b48d68 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:44.123653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839f1ba-aeb4-49c9-b14a-701d79b48d68 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:44.123970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839f1ba-aeb4-49c9-b14a-701d79b48d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:44.154456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2839f1ba-aeb4-49c9-b14a-701d79b48d68 None None] MFA Rules not processed for user `814ba749810e42f1b7f2f4356c5a7983`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:44.155384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2839f1ba-aeb4-49c9-b14a-701d79b48d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:44.231372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1078/2160] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:44.246949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839f1ba-aeb4-49c9-b14a-701d79b48d68 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:44.248473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2839f1ba-aeb4-49c9-b14a-701d79b48d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:44.307058 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839f1ba-aeb4-49c9-b14a-701d79b48d68 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:44.311337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a680a83-c302-4ae6-b9a2-6dd70667f227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:44.311949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a680a83-c302-4ae6-b9a2-6dd70667f227 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:44.312234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a680a83-c302-4ae6-b9a2-6dd70667f227 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:44.312509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a680a83-c302-4ae6-b9a2-6dd70667f227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:44.372396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a680a83-c302-4ae6-b9a2-6dd70667f227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:44.373925 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a680a83-c302-4ae6-b9a2-6dd70667f227 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:44.381063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0499c8348440bb864dfd5861021a8e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:44.383281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1079/2161] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:44.394216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0499c8348440bb864dfd5861021a8e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:44.401256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0499c8348440bb864dfd5861021a8e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:44.525969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0499c8348440bb864dfd5861021a8e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:44.526605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0499c8348440bb864dfd5861021a8e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:44.533911 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1083/2162] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:43 2022] DELETE /identity/v3/users/ec0499c8348440bb864dfd5861021a8e => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:44.538142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304969-c246-4a03-857f-f9dd29215b45 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:44.538436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304969-c246-4a03-857f-f9dd29215b45 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:44.538716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304969-c246-4a03-857f-f9dd29215b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:44.560745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-87304969-c246-4a03-857f-f9dd29215b45 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:44.562238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-87304969-c246-4a03-857f-f9dd29215b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:44.626580 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1080/2163] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:44.636307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:44.638374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:44.701772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2c7ce-ac98-4f7b-b7af-3ebb5020e622 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:44.706258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8890e2-1004-4596-915a-4b6b966569b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:44.706883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8890e2-1004-4596-915a-4b6b966569b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:44.707167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8890e2-1004-4596-915a-4b6b966569b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:44.707446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8890e2-1004-4596-915a-4b6b966569b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:44.717541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8890e2-1004-4596-915a-4b6b966569b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:44.719012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8890e2-1004-4596-915a-4b6b966569b6 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:44.728674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1084/2164] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:45.208726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87304969-c246-4a03-857f-f9dd29215b45 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:45.210403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-87304969-c246-4a03-857f-f9dd29215b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:45.227223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87304969-c246-4a03-857f-f9dd29215b45 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:45.233934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:45.234639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:45.235004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:45.235286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] PATH_INFO: `/v3/projects/1985b8d404fb4c4a9c2bf5494ffa808b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:45.240578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1985b8d404fb4c4a9c2bf5494ffa808b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:45.240578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:45.370970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1985b8d404fb4c4a9c2bf5494ffa808b', 'request_id': 'req-06ea8214-7b51-417d-8284-75bf4e4710fe'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:45.376903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1985b8d404fb4c4a9c2bf5494ffa808b', 'request_id': 'req-06ea8214-7b51-417d-8284-75bf4e4710fe'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:45.383010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1985b8d404fb4c4a9c2bf5494ffa808b', 'request_id': 'req-06ea8214-7b51-417d-8284-75bf4e4710fe'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:45.534081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:45.540293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] The token cache is being invalidate because project 1985b8d404fb4c4a9c2bf5494ffa808b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:45.542700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:45.542700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-06ea8214-7b51-417d-8284-75bf4e4710fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:45.542950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1081/2165] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:45 2022] DELETE /identity/v3/projects/1985b8d404fb4c4a9c2bf5494ffa808b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:45.548099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd664f6-8542-4cb7-a18a-a15a31835870 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:45.548597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd664f6-8542-4cb7-a18a-a15a31835870 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:45.548688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd664f6-8542-4cb7-a18a-a15a31835870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:45.568875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-abd664f6-8542-4cb7-a18a-a15a31835870 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:45.570129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-abd664f6-8542-4cb7-a18a-a15a31835870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:45.629893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1085/2166] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:45.638546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf88b08-b6f7-49fe-84ca-fcd23dc47b94 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:45.648208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf88b08-b6f7-49fe-84ca-fcd23dc47b94 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:45.648208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf88b08-b6f7-49fe-84ca-fcd23dc47b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:45.660180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-7cf88b08-b6f7-49fe-84ca-fcd23dc47b94 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:45.661410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7cf88b08-b6f7-49fe-84ca-fcd23dc47b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:45.669855 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1082/2167] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:45.674046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd664f6-8542-4cb7-a18a-a15a31835870 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:45.684491 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd664f6-8542-4cb7-a18a-a15a31835870 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:45.689000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450b55-9f03-44f9-bd2d-a8b81df1b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:45.689619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450b55-9f03-44f9-bd2d-a8b81df1b7ab admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:45.689915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450b55-9f03-44f9-bd2d-a8b81df1b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:45.690184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450b55-9f03-44f9-bd2d-a8b81df1b7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:45.690830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6450b55-9f03-44f9-bd2d-a8b81df1b7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:45.691126 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6450b55-9f03-44f9-bd2d-a8b81df1b7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:45.692767 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6450b55-9f03-44f9-bd2d-a8b81df1b7ab admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:45.705109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1086/2168] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:45.709543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf88b08-b6f7-49fe-84ca-fcd23dc47b94 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:45.721846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf88b08-b6f7-49fe-84ca-fcd23dc47b94 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:45.726771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff2131-172a-4699-87b0-b43a533f2be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:45.727431 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff2131-172a-4699-87b0-b43a533f2be4 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:45.727715 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff2131-172a-4699-87b0-b43a533f2be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:45.727986 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff2131-172a-4699-87b0-b43a533f2be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:45.728638 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff2131-172a-4699-87b0-b43a533f2be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:45.729085 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:45.730758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff2131-172a-4699-87b0-b43a533f2be4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:45.896679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1083/2169] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:45 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:45.900824 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450b55-9f03-44f9-bd2d-a8b81df1b7ab admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:45.910933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450b55-9f03-44f9-bd2d-a8b81df1b7ab admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:45.967532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d2e0a-40b0-43d3-a30b-a9e1900d40c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:45.968170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d2e0a-40b0-43d3-a30b-a9e1900d40c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:45.968454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d2e0a-40b0-43d3-a30b-a9e1900d40c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:45.968731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d2e0a-40b0-43d3-a30b-a9e1900d40c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:45.969375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d2e0a-40b0-43d3-a30b-a9e1900d40c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:45.971358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d2e0a-40b0-43d3-a30b-a9e1900d40c7 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:46.082289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1087/2170] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:45 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:46.091941 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff2131-172a-4699-87b0-b43a533f2be4 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:46.118273 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff2131-172a-4699-87b0-b43a533f2be4 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:46.126378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78836b4-640a-4854-a262-03fa5d070b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:46.126378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78836b4-640a-4854-a262-03fa5d070b19 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:46.126378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78836b4-640a-4854-a262-03fa5d070b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:46.137992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78836b4-640a-4854-a262-03fa5d070b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:46.138744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78836b4-640a-4854-a262-03fa5d070b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:46.140779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78836b4-640a-4854-a262-03fa5d070b19 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:46.155004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1084/2171] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:46.159166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d2e0a-40b0-43d3-a30b-a9e1900d40c7 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:46.170367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d2e0a-40b0-43d3-a30b-a9e1900d40c7 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:46.175034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958c555-a58b-40a0-a84e-451e0ab5b203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:46.175637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c555-a58b-40a0-a84e-451e0ab5b203 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:46.175920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c555-a58b-40a0-a84e-451e0ab5b203 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:46.176199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c555-a58b-40a0-a84e-451e0ab5b203 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:46.176845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958c555-a58b-40a0-a84e-451e0ab5b203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:46.178497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958c555-a58b-40a0-a84e-451e0ab5b203 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:46.189787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1088/2172] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:46.194502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78836b4-640a-4854-a262-03fa5d070b19 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:46.206805 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78836b4-640a-4854-a262-03fa5d070b19 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:46.211973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d395d4-80e5-41bb-a2c0-8f420d576a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:46.212762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d395d4-80e5-41bb-a2c0-8f420d576a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:46.213221 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d395d4-80e5-41bb-a2c0-8f420d576a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:46.213683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d395d4-80e5-41bb-a2c0-8f420d576a37 admin admin] PATH_INFO: `/v3/projects/527ee490f48c4f5895f8d01dd3595007/users/7529bc6957284314b72d0bc10c4f7088/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:46.230125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d395d4-80e5-41bb-a2c0-8f420d576a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527ee490f48c4f5895f8d01dd3595007, user_id=7529bc6957284314b72d0bc10c4f7088, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:46.234153 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d395d4-80e5-41bb-a2c0-8f420d576a37 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:46.341952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1085/2173] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:46 2022] PUT /identity/v3/projects/527ee490f48c4f5895f8d01dd3595007/users/7529bc6957284314b72d0bc10c4f7088/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:46.346929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32455f00-dcf2-43fd-b441-b9e17b4bc86c None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:46.347367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32455f00-dcf2-43fd-b441-b9e17b4bc86c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:46.347595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32455f00-dcf2-43fd-b441-b9e17b4bc86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:46.368580 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-32455f00-dcf2-43fd-b441-b9e17b4bc86c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:46.368879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-32455f00-dcf2-43fd-b441-b9e17b4bc86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:46.382788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d395d4-80e5-41bb-a2c0-8f420d576a37 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:46.384615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-62d395d4-80e5-41bb-a2c0-8f420d576a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:46.431519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1089/2174] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:46.444313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32455f00-dcf2-43fd-b441-b9e17b4bc86c None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:46.446423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-32455f00-dcf2-43fd-b441-b9e17b4bc86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:46.458162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d395d4-80e5-41bb-a2c0-8f420d576a37 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:46.463881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:46.464698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:46.465326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:46.465728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] PATH_INFO: `/v3/users/971d7c560ded4ebcb671386041f234a3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:46.467158 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971d7c560ded4ebcb671386041f234a3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:46.469835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:46.520093 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32455f00-dcf2-43fd-b441-b9e17b4bc86c None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:46.523816 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5f7a7-f72c-4048-846e-7df8f5566ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:46.524422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5f7a7-f72c-4048-846e-7df8f5566ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:46.524696 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5f7a7-f72c-4048-846e-7df8f5566ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:46.524963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5f7a7-f72c-4048-846e-7df8f5566ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:46.534847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5f7a7-f72c-4048-846e-7df8f5566ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:46.536348 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5f7a7-f72c-4048-846e-7df8f5566ae9 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:46.546979 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1090/2175] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:46.750861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971d7c560ded4ebcb671386041f234a3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:46.837746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:46.892106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971d7c560ded4ebcb671386041f234a3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:46.906532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971d7c560ded4ebcb671386041f234a3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:46.913917 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971d7c560ded4ebcb671386041f234a3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:46.914712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971d7c560ded4ebcb671386041f234a3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:46.921549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1086/2176] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:46 2022] DELETE /identity/v3/users/971d7c560ded4ebcb671386041f234a3 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:46.926045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0cadc-956e-4e16-91ff-e7db5be9fee5 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:46.926525 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0cadc-956e-4e16-91ff-e7db5be9fee5 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:46.926630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0cadc-956e-4e16-91ff-e7db5be9fee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:46.949776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0cb0cadc-956e-4e16-91ff-e7db5be9fee5 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:46.951303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0cb0cadc-956e-4e16-91ff-e7db5be9fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:47.030904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1091/2177] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:47.041351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:47.043244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:47.118825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c1b51-dcad-4115-9966-7832cb59f2b5 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:47.122799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b0c37-7d2a-4b7a-b3bb-2df57c137335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:47.128605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b0c37-7d2a-4b7a-b3bb-2df57c137335 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:47.128605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b0c37-7d2a-4b7a-b3bb-2df57c137335 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:47.128605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b0c37-7d2a-4b7a-b3bb-2df57c137335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:47.133729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b0c37-7d2a-4b7a-b3bb-2df57c137335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:47.135100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b0c37-7d2a-4b7a-b3bb-2df57c137335 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:47.137508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0cadc-956e-4e16-91ff-e7db5be9fee5 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:47.139032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0cb0cadc-956e-4e16-91ff-e7db5be9fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:47.146477 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1087/2178] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:47.162989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0cadc-956e-4e16-91ff-e7db5be9fee5 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:47.169933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:47.170677 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:47.171448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:47.171448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] PATH_INFO: `/v3/users/2ccdf34da088401e982a558a316b6d53` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:47.172668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ccdf34da088401e982a558a316b6d53)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:47.174703 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:47.493234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ccdf34da088401e982a558a316b6d53'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:47.508723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ccdf34da088401e982a558a316b6d53'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:47.516190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ccdf34da088401e982a558a316b6d53'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:47.619069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ccdf34da088401e982a558a316b6d53'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:47.619685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ccdf34da088401e982a558a316b6d53'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:47.627290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1092/2179] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:47 2022] DELETE /identity/v3/users/2ccdf34da088401e982a558a316b6d53 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:47.632012 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889bf76-580a-4ccf-9c80-e0a36f8bb35d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:47.632361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889bf76-580a-4ccf-9c80-e0a36f8bb35d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:47.632638 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889bf76-580a-4ccf-9c80-e0a36f8bb35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:47.657878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:47.660373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-1889bf76-580a-4ccf-9c80-e0a36f8bb35d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:47.660858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:47.662479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1889bf76-580a-4ccf-9c80-e0a36f8bb35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:47.749119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1088/2180] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:47.759122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889bf76-580a-4ccf-9c80-e0a36f8bb35d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:47.761511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1889bf76-580a-4ccf-9c80-e0a36f8bb35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:47.767128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c74d7-14e8-45cb-80d4-f7f8f1ac90eb admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:47.781143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:47.781992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:47.782338 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:47.782776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] PATH_INFO: `/v3/projects/b51a4bb204bd4d2893324932c2bcc85f` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:47.783946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51a4bb204bd4d2893324932c2bcc85f)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:47.786019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:47.853996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889bf76-580a-4ccf-9c80-e0a36f8bb35d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:47.858723 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a819c3-3495-4c19-94ae-f8e81ccd6f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:47.859347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a819c3-3495-4c19-94ae-f8e81ccd6f84 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:47.860302 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a819c3-3495-4c19-94ae-f8e81ccd6f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:47.860302 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a819c3-3495-4c19-94ae-f8e81ccd6f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:47.870404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a819c3-3495-4c19-94ae-f8e81ccd6f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:47.873151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a819c3-3495-4c19-94ae-f8e81ccd6f84 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:47.884126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1089/2181] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:48.010278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51a4bb204bd4d2893324932c2bcc85f', 'request_id': 'req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:48.133976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:48.134959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51a4bb204bd4d2893324932c2bcc85f', 'request_id': 'req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:48.155984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51a4bb204bd4d2893324932c2bcc85f', 'request_id': 'req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:48.179554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] The token cache is being invalidate because project b51a4bb204bd4d2893324932c2bcc85f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:48.179554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:48.181752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-ab7b5d88-efb4-4aeb-9204-ebebc8aa9315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:48.183773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1093/2182] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:47 2022] DELETE /identity/v3/projects/b51a4bb204bd4d2893324932c2bcc85f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:48.190250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820e37-163e-4b1a-abcd-e28d45aee877 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:48.191650 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820e37-163e-4b1a-abcd-e28d45aee877 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:48.192102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820e37-163e-4b1a-abcd-e28d45aee877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:48.215625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-06820e37-163e-4b1a-abcd-e28d45aee877 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:48.217339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-06820e37-163e-4b1a-abcd-e28d45aee877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:48.316035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1090/2183] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:48.330403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc942-a451-4e4d-90cd-a5bf640e6f40 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:48.330729 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc942-a451-4e4d-90cd-a5bf640e6f40 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:48.331071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44dc942-a451-4e4d-90cd-a5bf640e6f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:48.366622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-c44dc942-a451-4e4d-90cd-a5bf640e6f40 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:48.367919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c44dc942-a451-4e4d-90cd-a5bf640e6f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:48.377263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1094/2184] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:48.382346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820e37-163e-4b1a-abcd-e28d45aee877 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:48.400183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820e37-163e-4b1a-abcd-e28d45aee877 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:48.405615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110672-8366-4dc4-b8d5-819d461f6e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:48.406234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110672-8366-4dc4-b8d5-819d461f6e45 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:48.406516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110672-8366-4dc4-b8d5-819d461f6e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:48.406785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110672-8366-4dc4-b8d5-819d461f6e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:48.408393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee110672-8366-4dc4-b8d5-819d461f6e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:48.408393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee110672-8366-4dc4-b8d5-819d461f6e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:48.409512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee110672-8366-4dc4-b8d5-819d461f6e45 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:48.430775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1091/2185] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:48.446381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110672-8366-4dc4-b8d5-819d461f6e45 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:48.448133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ee110672-8366-4dc4-b8d5-819d461f6e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:48.454416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dc942-a451-4e4d-90cd-a5bf640e6f40 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:48.483467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110672-8366-4dc4-b8d5-819d461f6e45 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:48.489786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:48.497163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44dc942-a451-4e4d-90cd-a5bf640e6f40 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:48.497297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:48.497297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:48.497297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] PATH_INFO: `/v3/projects/70d6041c5cba45018ec4ab183a1178da` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:48.497297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d6041c5cba45018ec4ab183a1178da)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:48.497614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fa442-3d99-4000-8574-c8007f545c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:48.497614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa442-3d99-4000-8574-c8007f545c2d admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:48.497614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa442-3d99-4000-8574-c8007f545c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:48.497846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:48.497926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fa442-3d99-4000-8574-c8007f545c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:48.498617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fa442-3d99-4000-8574-c8007f545c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:48.502028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fa442-3d99-4000-8574-c8007f545c2d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:48.602440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1095/2186] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:48 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:48.603820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097dbe-9807-48e2-994f-fd961763eb1b None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:48.604099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097dbe-9807-48e2-994f-fd961763eb1b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:48.604374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9097dbe-9807-48e2-994f-fd961763eb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:48.633162 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-b9097dbe-9807-48e2-994f-fd961763eb1b None None] MFA Rules not processed for user `7529bc6957284314b72d0bc10c4f7088`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:48.639628 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b9097dbe-9807-48e2-994f-fd961763eb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:48.705123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d6041c5cba45018ec4ab183a1178da', 'request_id': 'req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:48.713400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1096/2187] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:48.713400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9097dbe-9807-48e2-994f-fd961763eb1b None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:48.713840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d6041c5cba45018ec4ab183a1178da', 'request_id': 'req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:48.722439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d6041c5cba45018ec4ab183a1178da', 'request_id': 'req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:48.788682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9097dbe-9807-48e2-994f-fd961763eb1b None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:48.837824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] The token cache is being invalidate because project 70d6041c5cba45018ec4ab183a1178da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:48.838424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:48.838889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:48.840890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1092/2188] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:48 2022] DELETE /identity/v3/projects/70d6041c5cba45018ec4ab183a1178da => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:48.841991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:48.846033 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:48.852440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d75f8d-725b-4f36-85af-ceb5f7559ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:48.853082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d75f8d-725b-4f36-85af-ceb5f7559ffd admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:48.853358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d75f8d-725b-4f36-85af-ceb5f7559ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:48.853662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d75f8d-725b-4f36-85af-ceb5f7559ffd admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:48.854297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d75f8d-725b-4f36-85af-ceb5f7559ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:48.856403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d75f8d-725b-4f36-85af-ceb5f7559ffd admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:48.912506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e09d48-5e3b-4f44-9cd6-8f825b4f0db7 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:48.916277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bc45d-7511-41e1-9316-5d8c591032b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:48.916890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bc45d-7511-41e1-9316-5d8c591032b9 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:48.917173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bc45d-7511-41e1-9316-5d8c591032b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:48.917450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bc45d-7511-41e1-9316-5d8c591032b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:48.919343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c88bc45d-7511-41e1-9316-5d8c591032b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:48.931636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1097/2189] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:48 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:48.932967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defc1f1-2823-4986-8b5a-94c8fb1eac90 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:48.933252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defc1f1-2823-4986-8b5a-94c8fb1eac90 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:48.934170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defc1f1-2823-4986-8b5a-94c8fb1eac90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:48.954336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8defc1f1-2823-4986-8b5a-94c8fb1eac90 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:48.955545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8defc1f1-2823-4986-8b5a-94c8fb1eac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:48.963625 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1098/2190] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:48.964983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defc1f1-2823-4986-8b5a-94c8fb1eac90 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:48.967948 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8defc1f1-2823-4986-8b5a-94c8fb1eac90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:48.979937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defc1f1-2823-4986-8b5a-94c8fb1eac90 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:48.985154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c840e-8f1e-4c36-875d-6863aab342ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:48.985855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c840e-8f1e-4c36-875d-6863aab342ee admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:48.986288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c840e-8f1e-4c36-875d-6863aab342ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:48.986574 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c840e-8f1e-4c36-875d-6863aab342ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:48.987314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c840e-8f1e-4c36-875d-6863aab342ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:48.988529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bc45d-7511-41e1-9316-5d8c591032b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:48.988964 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c840e-8f1e-4c36-875d-6863aab342ee admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:48.990157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88bc45d-7511-41e1-9316-5d8c591032b9 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:48.999866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1099/2191] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:49.000413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1093/2192] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:49.003831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bc45d-7511-41e1-9316-5d8c591032b9 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.004082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966496a2-ebaf-4406-ba89-ddce71dc2b6a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.004370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966496a2-ebaf-4406-ba89-ddce71dc2b6a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.010285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966496a2-ebaf-4406-ba89-ddce71dc2b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.017831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bc45d-7511-41e1-9316-5d8c591032b9 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.023593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50a7f-23c1-43ba-9620-c24033bd9251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.024266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50a7f-23c1-43ba-9620-c24033bd9251 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.024662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50a7f-23c1-43ba-9620-c24033bd9251 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.024940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50a7f-23c1-43ba-9620-c24033bd9251 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.025663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50a7f-23c1-43ba-9620-c24033bd9251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.026170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-966496a2-ebaf-4406-ba89-ddce71dc2b6a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:49.027615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-966496a2-ebaf-4406-ba89-ddce71dc2b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:49.027880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50a7f-23c1-43ba-9620-c24033bd9251 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.037171 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1100/2193] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:49.044786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1094/2194] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:49.046934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50a7f-23c1-43ba-9620-c24033bd9251 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.047737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966496a2-ebaf-4406-ba89-ddce71dc2b6a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.062267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50a7f-23c1-43ba-9620-c24033bd9251 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.063035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966496a2-ebaf-4406-ba89-ddce71dc2b6a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.068961 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6ebd6-7100-4930-a046-90061bb486f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.069672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ebd6-7100-4930-a046-90061bb486f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.069884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:49.070008 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ebd6-7100-4930-a046-90061bb486f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.070224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6ebd6-7100-4930-a046-90061bb486f3 admin admin] PATH_INFO: `/v3/projects/809b030f26e2445b9ed9d4e862310755/users/d50abbe2a2fe496aa68bb2107319524f/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.082889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2d5c6-f72a-40fb-97b3-6aee72e19d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.083504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2d5c6-f72a-40fb-97b3-6aee72e19d78 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.090414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2d5c6-f72a-40fb-97b3-6aee72e19d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.090414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2d5c6-f72a-40fb-97b3-6aee72e19d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.090414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2d5c6-f72a-40fb-97b3-6aee72e19d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:49.090414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2d5c6-f72a-40fb-97b3-6aee72e19d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.090414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2d5c6-f72a-40fb-97b3-6aee72e19d78 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.092806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6ebd6-7100-4930-a046-90061bb486f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809b030f26e2445b9ed9d4e862310755, user_id=d50abbe2a2fe496aa68bb2107319524f, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.095852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6ebd6-7100-4930-a046-90061bb486f3 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.100490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1101/2195] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:49.101644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2d5c6-f72a-40fb-97b3-6aee72e19d78 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.103306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2fa2d5c6-f72a-40fb-97b3-6aee72e19d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:49.116622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2d5c6-f72a-40fb-97b3-6aee72e19d78 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.120375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9294-dd94-48ee-a9ff-a17f60db33b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.121655 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9294-dd94-48ee-a9ff-a17f60db33b6 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.121941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9294-dd94-48ee-a9ff-a17f60db33b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.122215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9294-dd94-48ee-a9ff-a17f60db33b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.123979 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-174c9294-dd94-48ee-a9ff-a17f60db33b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:49.191499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c9294-dd94-48ee-a9ff-a17f60db33b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.193010 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c9294-dd94-48ee-a9ff-a17f60db33b6 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.201173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1095/2196] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:49 2022] PUT /identity/v3/projects/809b030f26e2445b9ed9d4e862310755/users/d50abbe2a2fe496aa68bb2107319524f/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:49.202344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6ebd6-7100-4930-a046-90061bb486f3 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.205138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1102/2197] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:49.212765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035b62c-0a06-4e24-97d2-665fe1ef20a9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.213123 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035b62c-0a06-4e24-97d2-665fe1ef20a9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.213553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035b62c-0a06-4e24-97d2-665fe1ef20a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.252510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-4035b62c-0a06-4e24-97d2-665fe1ef20a9 None None] MFA Rules not processed for user `d50abbe2a2fe496aa68bb2107319524f`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:49.254156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4035b62c-0a06-4e24-97d2-665fe1ef20a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:49.275408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6ebd6-7100-4930-a046-90061bb486f3 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.280391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc394-23d7-4f82-85a8-64cedd31804b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.280998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc394-23d7-4f82-85a8-64cedd31804b admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.281275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc394-23d7-4f82-85a8-64cedd31804b admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.281553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cc394-23d7-4f82-85a8-64cedd31804b admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.282220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cc394-23d7-4f82-85a8-64cedd31804b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.284191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cc394-23d7-4f82-85a8-64cedd31804b admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.321282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1103/2198] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:49.325804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035b62c-0a06-4e24-97d2-665fe1ef20a9 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.336033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035b62c-0a06-4e24-97d2-665fe1ef20a9 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.340787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347afc27-c6e8-4473-9dd1-bf4f02e7ea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.341393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347afc27-c6e8-4473-9dd1-bf4f02e7ea04 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.342150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347afc27-c6e8-4473-9dd1-bf4f02e7ea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.342150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347afc27-c6e8-4473-9dd1-bf4f02e7ea04 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.342715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347afc27-c6e8-4473-9dd1-bf4f02e7ea04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.344941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347afc27-c6e8-4473-9dd1-bf4f02e7ea04 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.419781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1096/2199] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:49 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:49.423788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc394-23d7-4f82-85a8-64cedd31804b admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.485833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cc394-23d7-4f82-85a8-64cedd31804b admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.491035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72099aa8-8cad-4951-b2d8-d42cbb8ac38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.491643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72099aa8-8cad-4951-b2d8-d42cbb8ac38f admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.491922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72099aa8-8cad-4951-b2d8-d42cbb8ac38f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.492197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72099aa8-8cad-4951-b2d8-d42cbb8ac38f admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.492836 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72099aa8-8cad-4951-b2d8-d42cbb8ac38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.494819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72099aa8-8cad-4951-b2d8-d42cbb8ac38f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.523446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1104/2200] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:49 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:37:49.528918 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347afc27-c6e8-4473-9dd1-bf4f02e7ea04 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.596583 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347afc27-c6e8-4473-9dd1-bf4f02e7ea04 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.601510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0ee71-b76a-43a3-af9c-3ecbec2add68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.602322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0ee71-b76a-43a3-af9c-3ecbec2add68 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.602602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0ee71-b76a-43a3-af9c-3ecbec2add68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.604906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0ee71-b76a-43a3-af9c-3ecbec2add68 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.604906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0ee71-b76a-43a3-af9c-3ecbec2add68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.606583 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0ee71-b76a-43a3-af9c-3ecbec2add68 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.614173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1097/2201] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:49 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:37:49.615302 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72099aa8-8cad-4951-b2d8-d42cbb8ac38f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.628357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72099aa8-8cad-4951-b2d8-d42cbb8ac38f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.633770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ce717-b069-438a-a39f-815064a56442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.634484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce717-b069-438a-a39f-815064a56442 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.635091 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce717-b069-438a-a39f-815064a56442 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.635468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce717-b069-438a-a39f-815064a56442 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.636409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ce717-b069-438a-a39f-815064a56442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.638274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ce717-b069-438a-a39f-815064a56442 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.648709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1098/2202] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:49.653393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ce717-b069-438a-a39f-815064a56442 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.663200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ce717-b069-438a-a39f-815064a56442 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.668443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5493ad-b7a2-491d-8eba-836a3b0a879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.669083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5493ad-b7a2-491d-8eba-836a3b0a879c admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.669371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5493ad-b7a2-491d-8eba-836a3b0a879c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.669685 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5493ad-b7a2-491d-8eba-836a3b0a879c admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.670323 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5493ad-b7a2-491d-8eba-836a3b0a879c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.671910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5493ad-b7a2-491d-8eba-836a3b0a879c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.682715 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1099/2203] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:37:49.686644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5493ad-b7a2-491d-8eba-836a3b0a879c admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.697073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5493ad-b7a2-491d-8eba-836a3b0a879c admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.702482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f049f-e4b3-45bf-9dbb-45d8439443e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.703138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f049f-e4b3-45bf-9dbb-45d8439443e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.703417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f049f-e4b3-45bf-9dbb-45d8439443e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.703691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f049f-e4b3-45bf-9dbb-45d8439443e9 admin admin] PATH_INFO: `/v3/projects/19ef394d28714744878387b3447adf1b/users/af6b2c3b389c4fecad11a78ebf526b4f/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.719874 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f049f-e4b3-45bf-9dbb-45d8439443e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ef394d28714744878387b3447adf1b, user_id=af6b2c3b389c4fecad11a78ebf526b4f, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.722735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f049f-e4b3-45bf-9dbb-45d8439443e9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.729608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1105/2204] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:49 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:49.735003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0ee71-b76a-43a3-af9c-3ecbec2add68 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.746643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0ee71-b76a-43a3-af9c-3ecbec2add68 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.760559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e4686-e60a-4ef7-bf36-723a139f06cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.760559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e4686-e60a-4ef7-bf36-723a139f06cd admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.760779 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e4686-e60a-4ef7-bf36-723a139f06cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.761018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e4686-e60a-4ef7-bf36-723a139f06cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.761802 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e4686-e60a-4ef7-bf36-723a139f06cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.763363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e4686-e60a-4ef7-bf36-723a139f06cd admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.781551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1106/2205] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:37:49.782280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e4686-e60a-4ef7-bf36-723a139f06cd admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.794212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e4686-e60a-4ef7-bf36-723a139f06cd admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.804166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca2246-3ad2-443e-a6b9-53ac0fbba824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.804967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca2246-3ad2-443e-a6b9-53ac0fbba824 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.805254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca2246-3ad2-443e-a6b9-53ac0fbba824 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.805522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca2246-3ad2-443e-a6b9-53ac0fbba824 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.806205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca2246-3ad2-443e-a6b9-53ac0fbba824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.807823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca2246-3ad2-443e-a6b9-53ac0fbba824 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.820111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1107/2206] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:49.824407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca2246-3ad2-443e-a6b9-53ac0fbba824 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.834109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca2246-3ad2-443e-a6b9-53ac0fbba824 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:49.838750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d663c-9a59-4ade-99c2-8dfc1b09691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:49.839378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d663c-9a59-4ade-99c2-8dfc1b09691f admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.840184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d663c-9a59-4ade-99c2-8dfc1b09691f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.840535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d663c-9a59-4ade-99c2-8dfc1b09691f admin admin] PATH_INFO: `/v3/projects/f1096a0bfdb44276bbedb73a47f89fff/users/7e38f0dad6ce4311a77862b34db03b5f/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.854921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d663c-9a59-4ade-99c2-8dfc1b09691f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1096a0bfdb44276bbedb73a47f89fff, user_id=7e38f0dad6ce4311a77862b34db03b5f, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:49.858299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d663c-9a59-4ade-99c2-8dfc1b09691f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:49.863063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1100/2207] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:49 2022] PUT /identity/v3/projects/19ef394d28714744878387b3447adf1b/users/af6b2c3b389c4fecad11a78ebf526b4f/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:49.868730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe965e-2b7f-44d3-947c-62f3bf10732c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.869048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe965e-2b7f-44d3-947c-62f3bf10732c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.869331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe965e-2b7f-44d3-947c-62f3bf10732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:49.890197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-30fe965e-2b7f-44d3-947c-62f3bf10732c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:49.891402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-30fe965e-2b7f-44d3-947c-62f3bf10732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:49.969858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1101/2208] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:49.977994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe965e-2b7f-44d3-947c-62f3bf10732c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:49.980016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-30fe965e-2b7f-44d3-947c-62f3bf10732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:49.983070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1108/2209] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:49 2022] PUT /identity/v3/projects/f1096a0bfdb44276bbedb73a47f89fff/users/7e38f0dad6ce4311a77862b34db03b5f/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:37:49.994279 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7c8e1-943b-48c9-b1c1-ef224fb8db2a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:49.994565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7c8e1-943b-48c9-b1c1-ef224fb8db2a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:49.994838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7c8e1-943b-48c9-b1c1-ef224fb8db2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:50.024705 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ebe7c8e1-943b-48c9-b1c1-ef224fb8db2a None None] MFA Rules not processed for user `7e38f0dad6ce4311a77862b34db03b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:50.025987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ebe7c8e1-943b-48c9-b1c1-ef224fb8db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:50.046446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe965e-2b7f-44d3-947c-62f3bf10732c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:50.097549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1109/2210] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:50.102065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7c8e1-943b-48c9-b1c1-ef224fb8db2a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:50.108166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d29275-588c-4798-8f23-f8516b16114b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:50.108787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d29275-588c-4798-8f23-f8516b16114b service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:50.109073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d29275-588c-4798-8f23-f8516b16114b service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:50.109360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d29275-588c-4798-8f23-f8516b16114b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:50.170153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7c8e1-943b-48c9-b1c1-ef224fb8db2a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:50.173303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d29275-588c-4798-8f23-f8516b16114b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:50.175106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d29275-588c-4798-8f23-f8516b16114b service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:50.175369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917719a-bfe7-4813-a2ed-c9a33baa6b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:50.176045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917719a-bfe7-4813-a2ed-c9a33baa6b2e admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:50.176392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917719a-bfe7-4813-a2ed-c9a33baa6b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:50.176732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917719a-bfe7-4813-a2ed-c9a33baa6b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:50.177562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917719a-bfe7-4813-a2ed-c9a33baa6b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:50.180144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917719a-bfe7-4813-a2ed-c9a33baa6b2e admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:50.183037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:50.209774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1102/2211] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:50.353938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1110/2212] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:50 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:37:50.358245 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d29275-588c-4798-8f23-f8516b16114b service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:50.368048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d29275-588c-4798-8f23-f8516b16114b service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:50.434477 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032a5d9-60ce-4f0b-a71d-789134fe6513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:50.441966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032a5d9-60ce-4f0b-a71d-789134fe6513 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:50.441966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032a5d9-60ce-4f0b-a71d-789134fe6513 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:50.441966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032a5d9-60ce-4f0b-a71d-789134fe6513 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:50.441966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032a5d9-60ce-4f0b-a71d-789134fe6513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:50.441966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032a5d9-60ce-4f0b-a71d-789134fe6513 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:50.623892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1103/2213] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:50 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:50.627849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917719a-bfe7-4813-a2ed-c9a33baa6b2e admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:50.639724 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917719a-bfe7-4813-a2ed-c9a33baa6b2e admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:50.644483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e1da5-a75f-4edd-9578-97755c455732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:50.645091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e1da5-a75f-4edd-9578-97755c455732 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:50.645402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e1da5-a75f-4edd-9578-97755c455732 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:50.645704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e1da5-a75f-4edd-9578-97755c455732 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:50.646344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e1da5-a75f-4edd-9578-97755c455732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:50.648951 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e1da5-a75f-4edd-9578-97755c455732 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:50.662735 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1111/2214] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:50.664978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032a5d9-60ce-4f0b-a71d-789134fe6513 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:50.677147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032a5d9-60ce-4f0b-a71d-789134fe6513 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:50.681377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337bf4-279c-42da-94c6-cd0a2cd4bb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:50.682081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337bf4-279c-42da-94c6-cd0a2cd4bb91 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:50.682405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337bf4-279c-42da-94c6-cd0a2cd4bb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:50.682629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337bf4-279c-42da-94c6-cd0a2cd4bb91 admin admin] PATH_INFO: `/v3/projects/d63e845ad0a8441c8443f453c0ec9436/users/525f6876017147d8be13b6fcde4f2289/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:50.699111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1337bf4-279c-42da-94c6-cd0a2cd4bb91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63e845ad0a8441c8443f453c0ec9436, user_id=525f6876017147d8be13b6fcde4f2289, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:50.702158 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1337bf4-279c-42da-94c6-cd0a2cd4bb91 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:50.815953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1104/2215] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:50 2022] PUT /identity/v3/projects/d63e845ad0a8441c8443f453c0ec9436/users/525f6876017147d8be13b6fcde4f2289/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:50.820315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e1da5-a75f-4edd-9578-97755c455732 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:50.833638 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e1da5-a75f-4edd-9578-97755c455732 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:50.928071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4ab81-58fd-496b-b728-3125b991187d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:50.929626 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ab81-58fd-496b-b728-3125b991187d admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:50.929857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ab81-58fd-496b-b728-3125b991187d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:50.930395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4ab81-58fd-496b-b728-3125b991187d admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:50.931601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4ab81-58fd-496b-b728-3125b991187d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:50.935213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4ab81-58fd-496b-b728-3125b991187d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:50.947602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1112/2216] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:50.954181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337bf4-279c-42da-94c6-cd0a2cd4bb91 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:50.973922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337bf4-279c-42da-94c6-cd0a2cd4bb91 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:50.981396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a9a3d-b273-4eb9-b05e-a6989ff70167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:50.982112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a9a3d-b273-4eb9-b05e-a6989ff70167 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:50.982409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a9a3d-b273-4eb9-b05e-a6989ff70167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:50.983191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a9a3d-b273-4eb9-b05e-a6989ff70167 admin admin] PATH_INFO: `/v3/projects/d63e845ad0a8441c8443f453c0ec9436/users/525f6876017147d8be13b6fcde4f2289/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:50.986428 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a9a3d-b273-4eb9-b05e-a6989ff70167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63e845ad0a8441c8443f453c0ec9436, user_id=525f6876017147d8be13b6fcde4f2289, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:50.989076 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a9a3d-b273-4eb9-b05e-a6989ff70167 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:51.004436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1105/2217] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:50 2022] PUT /identity/v3/projects/d63e845ad0a8441c8443f453c0ec9436/users/525f6876017147d8be13b6fcde4f2289/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:51.017758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf46d0d-e946-4f33-ac18-f4841985ae61 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:51.018587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf46d0d-e946-4f33-ac18-f4841985ae61 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:51.018870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf46d0d-e946-4f33-ac18-f4841985ae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:51.052957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-bcf46d0d-e946-4f33-ac18-f4841985ae61 None None] MFA Rules not processed for user `525f6876017147d8be13b6fcde4f2289`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:51.054785 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bcf46d0d-e946-4f33-ac18-f4841985ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:51.131304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1113/2218] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:51.143443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a9a3d-b273-4eb9-b05e-a6989ff70167 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:51.203078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a9a3d-b273-4eb9-b05e-a6989ff70167 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:51.206756 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c723fa-f721-4d3a-b88a-b9fecb2b457c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:51.207356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c723fa-f721-4d3a-b88a-b9fecb2b457c service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:51.207632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c723fa-f721-4d3a-b88a-b9fecb2b457c service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:51.207901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c723fa-f721-4d3a-b88a-b9fecb2b457c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:51.299045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c723fa-f721-4d3a-b88a-b9fecb2b457c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:51.302666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c723fa-f721-4d3a-b88a-b9fecb2b457c service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:51.318212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1106/2219] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:52.075793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913492-7794-45ec-b6fe-6f450b41852b None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:52.076246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913492-7794-45ec-b6fe-6f450b41852b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:52.076338 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa913492-7794-45ec-b6fe-6f450b41852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:52.108344 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-aa913492-7794-45ec-b6fe-6f450b41852b None None] MFA Rules not processed for user `af6b2c3b389c4fecad11a78ebf526b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:52.110057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-aa913492-7794-45ec-b6fe-6f450b41852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:52.200065 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c723fa-f721-4d3a-b88a-b9fecb2b457c service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:52.201765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f5c723fa-f721-4d3a-b88a-b9fecb2b457c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:52.221003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1114/2220] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:52.253780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa913492-7794-45ec-b6fe-6f450b41852b None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:52.277296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa913492-7794-45ec-b6fe-6f450b41852b None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:52.294303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7739bb-2ad9-4083-bc16-4db56822bd5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:52.297608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7739bb-2ad9-4083-bc16-4db56822bd5b service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:52.297608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7739bb-2ad9-4083-bc16-4db56822bd5b service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:52.297608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7739bb-2ad9-4083-bc16-4db56822bd5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:52.313353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c723fa-f721-4d3a-b88a-b9fecb2b457c service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:52.321774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:52.322503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:52.322773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:52.323055 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] PATH_INFO: `/v3/users/7fee97ae9cca49ba8bd1c7faad702927` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:52.324349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fee97ae9cca49ba8bd1c7faad702927)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:52.327060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:52.331589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7739bb-2ad9-4083-bc16-4db56822bd5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:52.336464 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7739bb-2ad9-4083-bc16-4db56822bd5b service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:52.365795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1115/2221] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:52.368258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3623a-12b6-460c-874c-2758e9d377b9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:52.369159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3623a-12b6-460c-874c-2758e9d377b9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:52.369798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3623a-12b6-460c-874c-2758e9d377b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:52.393613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-6dd3623a-12b6-460c-874c-2758e9d377b9 None None] MFA Rules not processed for user `7529bc6957284314b72d0bc10c4f7088`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:52.394305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6dd3623a-12b6-460c-874c-2758e9d377b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:52.461335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1116/2222] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:52.532508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:52.580190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fee97ae9cca49ba8bd1c7faad702927'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:52.657765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fee97ae9cca49ba8bd1c7faad702927'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:52.676164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fee97ae9cca49ba8bd1c7faad702927'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:52.683991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fee97ae9cca49ba8bd1c7faad702927'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:52.684800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fee97ae9cca49ba8bd1c7faad702927'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:52.691756 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1107/2223] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:52 2022] DELETE /identity/v3/users/7fee97ae9cca49ba8bd1c7faad702927 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:52.698576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa0fe3-e1a5-49c1-88b8-278e205631a1 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:52.698889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa0fe3-e1a5-49c1-88b8-278e205631a1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:52.699207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa0fe3-e1a5-49c1-88b8-278e205631a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:52.722013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a9fa0fe3-e1a5-49c1-88b8-278e205631a1 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:52.723297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a9fa0fe3-e1a5-49c1-88b8-278e205631a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:52.803717 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1117/2224] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:52.815242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:52.816670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:52.888650 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef21101-6dd1-4a74-b225-8f9c6f393fff admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:52.897418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241bb94-b292-4c0a-9c3f-46e94640658d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:52.898515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241bb94-b292-4c0a-9c3f-46e94640658d service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:52.899950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241bb94-b292-4c0a-9c3f-46e94640658d service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:52.900436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241bb94-b292-4c0a-9c3f-46e94640658d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:52.917973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241bb94-b292-4c0a-9c3f-46e94640658d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:52.919989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241bb94-b292-4c0a-9c3f-46e94640658d service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:52.934395 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1108/2225] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:53.300978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:53.688893 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa0fe3-e1a5-49c1-88b8-278e205631a1 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:53.692494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a9fa0fe3-e1a5-49c1-88b8-278e205631a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:53.726456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa0fe3-e1a5-49c1-88b8-278e205631a1 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:53.733027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:53.733720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:53.734008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:53.734282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] PATH_INFO: `/v3/projects/13ef2e0cd4214b87a80a6be408e72368` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:53.736625 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ef2e0cd4214b87a80a6be408e72368)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:53.738786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:53.761040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241bb94-b292-4c0a-9c3f-46e94640658d service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:53.763829 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f241bb94-b292-4c0a-9c3f-46e94640658d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:53.829675 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241bb94-b292-4c0a-9c3f-46e94640658d service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:53.833476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545699c-a7be-4d7a-8eeb-b51dfbe43db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:53.834116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545699c-a7be-4d7a-8eeb-b51dfbe43db0 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:53.834399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545699c-a7be-4d7a-8eeb-b51dfbe43db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:53.834720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545699c-a7be-4d7a-8eeb-b51dfbe43db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:53.836482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6545699c-a7be-4d7a-8eeb-b51dfbe43db0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:53.912034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ef2e0cd4214b87a80a6be408e72368', 'request_id': 'req-acbd0c84-b037-4e34-9e61-59f5b5e24783'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:53.915161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545699c-a7be-4d7a-8eeb-b51dfbe43db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:53.916923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545699c-a7be-4d7a-8eeb-b51dfbe43db0 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:53.927731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1109/2226] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:37:54.047963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ef2e0cd4214b87a80a6be408e72368', 'request_id': 'req-acbd0c84-b037-4e34-9e61-59f5b5e24783'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:54.056834 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ef2e0cd4214b87a80a6be408e72368', 'request_id': 'req-acbd0c84-b037-4e34-9e61-59f5b5e24783'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:54.069683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] The token cache is being invalidate because project 13ef2e0cd4214b87a80a6be408e72368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:54.069976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:54.070815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-acbd0c84-b037-4e34-9e61-59f5b5e24783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:54.072616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1118/2227] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:53 2022] DELETE /identity/v3/projects/13ef2e0cd4214b87a80a6be408e72368 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:54.080788 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545699c-a7be-4d7a-8eeb-b51dfbe43db0 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:54.092128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545699c-a7be-4d7a-8eeb-b51dfbe43db0 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:54.159519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:54.160239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:54.160573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:54.160902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] PATH_INFO: `/v3/users/d4c8af9c51ec4ca388e9763c0b61dce1` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:54.162257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c8af9c51ec4ca388e9763c0b61dce1)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:54.164285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:54.456579 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c8af9c51ec4ca388e9763c0b61dce1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:54.537448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c8af9c51ec4ca388e9763c0b61dce1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:54.554566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c8af9c51ec4ca388e9763c0b61dce1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:54.563344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c8af9c51ec4ca388e9763c0b61dce1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:54.564211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c8af9c51ec4ca388e9763c0b61dce1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:54.571930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1110/2228] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:37:54 2022] DELETE /identity/v3/users/d4c8af9c51ec4ca388e9763c0b61dce1 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:54.635174 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01bb2-0cae-41fa-bed6-4d85f14522c0 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:54.635174 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01bb2-0cae-41fa-bed6-4d85f14522c0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:54.635174 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01bb2-0cae-41fa-bed6-4d85f14522c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:54.659774 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-62c01bb2-0cae-41fa-bed6-4d85f14522c0 None None] MFA Rules not processed for user `af6b2c3b389c4fecad11a78ebf526b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:54.661158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-62c01bb2-0cae-41fa-bed6-4d85f14522c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:54.737291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1119/2229] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:54.910694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:55.198497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:55.201179 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:55.301566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:55.310275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143ec74-6b93-4595-9baf-912c174e12a6 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:55.316149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:55.317407 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:55.317954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:55.318939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] PATH_INFO: `/v3/projects/fe5677224eec4756ae4dcd2065d3f8cb` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:55.320926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5677224eec4756ae4dcd2065d3f8cb)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:55.325075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:55.625266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5677224eec4756ae4dcd2065d3f8cb', 'request_id': 'req-7e505050-cb71-4f3a-b014-530e215371eb'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:55.635611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5677224eec4756ae4dcd2065d3f8cb', 'request_id': 'req-7e505050-cb71-4f3a-b014-530e215371eb'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:55.644402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5677224eec4756ae4dcd2065d3f8cb', 'request_id': 'req-7e505050-cb71-4f3a-b014-530e215371eb'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:55.776000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] The token cache is being invalidate because project fe5677224eec4756ae4dcd2065d3f8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:37:55.776505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:55.778180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7e505050-cb71-4f3a-b014-530e215371eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:37:55.780884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1111/2230] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:37:55 2022] DELETE /identity/v3/projects/fe5677224eec4756ae4dcd2065d3f8cb => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:55.792025 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070ae4-3983-42e3-a25b-3f9e2444590b None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:55.793246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070ae4-3983-42e3-a25b-3f9e2444590b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:55.793569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070ae4-3983-42e3-a25b-3f9e2444590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:55.831313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2e070ae4-3983-42e3-a25b-3f9e2444590b None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:55.834422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2e070ae4-3983-42e3-a25b-3f9e2444590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:55.941629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1120/2231] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:55.952333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48426b3-b7e4-45fc-b6e8-b5670b9b5fac None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:55.952815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48426b3-b7e4-45fc-b6e8-b5670b9b5fac None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:55.953200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48426b3-b7e4-45fc-b6e8-b5670b9b5fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:55.995068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-a48426b3-b7e4-45fc-b6e8-b5670b9b5fac None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:55.999359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a48426b3-b7e4-45fc-b6e8-b5670b9b5fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:56.030372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1112/2232] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:37:56.040099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e070ae4-3983-42e3-a25b-3f9e2444590b None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:56.065685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e070ae4-3983-42e3-a25b-3f9e2444590b None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:56.084670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb8e0-f9e1-46ec-9945-1eef9ff15766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:56.092094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb8e0-f9e1-46ec-9945-1eef9ff15766 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:56.092540 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb8e0-f9e1-46ec-9945-1eef9ff15766 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:56.093272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfb8e0-f9e1-46ec-9945-1eef9ff15766 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:56.105973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfb8e0-f9e1-46ec-9945-1eef9ff15766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:37:56.110173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfb8e0-f9e1-46ec-9945-1eef9ff15766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:56.112437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfb8e0-f9e1-46ec-9945-1eef9ff15766 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:56.123523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48426b3-b7e4-45fc-b6e8-b5670b9b5fac None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:56.125965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a48426b3-b7e4-45fc-b6e8-b5670b9b5fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:56.130774 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1121/2233] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:37:56.156898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb8e0-f9e1-46ec-9945-1eef9ff15766 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:56.176195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfb8e0-f9e1-46ec-9945-1eef9ff15766 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:56.182956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2160bfc-ba02-4f8e-b3b2-0fafe1103c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:56.190133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2160bfc-ba02-4f8e-b3b2-0fafe1103c0d admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:56.190482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2160bfc-ba02-4f8e-b3b2-0fafe1103c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:56.190746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2160bfc-ba02-4f8e-b3b2-0fafe1103c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:56.191503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2160bfc-ba02-4f8e-b3b2-0fafe1103c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:56.193958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2160bfc-ba02-4f8e-b3b2-0fafe1103c0d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:56.245049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48426b3-b7e4-45fc-b6e8-b5670b9b5fac None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:56.250486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b939685-e5b1-4971-9d54-608ed4769d43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:56.251188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b939685-e5b1-4971-9d54-608ed4769d43 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:56.251475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b939685-e5b1-4971-9d54-608ed4769d43 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:56.251752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b939685-e5b1-4971-9d54-608ed4769d43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:56.253884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6b939685-e5b1-4971-9d54-608ed4769d43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:56.337271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1122/2234] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:37:56 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:37:56.337420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b939685-e5b1-4971-9d54-608ed4769d43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:56.338308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2160bfc-ba02-4f8e-b3b2-0fafe1103c0d admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:56.338899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b939685-e5b1-4971-9d54-608ed4769d43 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:56.350532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1113/2235] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:56.428067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2160bfc-ba02-4f8e-b3b2-0fafe1103c0d admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:56.432956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb856e-db56-4d3b-ae91-f5afd86a5339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:56.434184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb856e-db56-4d3b-ae91-f5afd86a5339 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:56.434504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb856e-db56-4d3b-ae91-f5afd86a5339 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:56.434755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb856e-db56-4d3b-ae91-f5afd86a5339 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:56.435634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb856e-db56-4d3b-ae91-f5afd86a5339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:56.437645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb856e-db56-4d3b-ae91-f5afd86a5339 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:56.584397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1123/2236] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:37:56 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:37:56.588673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b939685-e5b1-4971-9d54-608ed4769d43 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:56.600190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b939685-e5b1-4971-9d54-608ed4769d43 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:56.607128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3d963-f3a1-4077-a690-2b39b4676cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:56.607755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3d963-f3a1-4077-a690-2b39b4676cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:56.608035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3d963-f3a1-4077-a690-2b39b4676cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:56.608313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3d963-f3a1-4077-a690-2b39b4676cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:56.608967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3d963-f3a1-4077-a690-2b39b4676cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:56.610720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3d963-f3a1-4077-a690-2b39b4676cb1 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:56.624437 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1114/2237] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:56.631262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb856e-db56-4d3b-ae91-f5afd86a5339 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:56.642749 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb856e-db56-4d3b-ae91-f5afd86a5339 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:56.648868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e472d-0d0a-40a2-892a-47f59cf61e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:56.649487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e472d-0d0a-40a2-892a-47f59cf61e15 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:56.649971 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e472d-0d0a-40a2-892a-47f59cf61e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:56.650353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e472d-0d0a-40a2-892a-47f59cf61e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:56.650928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e472d-0d0a-40a2-892a-47f59cf61e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:56.652599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e472d-0d0a-40a2-892a-47f59cf61e15 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:56.664580 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1124/2238] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:37:56.669490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3d963-f3a1-4077-a690-2b39b4676cb1 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:56.680028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3d963-f3a1-4077-a690-2b39b4676cb1 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:56.686880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a96cd5-8b3c-491a-a3a8-f9e499f83067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:56.687557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a96cd5-8b3c-491a-a3a8-f9e499f83067 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:56.687841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a96cd5-8b3c-491a-a3a8-f9e499f83067 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:56.688122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a96cd5-8b3c-491a-a3a8-f9e499f83067 admin admin] PATH_INFO: `/v3/projects/97844f7f01f84ea783934679e06fcc6d/users/6b6d1a074caf4b6c87adc5ab0dfb6ca3/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:56.707292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a96cd5-8b3c-491a-a3a8-f9e499f83067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97844f7f01f84ea783934679e06fcc6d, user_id=6b6d1a074caf4b6c87adc5ab0dfb6ca3, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:56.710077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a96cd5-8b3c-491a-a3a8-f9e499f83067 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:56.863362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1115/2239] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:37:56 2022] PUT /identity/v3/projects/97844f7f01f84ea783934679e06fcc6d/users/6b6d1a074caf4b6c87adc5ab0dfb6ca3/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:37:56.873972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065915-851a-4d45-bc75-14d4d282b8ed None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:56.874739 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065915-851a-4d45-bc75-14d4d282b8ed None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:56.874879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83065915-851a-4d45-bc75-14d4d282b8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:56.911667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-83065915-851a-4d45-bc75-14d4d282b8ed None None] MFA Rules not processed for user `6b6d1a074caf4b6c87adc5ab0dfb6ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:37:56.913332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-83065915-851a-4d45-bc75-14d4d282b8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:56.992149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1125/2240] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:37:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:37:56.994732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:57.006840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a96cd5-8b3c-491a-a3a8-f9e499f83067 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:37:57.006840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-09a96cd5-8b3c-491a-a3a8-f9e499f83067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:37:57.046304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:37:57.101770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a96cd5-8b3c-491a-a3a8-f9e499f83067 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:37:57.106022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d921e-2772-4236-a767-83868a4a07d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8590378b14c49cf9266a0d859db5bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:37:57.106671 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d921e-2772-4236-a767-83868a4a07d1 service glance] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:37:57.106958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d921e-2772-4236-a767-83868a4a07d1 service glance] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:37:57.107232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d921e-2772-4236-a767-83868a4a07d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:37:57.116077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d921e-2772-4236-a767-83868a4a07d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:37:57.117517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d921e-2772-4236-a767-83868a4a07d1 service glance] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:37:57.127204 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1116/2241] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:37:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:37:59.084147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:00.264865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:02.150248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:03.468254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:03.569136 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83065915-851a-4d45-bc75-14d4d282b8ed None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:03.570823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-83065915-851a-4d45-bc75-14d4d282b8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:03.681976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83065915-851a-4d45-bc75-14d4d282b8ed None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:03.689828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:03.691018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:03.691532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:03.692049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] PATH_INFO: `/v3/users/d50abbe2a2fe496aa68bb2107319524f` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:03.694371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50abbe2a2fe496aa68bb2107319524f)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:03.697212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:03.966272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50abbe2a2fe496aa68bb2107319524f'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:03.982832 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50abbe2a2fe496aa68bb2107319524f'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:03.991358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50abbe2a2fe496aa68bb2107319524f'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:04.100184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50abbe2a2fe496aa68bb2107319524f'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:04.100823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50abbe2a2fe496aa68bb2107319524f'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:04.109768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1126/2242] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:38:03 2022] DELETE /identity/v3/users/d50abbe2a2fe496aa68bb2107319524f => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:04.112764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353645b-6217-49dc-90ce-9f3b14eec174 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:04.113465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353645b-6217-49dc-90ce-9f3b14eec174 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:04.113465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353645b-6217-49dc-90ce-9f3b14eec174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:04.134826 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-f353645b-6217-49dc-90ce-9f3b14eec174 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:04.136753 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f353645b-6217-49dc-90ce-9f3b14eec174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:04.211392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1117/2243] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:04.224603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:04.227183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:04.305923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958288c-6c18-4235-aea2-2d5c9bb6b0ca admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:04.310597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1413-c540-481e-a38c-9a061223aff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:04.311218 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1413-c540-481e-a38c-9a061223aff3 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:04.311500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1413-c540-481e-a38c-9a061223aff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:04.311775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1413-c540-481e-a38c-9a061223aff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:04.322128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c1413-c540-481e-a38c-9a061223aff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:04.323609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c1413-c540-481e-a38c-9a061223aff3 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:04.334955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1127/2244] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:38:04.967240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353645b-6217-49dc-90ce-9f3b14eec174 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:04.970060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f353645b-6217-49dc-90ce-9f3b14eec174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:04.990830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353645b-6217-49dc-90ce-9f3b14eec174 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:04.996873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:04.997732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:04.998116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:04.998480 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] PATH_INFO: `/v3/projects/809b030f26e2445b9ed9d4e862310755` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:05.000283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] RBAC: Authorizing `identity:delete_project(project_id=809b030f26e2445b9ed9d4e862310755)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:05.006587 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:05.211740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809b030f26e2445b9ed9d4e862310755', 'request_id': 'req-644274ff-f41f-421e-abe8-88fff351e04d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:05.219120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809b030f26e2445b9ed9d4e862310755', 'request_id': 'req-644274ff-f41f-421e-abe8-88fff351e04d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:05.227174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809b030f26e2445b9ed9d4e862310755', 'request_id': 'req-644274ff-f41f-421e-abe8-88fff351e04d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:05.254328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:05.354253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] The token cache is being invalidate because project 809b030f26e2445b9ed9d4e862310755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:38:05.354544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:05.355790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:05.357333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1118/2245] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:38:04 2022] DELETE /identity/v3/projects/809b030f26e2445b9ed9d4e862310755 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:38:05.361900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1413-c540-481e-a38c-9a061223aff3 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:05.373527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1413-c540-481e-a38c-9a061223aff3 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:05.453514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:05.454856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:05.455275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:05.460687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] PATH_INFO: `/v3/users/7e38f0dad6ce4311a77862b34db03b5f` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:05.460687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e38f0dad6ce4311a77862b34db03b5f)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:05.460687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:05.769231 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e38f0dad6ce4311a77862b34db03b5f'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:05.789432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e38f0dad6ce4311a77862b34db03b5f'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:05.803209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e38f0dad6ce4311a77862b34db03b5f'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:05.968479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e38f0dad6ce4311a77862b34db03b5f'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:05.969137 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e38f0dad6ce4311a77862b34db03b5f'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:05.981768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1128/2246] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:38:05 2022] DELETE /identity/v3/users/7e38f0dad6ce4311a77862b34db03b5f => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:06.549363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:06.772870 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:06.774439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:06.791304 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644274ff-f41f-421e-abe8-88fff351e04d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:06.871326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:06.872453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:06.872453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:06.872640 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] PATH_INFO: `/v3/projects/f1096a0bfdb44276bbedb73a47f89fff` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:06.873815 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1096a0bfdb44276bbedb73a47f89fff)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:06.875746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:07.139503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1096a0bfdb44276bbedb73a47f89fff', 'request_id': 'req-9dae4542-2bd4-4b99-89c2-3c435e43dd68'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:07.159971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1096a0bfdb44276bbedb73a47f89fff', 'request_id': 'req-9dae4542-2bd4-4b99-89c2-3c435e43dd68'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:07.170576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1096a0bfdb44276bbedb73a47f89fff', 'request_id': 'req-9dae4542-2bd4-4b99-89c2-3c435e43dd68'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:07.281243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] The token cache is being invalidate because project f1096a0bfdb44276bbedb73a47f89fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:38:07.286209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:07.286209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:07.286209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1119/2247] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:38:06 2022] DELETE /identity/v3/projects/f1096a0bfdb44276bbedb73a47f89fff => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:07.288872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:07.290319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:07.304774 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e3914-6ce4-417b-a47a-df3c68a1ffa7 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:07.381954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:07.382807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:07.383098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:07.383532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] PATH_INFO: `/v3/users/525f6876017147d8be13b6fcde4f2289` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:07.384745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=525f6876017147d8be13b6fcde4f2289)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:07.387346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:07.711989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525f6876017147d8be13b6fcde4f2289'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:07.748327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525f6876017147d8be13b6fcde4f2289'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:07.756850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525f6876017147d8be13b6fcde4f2289'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:07.936202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525f6876017147d8be13b6fcde4f2289'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:07.936202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525f6876017147d8be13b6fcde4f2289'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:07.936733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1129/2248] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:38:07 2022] DELETE /identity/v3/users/525f6876017147d8be13b6fcde4f2289 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:08.189779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:08.190670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:08.206836 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae4542-2bd4-4b99-89c2-3c435e43dd68 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:08.297568 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff5de-ef19-4710-9f21-c0a521f73441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:08.298270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff5de-ef19-4710-9f21-c0a521f73441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:08.298545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff5de-ef19-4710-9f21-c0a521f73441 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:08.298820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff5de-ef19-4710-9f21-c0a521f73441 admin admin] PATH_INFO: `/v3/users/27bdf2e33c1948139879b511aaffa372` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:08.299995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ff5de-ef19-4710-9f21-c0a521f73441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27bdf2e33c1948139879b511aaffa372)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:08.302028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ff5de-ef19-4710-9f21-c0a521f73441 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:08.520517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:08.522160 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:08.542658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd21c99-0724-4958-9ed7-894c540565eb admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:08.550009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:08.550009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:08.550009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:08.550009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] PATH_INFO: `/v3/projects/d63e845ad0a8441c8443f453c0ec9436` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:08.550597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63e845ad0a8441c8443f453c0ec9436)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:08.559152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:08.604792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-fe3ff5de-ef19-4710-9f21-c0a521f73441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27bdf2e33c1948139879b511aaffa372'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:08.773953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63e845ad0a8441c8443f453c0ec9436', 'request_id': 'req-116ca542-2c32-41d0-b944-68b04f522404'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:08.877527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-fe3ff5de-ef19-4710-9f21-c0a521f73441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27bdf2e33c1948139879b511aaffa372'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:08.906253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-fe3ff5de-ef19-4710-9f21-c0a521f73441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27bdf2e33c1948139879b511aaffa372'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:08.913506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-fe3ff5de-ef19-4710-9f21-c0a521f73441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27bdf2e33c1948139879b511aaffa372'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:08.914727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-fe3ff5de-ef19-4710-9f21-c0a521f73441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27bdf2e33c1948139879b511aaffa372'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:08.925100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1120/2249] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:38:08 2022] DELETE /identity/v3/users/27bdf2e33c1948139879b511aaffa372 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:08.932080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9c06-65f3-401c-9370-53f2581bd951 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:08.932080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9c06-65f3-401c-9370-53f2581bd951 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:08.933642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9c06-65f3-401c-9370-53f2581bd951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:08.963517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-71de9c06-65f3-401c-9370-53f2581bd951 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:08.964774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-71de9c06-65f3-401c-9370-53f2581bd951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:09.041437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63e845ad0a8441c8443f453c0ec9436', 'request_id': 'req-116ca542-2c32-41d0-b944-68b04f522404'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:09.054593 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63e845ad0a8441c8443f453c0ec9436', 'request_id': 'req-116ca542-2c32-41d0-b944-68b04f522404'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:09.059689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1121/2250] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:38:09.069843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] The token cache is being invalidate because project d63e845ad0a8441c8443f453c0ec9436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:38:09.070186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:09.071057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:09.071763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de9c06-65f3-401c-9370-53f2581bd951 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:09.076554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1130/2251] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:38:08 2022] DELETE /identity/v3/projects/d63e845ad0a8441c8443f453c0ec9436 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:38:09.083424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-71de9c06-65f3-401c-9370-53f2581bd951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:09.190170 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de9c06-65f3-401c-9370-53f2581bd951 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:09.220374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1e5ad-8f02-4a3c-90e4-6294ceca0d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:09.220374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1e5ad-8f02-4a3c-90e4-6294ceca0d1b service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:09.220374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1e5ad-8f02-4a3c-90e4-6294ceca0d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:09.220374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1e5ad-8f02-4a3c-90e4-6294ceca0d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:09.220800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b1d1e5ad-8f02-4a3c-90e4-6294ceca0d1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:09.224086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1e5ad-8f02-4a3c-90e4-6294ceca0d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:09.226490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1e5ad-8f02-4a3c-90e4-6294ceca0d1b service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:09.238640 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1122/2252] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:38:09.297615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:09.779452 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:09.781723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:09.890525 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ca542-2c32-41d0-b944-68b04f522404 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:09.905347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:09.906511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:09.906804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:09.907248 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] PATH_INFO: `/v3/projects/f454504491ce483d91ae9309c5f112ce` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:09.908714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f454504491ce483d91ae9309c5f112ce)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:09.911347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:10.123623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f454504491ce483d91ae9309c5f112ce', 'request_id': 'req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:10.325029 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f454504491ce483d91ae9309c5f112ce', 'request_id': 'req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:10.338446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f454504491ce483d91ae9309c5f112ce', 'request_id': 'req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:10.367737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] The token cache is being invalidate because project f454504491ce483d91ae9309c5f112ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:38:10.368297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:10.369229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:10.372605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1131/2253] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:38:09 2022] DELETE /identity/v3/projects/f454504491ce483d91ae9309c5f112ce => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:10.375728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1e5ad-8f02-4a3c-90e4-6294ceca0d1b service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:10.388370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1e5ad-8f02-4a3c-90e4-6294ceca0d1b service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:10.460496 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1baef0-fe92-4135-8021-ea9cabb77136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:10.461136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1baef0-fe92-4135-8021-ea9cabb77136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:10.461541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1baef0-fe92-4135-8021-ea9cabb77136 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:10.461855 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1baef0-fe92-4135-8021-ea9cabb77136 admin admin] PATH_INFO: `/v3/users/814ba749810e42f1b7f2f4356c5a7983` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:10.462991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1baef0-fe92-4135-8021-ea9cabb77136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814ba749810e42f1b7f2f4356c5a7983)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:10.464930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1baef0-fe92-4135-8021-ea9cabb77136 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:10.727390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-1c1baef0-fe92-4135-8021-ea9cabb77136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814ba749810e42f1b7f2f4356c5a7983'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:10.858089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-1c1baef0-fe92-4135-8021-ea9cabb77136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814ba749810e42f1b7f2f4356c5a7983'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:10.879640 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-1c1baef0-fe92-4135-8021-ea9cabb77136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814ba749810e42f1b7f2f4356c5a7983'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:10.892037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-1c1baef0-fe92-4135-8021-ea9cabb77136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814ba749810e42f1b7f2f4356c5a7983'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:10.893959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-1c1baef0-fe92-4135-8021-ea9cabb77136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814ba749810e42f1b7f2f4356c5a7983'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:10.913351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1123/2254] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:38:10 2022] DELETE /identity/v3/users/814ba749810e42f1b7f2f4356c5a7983 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:11.570656 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:11.572745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:11.588448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500a94c-3021-4c6c-877b-fd4ac1c8b31b admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:11.653734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:11.654602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:11.654740 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:11.654953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] PATH_INFO: `/v3/projects/5bcea9e3873b4b85bb0978fd892f847a` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:11.656108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bcea9e3873b4b85bb0978fd892f847a)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:11.658116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:11.685980 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:11.842453 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bcea9e3873b4b85bb0978fd892f847a', 'request_id': 'req-a78a841b-975e-4d7a-b580-9eca8f2533b0'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:12.016599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bcea9e3873b4b85bb0978fd892f847a', 'request_id': 'req-a78a841b-975e-4d7a-b580-9eca8f2533b0'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:12.023185 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bcea9e3873b4b85bb0978fd892f847a', 'request_id': 'req-a78a841b-975e-4d7a-b580-9eca8f2533b0'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:12.037105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] The token cache is being invalidate because project 5bcea9e3873b4b85bb0978fd892f847a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:38:12.037412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:12.038110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a78a841b-975e-4d7a-b580-9eca8f2533b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:12.039657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1132/2255] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:38:11 2022] DELETE /identity/v3/projects/5bcea9e3873b4b85bb0978fd892f847a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:12.044960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795242ac-8bc0-4633-9dc7-689fd7dd9e21 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:12.045481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795242ac-8bc0-4633-9dc7-689fd7dd9e21 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:12.045481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795242ac-8bc0-4633-9dc7-689fd7dd9e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:12.066147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-795242ac-8bc0-4633-9dc7-689fd7dd9e21 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:12.067391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-795242ac-8bc0-4633-9dc7-689fd7dd9e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:12.137108 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1124/2256] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:12.145032 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a8c1a-e5b3-4d3a-a474-ec5094709efe None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:12.164509 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a8c1a-e5b3-4d3a-a474-ec5094709efe None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:12.164509 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a8c1a-e5b3-4d3a-a474-ec5094709efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:12.171092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ea2a8c1a-e5b3-4d3a-a474-ec5094709efe None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:12.172342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ea2a8c1a-e5b3-4d3a-a474-ec5094709efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:12.180484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1133/2257] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:12.186028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795242ac-8bc0-4633-9dc7-689fd7dd9e21 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:12.199130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795242ac-8bc0-4633-9dc7-689fd7dd9e21 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:12.204392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81375d-051d-445d-a95e-35cf8402e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:12.205501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81375d-051d-445d-a95e-35cf8402e0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:12.206106 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81375d-051d-445d-a95e-35cf8402e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:12.206290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81375d-051d-445d-a95e-35cf8402e0a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:12.206877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81375d-051d-445d-a95e-35cf8402e0a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:38:12.207181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81375d-051d-445d-a95e-35cf8402e0a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:12.209250 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81375d-051d-445d-a95e-35cf8402e0a3 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:12.224662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1125/2258] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:38:12.229339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a8c1a-e5b3-4d3a-a474-ec5094709efe None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:12.246250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a8c1a-e5b3-4d3a-a474-ec5094709efe None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:12.255714 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbd79f-eebe-4f1a-abce-5ede931349e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:12.260131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd79f-eebe-4f1a-abce-5ede931349e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:12.262070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd79f-eebe-4f1a-abce-5ede931349e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:12.262070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbd79f-eebe-4f1a-abce-5ede931349e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:12.263651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbd79f-eebe-4f1a-abce-5ede931349e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:12.265694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbd79f-eebe-4f1a-abce-5ede931349e5 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:12.382569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1134/2259] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:38:12 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:38:12.387157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81375d-051d-445d-a95e-35cf8402e0a3 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:12.397924 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81375d-051d-445d-a95e-35cf8402e0a3 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:12.470103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb72504-9b82-49e9-b106-55fed7da944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:12.470980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb72504-9b82-49e9-b106-55fed7da944f admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:12.471325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb72504-9b82-49e9-b106-55fed7da944f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:12.471808 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb72504-9b82-49e9-b106-55fed7da944f admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:12.472450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb72504-9b82-49e9-b106-55fed7da944f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:12.474423 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb72504-9b82-49e9-b106-55fed7da944f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:12.613253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1126/2260] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:38:12 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:38:12.618996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbd79f-eebe-4f1a-abce-5ede931349e5 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:12.631125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbd79f-eebe-4f1a-abce-5ede931349e5 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:12.636191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47eba-8a2d-4d40-9408-9ef0de0d64ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:12.636818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47eba-8a2d-4d40-9408-9ef0de0d64ea admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:12.637098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47eba-8a2d-4d40-9408-9ef0de0d64ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:12.637437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47eba-8a2d-4d40-9408-9ef0de0d64ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:12.638098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a47eba-8a2d-4d40-9408-9ef0de0d64ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:12.639720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a47eba-8a2d-4d40-9408-9ef0de0d64ea admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:12.652817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1135/2261] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:38:12.656123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb72504-9b82-49e9-b106-55fed7da944f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:12.666673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb72504-9b82-49e9-b106-55fed7da944f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:12.672338 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d305806-6e2a-4771-9b99-b25a04167c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:12.672957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305806-6e2a-4771-9b99-b25a04167c54 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:12.673238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305806-6e2a-4771-9b99-b25a04167c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:12.673515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305806-6e2a-4771-9b99-b25a04167c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:12.674201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d305806-6e2a-4771-9b99-b25a04167c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:12.675957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d305806-6e2a-4771-9b99-b25a04167c54 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:12.688370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1127/2262] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:38:12.692806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47eba-8a2d-4d40-9408-9ef0de0d64ea admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:12.707718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47eba-8a2d-4d40-9408-9ef0de0d64ea admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:12.713498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5da1e6-05cb-4aa4-b709-08ff0af323de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:12.715631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da1e6-05cb-4aa4-b709-08ff0af323de admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:12.715631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da1e6-05cb-4aa4-b709-08ff0af323de admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:12.715631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da1e6-05cb-4aa4-b709-08ff0af323de admin admin] PATH_INFO: `/v3/projects/7370f926724c489eb6f4b79d407815db/users/e0115439a66d4e8c80f5f93c066fc420/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:12.737671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5da1e6-05cb-4aa4-b709-08ff0af323de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7370f926724c489eb6f4b79d407815db, user_id=e0115439a66d4e8c80f5f93c066fc420, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:12.740433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5da1e6-05cb-4aa4-b709-08ff0af323de admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:12.897702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1136/2263] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:38:12 2022] PUT /identity/v3/projects/7370f926724c489eb6f4b79d407815db/users/e0115439a66d4e8c80f5f93c066fc420/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:12.916810 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2468b0-5d31-43f9-96e5-44b79340e0d5 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:12.917659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2468b0-5d31-43f9-96e5-44b79340e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:12.918015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2468b0-5d31-43f9-96e5-44b79340e0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:12.970667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-5d2468b0-5d31-43f9-96e5-44b79340e0d5 None None] MFA Rules not processed for user `e0115439a66d4e8c80f5f93c066fc420`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:12.970667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5d2468b0-5d31-43f9-96e5-44b79340e0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:13.023510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1128/2264] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:13.028810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5da1e6-05cb-4aa4-b709-08ff0af323de admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:13.098750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5da1e6-05cb-4aa4-b709-08ff0af323de admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:13.109095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d28fae-3b98-42c8-95d1-ca7a60226f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:13.109758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d28fae-3b98-42c8-95d1-ca7a60226f77 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:13.110042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d28fae-3b98-42c8-95d1-ca7a60226f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:13.110314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d28fae-3b98-42c8-95d1-ca7a60226f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:13.110958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d28fae-3b98-42c8-95d1-ca7a60226f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:13.112894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d28fae-3b98-42c8-95d1-ca7a60226f77 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:13.265811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1137/2265] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:38:13 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:38:13.271902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2468b0-5d31-43f9-96e5-44b79340e0d5 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:13.279007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2468b0-5d31-43f9-96e5-44b79340e0d5 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:13.354757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d11a69-2637-441a-8f07-a3f7bd4091b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:13.356185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11a69-2637-441a-8f07-a3f7bd4091b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:13.356185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11a69-2637-441a-8f07-a3f7bd4091b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:13.356185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11a69-2637-441a-8f07-a3f7bd4091b4 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:13.356560 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d11a69-2637-441a-8f07-a3f7bd4091b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:13.358482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d11a69-2637-441a-8f07-a3f7bd4091b4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:13.529931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1129/2266] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:38:13 2022] POST /identity/v3/users => generated 298 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:38:13.548502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d28fae-3b98-42c8-95d1-ca7a60226f77 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:13.563232 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d28fae-3b98-42c8-95d1-ca7a60226f77 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:13.568841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6aeaca-e597-45ed-b55c-af4eb2889b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:13.569610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aeaca-e597-45ed-b55c-af4eb2889b48 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:13.570002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aeaca-e597-45ed-b55c-af4eb2889b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:13.570387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aeaca-e597-45ed-b55c-af4eb2889b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:13.571130 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6aeaca-e597-45ed-b55c-af4eb2889b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:13.572871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6aeaca-e597-45ed-b55c-af4eb2889b48 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:13.588998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1138/2267] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:38:13.598445 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d11a69-2637-441a-8f07-a3f7bd4091b4 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:13.617244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d11a69-2637-441a-8f07-a3f7bd4091b4 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:13.617244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb391f-c165-49c0-871e-9aa74a6d593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:13.617244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb391f-c165-49c0-871e-9aa74a6d593e admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:13.617244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb391f-c165-49c0-871e-9aa74a6d593e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:13.617789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb391f-c165-49c0-871e-9aa74a6d593e admin admin] PATH_INFO: `/v3/projects/cced48829bc548e0a26a91c7dfa6a006/users/628a3efd706f48c7afe6dfd1b1c82c4e/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:13.633984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb391f-c165-49c0-871e-9aa74a6d593e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cced48829bc548e0a26a91c7dfa6a006, user_id=628a3efd706f48c7afe6dfd1b1c82c4e, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:13.638110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb391f-c165-49c0-871e-9aa74a6d593e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:13.963785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1130/2268] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:38:13 2022] PUT /identity/v3/projects/cced48829bc548e0a26a91c7dfa6a006/users/628a3efd706f48c7afe6dfd1b1c82c4e/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:13.968037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6aeaca-e597-45ed-b55c-af4eb2889b48 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:13.982052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6aeaca-e597-45ed-b55c-af4eb2889b48 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:14.051972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39056ad-0a7a-45f2-9453-cd78ae1f8f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:14.052600 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39056ad-0a7a-45f2-9453-cd78ae1f8f26 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:14.052886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39056ad-0a7a-45f2-9453-cd78ae1f8f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:14.053167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39056ad-0a7a-45f2-9453-cd78ae1f8f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:14.053860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39056ad-0a7a-45f2-9453-cd78ae1f8f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:14.055589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39056ad-0a7a-45f2-9453-cd78ae1f8f26 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:14.068314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1139/2269] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:38:14.073475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb391f-c165-49c0-871e-9aa74a6d593e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:14.084169 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb391f-c165-49c0-871e-9aa74a6d593e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:14.088769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe343aa5-750f-43ff-b830-eac003ad3bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:14.089507 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343aa5-750f-43ff-b830-eac003ad3bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:14.089825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343aa5-750f-43ff-b830-eac003ad3bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:14.090102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343aa5-750f-43ff-b830-eac003ad3bbc admin admin] PATH_INFO: `/v3/projects/cced48829bc548e0a26a91c7dfa6a006/users/628a3efd706f48c7afe6dfd1b1c82c4e/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:14.092301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe343aa5-750f-43ff-b830-eac003ad3bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cced48829bc548e0a26a91c7dfa6a006, user_id=628a3efd706f48c7afe6dfd1b1c82c4e, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:14.095156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe343aa5-750f-43ff-b830-eac003ad3bbc admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:14.107698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1131/2270] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:38:14 2022] PUT /identity/v3/projects/cced48829bc548e0a26a91c7dfa6a006/users/628a3efd706f48c7afe6dfd1b1c82c4e/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:38:14.124339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a059a3-f3d0-4995-ad3b-6f7289768b57 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:14.125121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a059a3-f3d0-4995-ad3b-6f7289768b57 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:14.125305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a059a3-f3d0-4995-ad3b-6f7289768b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:14.184531 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-69a059a3-f3d0-4995-ad3b-6f7289768b57 None None] MFA Rules not processed for user `628a3efd706f48c7afe6dfd1b1c82c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:14.185837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-69a059a3-f3d0-4995-ad3b-6f7289768b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:14.265765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1140/2271] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:14.277782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe343aa5-750f-43ff-b830-eac003ad3bbc admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:14.279453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-fe343aa5-750f-43ff-b830-eac003ad3bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:14.359185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe343aa5-750f-43ff-b830-eac003ad3bbc admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:14.363398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282280-942e-4939-8a6f-460a91d9eb55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:14.364046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282280-942e-4939-8a6f-460a91d9eb55 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:14.364325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282280-942e-4939-8a6f-460a91d9eb55 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:14.364602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8282280-942e-4939-8a6f-460a91d9eb55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:14.437398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8282280-942e-4939-8a6f-460a91d9eb55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:14.438929 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8282280-942e-4939-8a6f-460a91d9eb55 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:14.452392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1132/2272] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:38:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:38:14.857729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:16.643563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:18.019942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:18.991382 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:20.626984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:20.823496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152825-5657-421f-98f5-e4987b71e299 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:20.824823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152825-5657-421f-98f5-e4987b71e299 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:20.825169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152825-5657-421f-98f5-e4987b71e299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:20.852891 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a3152825-5657-421f-98f5-e4987b71e299 None None] MFA Rules not processed for user `7529bc6957284314b72d0bc10c4f7088`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:20.856211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a3152825-5657-421f-98f5-e4987b71e299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:20.954544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1141/2273] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:21.777150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:23.237711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:23.647409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282280-942e-4939-8a6f-460a91d9eb55 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:23.648864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a8282280-942e-4939-8a6f-460a91d9eb55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:23.662834 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8282280-942e-4939-8a6f-460a91d9eb55 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:23.668020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c1c30-23a9-4598-b855-02793a10c946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:23.668643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c1c30-23a9-4598-b855-02793a10c946 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:23.669110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c1c30-23a9-4598-b855-02793a10c946 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:23.669596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c1c30-23a9-4598-b855-02793a10c946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:23.680613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c1c30-23a9-4598-b855-02793a10c946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:23.683224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c1c30-23a9-4598-b855-02793a10c946 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:23.694553 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1133/2274] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:38:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:38:24.091353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:25.355082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:25.458108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:26.439723 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:27.034682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:27.493828 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:29.645773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:30.132417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:31.485303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:31.582648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3152825-5657-421f-98f5-e4987b71e299 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:31.708904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3152825-5657-421f-98f5-e4987b71e299 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:31.717051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:31.718259 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:31.718259 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:31.718548 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] PATH_INFO: `/v3/users/e0115439a66d4e8c80f5f93c066fc420` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:31.727470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0115439a66d4e8c80f5f93c066fc420)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:31.729565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:32.183708 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0115439a66d4e8c80f5f93c066fc420'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:32.196495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0115439a66d4e8c80f5f93c066fc420'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:32.206017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0115439a66d4e8c80f5f93c066fc420'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:32.331614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0115439a66d4e8c80f5f93c066fc420'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:32.332359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0115439a66d4e8c80f5f93c066fc420'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:32.345247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1142/2275] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:38:31 2022] DELETE /identity/v3/users/e0115439a66d4e8c80f5f93c066fc420 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:32.346948 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f7920-04c4-4c30-89e5-4f3ebb4b9686 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:32.347265 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f7920-04c4-4c30-89e5-4f3ebb4b9686 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:32.347538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f7920-04c4-4c30-89e5-4f3ebb4b9686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:32.379634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-6a5f7920-04c4-4c30-89e5-4f3ebb4b9686 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:32.381051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6a5f7920-04c4-4c30-89e5-4f3ebb4b9686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:32.446006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1134/2276] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:32.457040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:32.459164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:32.534899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4165a-5b60-47a9-a644-8d1cc0cb823d admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:32.538737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c6b22-6efa-407e-b76a-c5c4ba5ca148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:32.539481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6b22-6efa-407e-b76a-c5c4ba5ca148 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:32.539620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6b22-6efa-407e-b76a-c5c4ba5ca148 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:32.540494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6b22-6efa-407e-b76a-c5c4ba5ca148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:32.551245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c6b22-6efa-407e-b76a-c5c4ba5ca148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:32.552834 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c6b22-6efa-407e-b76a-c5c4ba5ca148 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:32.563635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1143/2277] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:38:32.588906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:32.708642 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:33.207976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f7920-04c4-4c30-89e5-4f3ebb4b9686 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:33.209730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6a5f7920-04c4-4c30-89e5-4f3ebb4b9686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:33.223086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f7920-04c4-4c30-89e5-4f3ebb4b9686 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:33.227738 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:33.228396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:33.228689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:33.229173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] PATH_INFO: `/v3/projects/7370f926724c489eb6f4b79d407815db` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:33.230164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7370f926724c489eb6f4b79d407815db)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:33.232095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:33.428510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7370f926724c489eb6f4b79d407815db', 'request_id': 'req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:33.434271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7370f926724c489eb6f4b79d407815db', 'request_id': 'req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:33.440466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7370f926724c489eb6f4b79d407815db', 'request_id': 'req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:33.547881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] The token cache is being invalidate because project 7370f926724c489eb6f4b79d407815db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:38:33.548182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:33.548848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:33.550515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1135/2278] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:38:33 2022] DELETE /identity/v3/projects/7370f926724c489eb6f4b79d407815db => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:33.557898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c6b22-6efa-407e-b76a-c5c4ba5ca148 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:33.570180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c6b22-6efa-407e-b76a-c5c4ba5ca148 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:33.641178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430de800-a8d8-4e73-a0f7-0405b8415767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:33.641861 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430de800-a8d8-4e73-a0f7-0405b8415767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:33.642148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430de800-a8d8-4e73-a0f7-0405b8415767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:33.643051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430de800-a8d8-4e73-a0f7-0405b8415767 admin admin] PATH_INFO: `/v3/users/628a3efd706f48c7afe6dfd1b1c82c4e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:33.643576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430de800-a8d8-4e73-a0f7-0405b8415767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=628a3efd706f48c7afe6dfd1b1c82c4e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:33.645533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430de800-a8d8-4e73-a0f7-0405b8415767 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:34.016546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-430de800-a8d8-4e73-a0f7-0405b8415767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '628a3efd706f48c7afe6dfd1b1c82c4e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:34.040569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-430de800-a8d8-4e73-a0f7-0405b8415767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '628a3efd706f48c7afe6dfd1b1c82c4e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:34.055558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-430de800-a8d8-4e73-a0f7-0405b8415767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '628a3efd706f48c7afe6dfd1b1c82c4e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:34.154118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-430de800-a8d8-4e73-a0f7-0405b8415767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '628a3efd706f48c7afe6dfd1b1c82c4e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:34.155242 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-430de800-a8d8-4e73-a0f7-0405b8415767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '628a3efd706f48c7afe6dfd1b1c82c4e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:34.163353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1144/2279] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:38:33 2022] DELETE /identity/v3/users/628a3efd706f48c7afe6dfd1b1c82c4e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:34.999160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:35.000767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:35.015997 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d03b-bf9d-4aa0-97c9-fbe23a3e374b admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:35.082200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:35.082997 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:35.083361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:35.083708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] PATH_INFO: `/v3/projects/cced48829bc548e0a26a91c7dfa6a006` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:35.084923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cced48829bc548e0a26a91c7dfa6a006)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:35.086957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:35.284056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cced48829bc548e0a26a91c7dfa6a006', 'request_id': 'req-9b9edca9-904a-447c-86e3-1d943be387e7'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:35.289466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cced48829bc548e0a26a91c7dfa6a006', 'request_id': 'req-9b9edca9-904a-447c-86e3-1d943be387e7'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:35.297807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cced48829bc548e0a26a91c7dfa6a006', 'request_id': 'req-9b9edca9-904a-447c-86e3-1d943be387e7'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:35.399605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] The token cache is being invalidate because project cced48829bc548e0a26a91c7dfa6a006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:38:35.399910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:35.401947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9b9edca9-904a-447c-86e3-1d943be387e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:35.407839 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1136/2280] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:38:34 2022] DELETE /identity/v3/projects/cced48829bc548e0a26a91c7dfa6a006 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:35.412720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab702ee-e44d-47b7-b67d-6442979b8167 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:35.413186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab702ee-e44d-47b7-b67d-6442979b8167 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:35.413294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab702ee-e44d-47b7-b67d-6442979b8167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:35.434529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-eab702ee-e44d-47b7-b67d-6442979b8167 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:35.435733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-eab702ee-e44d-47b7-b67d-6442979b8167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:35.504758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1145/2281] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:35.513211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec544-f4c3-4bba-a8f0-8a01367b296a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:35.517199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec544-f4c3-4bba-a8f0-8a01367b296a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:35.517199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dec544-f4c3-4bba-a8f0-8a01367b296a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:35.535512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-23dec544-f4c3-4bba-a8f0-8a01367b296a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:35.537003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-23dec544-f4c3-4bba-a8f0-8a01367b296a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:35.547413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1137/2282] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:35.551524 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab702ee-e44d-47b7-b67d-6442979b8167 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:35.563752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab702ee-e44d-47b7-b67d-6442979b8167 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:35.569463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb512c-4311-4595-8d86-2153a2e7222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:35.570299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb512c-4311-4595-8d86-2153a2e7222f admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:35.570633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb512c-4311-4595-8d86-2153a2e7222f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:35.570910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb512c-4311-4595-8d86-2153a2e7222f admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:35.571570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb512c-4311-4595-8d86-2153a2e7222f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:38:35.571869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb512c-4311-4595-8d86-2153a2e7222f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:35.574079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb512c-4311-4595-8d86-2153a2e7222f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:35.591262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1146/2283] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:38:35.592257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dec544-f4c3-4bba-a8f0-8a01367b296a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:35.606807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dec544-f4c3-4bba-a8f0-8a01367b296a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:35.613772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee63e22-0dde-46fd-aea3-d8e9fe6b84ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:35.614694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee63e22-0dde-46fd-aea3-d8e9fe6b84ec admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:35.615079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee63e22-0dde-46fd-aea3-d8e9fe6b84ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:35.616035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee63e22-0dde-46fd-aea3-d8e9fe6b84ec admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:35.616770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee63e22-0dde-46fd-aea3-d8e9fe6b84ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:35.619168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee63e22-0dde-46fd-aea3-d8e9fe6b84ec admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:35.813767 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:35.821799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1138/2284] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:38:35 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:38:35.825909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb512c-4311-4595-8d86-2153a2e7222f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:35.835829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb512c-4311-4595-8d86-2153a2e7222f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:35.892953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb444430-fac2-498c-b99b-0a7251396488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:35.893265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb444430-fac2-498c-b99b-0a7251396488 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:35.893550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb444430-fac2-498c-b99b-0a7251396488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:35.893858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb444430-fac2-498c-b99b-0a7251396488 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:35.894558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb444430-fac2-498c-b99b-0a7251396488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:35.896869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb444430-fac2-498c-b99b-0a7251396488 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:36.009398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1147/2285] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:38:35 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:38:36.011213 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee63e22-0dde-46fd-aea3-d8e9fe6b84ec admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:36.025732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee63e22-0dde-46fd-aea3-d8e9fe6b84ec admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:36.031963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ab823-0b31-4a6a-a6b1-523a31c70e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:36.032645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ab823-0b31-4a6a-a6b1-523a31c70e5c admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:36.032920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ab823-0b31-4a6a-a6b1-523a31c70e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:36.033195 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ab823-0b31-4a6a-a6b1-523a31c70e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:36.033921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ab823-0b31-4a6a-a6b1-523a31c70e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:36.037928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ab823-0b31-4a6a-a6b1-523a31c70e5c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:36.047988 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1139/2286] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:38:36.052336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb444430-fac2-498c-b99b-0a7251396488 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:36.064210 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb444430-fac2-498c-b99b-0a7251396488 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:36.072423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6778e-27e4-46d0-849b-5f2860436627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:36.072423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6778e-27e4-46d0-849b-5f2860436627 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:36.072718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6778e-27e4-46d0-849b-5f2860436627 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:36.073703 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6778e-27e4-46d0-849b-5f2860436627 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:36.073992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6778e-27e4-46d0-849b-5f2860436627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:36.076272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6778e-27e4-46d0-849b-5f2860436627 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:36.091034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ab823-0b31-4a6a-a6b1-523a31c70e5c admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:36.091169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1148/2287] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:38:36.092919 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d11ab823-0b31-4a6a-a6b1-523a31c70e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:36.095418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6778e-27e4-46d0-849b-5f2860436627 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:36.108041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6778e-27e4-46d0-849b-5f2860436627 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:36.115309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311fe44-12c5-4f77-8f22-6e14e5ed0ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:36.115507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311fe44-12c5-4f77-8f22-6e14e5ed0ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:36.117277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311fe44-12c5-4f77-8f22-6e14e5ed0ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:36.117277 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311fe44-12c5-4f77-8f22-6e14e5ed0ee6 admin admin] PATH_INFO: `/v3/projects/9c158651374147ceacea004c434dac05/users/8426d6f0856348089db4dc55159b1e03/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:36.128328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ab823-0b31-4a6a-a6b1-523a31c70e5c admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:36.137502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83b716-1f2b-4354-9cf7-ceaefac423c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:36.138421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83b716-1f2b-4354-9cf7-ceaefac423c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:36.138906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83b716-1f2b-4354-9cf7-ceaefac423c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:36.139386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83b716-1f2b-4354-9cf7-ceaefac423c6 admin admin] PATH_INFO: `/v3/users/6b6d1a074caf4b6c87adc5ab0dfb6ca3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:36.141111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83b716-1f2b-4354-9cf7-ceaefac423c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6d1a074caf4b6c87adc5ab0dfb6ca3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:36.146332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83b716-1f2b-4354-9cf7-ceaefac423c6 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:36.153264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311fe44-12c5-4f77-8f22-6e14e5ed0ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c158651374147ceacea004c434dac05, user_id=8426d6f0856348089db4dc55159b1e03, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:36.159178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311fe44-12c5-4f77-8f22-6e14e5ed0ee6 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:36.383526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1149/2288] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:38:36 2022] PUT /identity/v3/projects/9c158651374147ceacea004c434dac05/users/8426d6f0856348089db4dc55159b1e03/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:36.386574 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8cf5a-2fac-4c6f-b8fb-58c79fcd41e7 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:36.386574 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8cf5a-2fac-4c6f-b8fb-58c79fcd41e7 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:36.386838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8cf5a-2fac-4c6f-b8fb-58c79fcd41e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:36.438255 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-4ab8cf5a-2fac-4c6f-b8fb-58c79fcd41e7 None None] MFA Rules not processed for user `8426d6f0856348089db4dc55159b1e03`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:36.440066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4ab8cf5a-2fac-4c6f-b8fb-58c79fcd41e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:36.524618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1150/2289] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:36.530287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8cf5a-2fac-4c6f-b8fb-58c79fcd41e7 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:36.542464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-3a83b716-1f2b-4354-9cf7-ceaefac423c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6d1a074caf4b6c87adc5ab0dfb6ca3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:36.640943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8cf5a-2fac-4c6f-b8fb-58c79fcd41e7 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:36.644977 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-3a83b716-1f2b-4354-9cf7-ceaefac423c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6d1a074caf4b6c87adc5ab0dfb6ca3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:36.646873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0073772-d34b-44be-991d-e20ced4ca07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:36.647884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0073772-d34b-44be-991d-e20ced4ca07f admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:36.647884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0073772-d34b-44be-991d-e20ced4ca07f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:36.648341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0073772-d34b-44be-991d-e20ced4ca07f admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:36.649080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0073772-d34b-44be-991d-e20ced4ca07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:36.651764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0073772-d34b-44be-991d-e20ced4ca07f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:36.660760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-3a83b716-1f2b-4354-9cf7-ceaefac423c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6d1a074caf4b6c87adc5ab0dfb6ca3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:36.668948 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-3a83b716-1f2b-4354-9cf7-ceaefac423c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6d1a074caf4b6c87adc5ab0dfb6ca3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:36.669841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-3a83b716-1f2b-4354-9cf7-ceaefac423c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6d1a074caf4b6c87adc5ab0dfb6ca3'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:36.677940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1140/2290] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:38:36 2022] DELETE /identity/v3/users/6b6d1a074caf4b6c87adc5ab0dfb6ca3 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:38:36.683347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22af5-71d5-4f79-8013-8435dd42fac6 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:36.683740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22af5-71d5-4f79-8013-8435dd42fac6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:36.684127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f22af5-71d5-4f79-8013-8435dd42fac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:36.710473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b0f22af5-71d5-4f79-8013-8435dd42fac6 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:36.712268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b0f22af5-71d5-4f79-8013-8435dd42fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:36.781772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:36.788197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1151/2291] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:38:36 2022] POST /identity/v3/projects => generated 373 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:38:36.788197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1169cb6-79c4-4a51-ac6b-53ab8f4bbcf9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:36.788197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1169cb6-79c4-4a51-ac6b-53ab8f4bbcf9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:36.788905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1169cb6-79c4-4a51-ac6b-53ab8f4bbcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:36.821851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-d1169cb6-79c4-4a51-ac6b-53ab8f4bbcf9 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:36.823731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d1169cb6-79c4-4a51-ac6b-53ab8f4bbcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:36.878196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1141/2292] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:38:36.884890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f22af5-71d5-4f79-8013-8435dd42fac6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:36.887588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b0f22af5-71d5-4f79-8013-8435dd42fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:36.906208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1152/2293] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:38:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:36.929795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f22af5-71d5-4f79-8013-8435dd42fac6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:36.938797 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1169cb6-79c4-4a51-ac6b-53ab8f4bbcf9 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:36.940933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d1169cb6-79c4-4a51-ac6b-53ab8f4bbcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:37.008311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97456d-e74f-45e3-9197-483b633013fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:37.008662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97456d-e74f-45e3-9197-483b633013fb admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:37.008910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97456d-e74f-45e3-9197-483b633013fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:37.009187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97456d-e74f-45e3-9197-483b633013fb admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:37.010675 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97456d-e74f-45e3-9197-483b633013fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:37.011941 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97456d-e74f-45e3-9197-483b633013fb admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:37.046616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1169cb6-79c4-4a51-ac6b-53ab8f4bbcf9 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:37.046616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4e2f-afd6-428e-863b-49c967d940d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:37.046616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4e2f-afd6-428e-863b-49c967d940d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:37.046616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4e2f-afd6-428e-863b-49c967d940d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:37.047099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e4e2f-afd6-428e-863b-49c967d940d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:37.057638 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e4e2f-afd6-428e-863b-49c967d940d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:37.059155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e4e2f-afd6-428e-863b-49c967d940d6 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:37.070912 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1153/2294] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:38:37.071577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4e2f-afd6-428e-863b-49c967d940d6 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:37.073059 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ad2e4e2f-afd6-428e-863b-49c967d940d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:37.129546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1142/2295] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:38:36 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:38:37.134002 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97456d-e74f-45e3-9197-483b633013fb admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:37.153135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e4e2f-afd6-428e-863b-49c967d940d6 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:37.159199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97456d-e74f-45e3-9197-483b633013fb admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:37.166089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0f5d4-b79a-444e-a491-ed57cfe3f136 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:37.167116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0f5d4-b79a-444e-a491-ed57cfe3f136 service swift] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:37.167498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0f5d4-b79a-444e-a491-ed57cfe3f136 service swift] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:37.167870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0f5d4-b79a-444e-a491-ed57cfe3f136 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:37.168682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420b8ec-dd35-4c2c-a83d-29c2e5c3c90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:37.169808 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b8ec-dd35-4c2c-a83d-29c2e5c3c90b admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:37.170458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b8ec-dd35-4c2c-a83d-29c2e5c3c90b admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:37.170992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b8ec-dd35-4c2c-a83d-29c2e5c3c90b admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:37.172290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420b8ec-dd35-4c2c-a83d-29c2e5c3c90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:37.174425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420b8ec-dd35-4c2c-a83d-29c2e5c3c90b admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:37.177661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0f5d4-b79a-444e-a491-ed57cfe3f136 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:37.179351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0f5d4-b79a-444e-a491-ed57cfe3f136 service swift] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:37.208127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1143/2296] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:38:37.208525 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1154/2297] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:38:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:38:37.210201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420b8ec-dd35-4c2c-a83d-29c2e5c3c90b admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:37.229712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420b8ec-dd35-4c2c-a83d-29c2e5c3c90b admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:37.238075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28683ed-8fb5-413d-8dc5-a94eee0c898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:37.239977 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28683ed-8fb5-413d-8dc5-a94eee0c898f admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:37.240268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28683ed-8fb5-413d-8dc5-a94eee0c898f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:37.240556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28683ed-8fb5-413d-8dc5-a94eee0c898f admin admin] PATH_INFO: `/v3/projects/f5280b9f459349e1ab4a32b60c3b8c53/users/f071fe6c583048419a4ef22526b57558/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:37.258598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28683ed-8fb5-413d-8dc5-a94eee0c898f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5280b9f459349e1ab4a32b60c3b8c53, user_id=f071fe6c583048419a4ef22526b57558, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:37.263207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28683ed-8fb5-413d-8dc5-a94eee0c898f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:37.406481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1144/2298] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:38:37 2022] PUT /identity/v3/projects/f5280b9f459349e1ab4a32b60c3b8c53/users/f071fe6c583048419a4ef22526b57558/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:38:37.421047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0f5d4-b79a-444e-a491-ed57cfe3f136 service swift] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:37.446972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0f5d4-b79a-444e-a491-ed57cfe3f136 service swift] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:37.516207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590ad51-48e0-4f00-9d23-8c25561c1f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:37.518691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590ad51-48e0-4f00-9d23-8c25561c1f5e admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:37.518691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590ad51-48e0-4f00-9d23-8c25561c1f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:37.518691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590ad51-48e0-4f00-9d23-8c25561c1f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:37.518691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590ad51-48e0-4f00-9d23-8c25561c1f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:37.521769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590ad51-48e0-4f00-9d23-8c25561c1f5e admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:37.541431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1155/2299] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:38:37.546383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28683ed-8fb5-413d-8dc5-a94eee0c898f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:37.565851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28683ed-8fb5-413d-8dc5-a94eee0c898f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:37.569488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697deda-b6b1-4d9d-94cb-fd9b4b326e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:37.570223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697deda-b6b1-4d9d-94cb-fd9b4b326e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:37.570608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697deda-b6b1-4d9d-94cb-fd9b4b326e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:37.571452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697deda-b6b1-4d9d-94cb-fd9b4b326e7f admin admin] PATH_INFO: `/v3/projects/f5280b9f459349e1ab4a32b60c3b8c53/users/f071fe6c583048419a4ef22526b57558/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:37.573833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697deda-b6b1-4d9d-94cb-fd9b4b326e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5280b9f459349e1ab4a32b60c3b8c53, user_id=f071fe6c583048419a4ef22526b57558, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:37.577341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697deda-b6b1-4d9d-94cb-fd9b4b326e7f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:37.616471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1145/2300] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:38:37 2022] PUT /identity/v3/projects/f5280b9f459349e1ab4a32b60c3b8c53/users/f071fe6c583048419a4ef22526b57558/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:37.627197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ebb90-eb0e-485a-af1d-2b6bb30973f4 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:37.627949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ebb90-eb0e-485a-af1d-2b6bb30973f4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:37.628444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ebb90-eb0e-485a-af1d-2b6bb30973f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:37.716838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-c89ebb90-eb0e-485a-af1d-2b6bb30973f4 None None] MFA Rules not processed for user `f071fe6c583048419a4ef22526b57558`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:37.721672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c89ebb90-eb0e-485a-af1d-2b6bb30973f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:37.904987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1156/2301] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:37.916046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697deda-b6b1-4d9d-94cb-fd9b4b326e7f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:37.918198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a697deda-b6b1-4d9d-94cb-fd9b4b326e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:38.049663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ebb90-eb0e-485a-af1d-2b6bb30973f4 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:38.051473 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c89ebb90-eb0e-485a-af1d-2b6bb30973f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:38.054661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697deda-b6b1-4d9d-94cb-fd9b4b326e7f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:38.069013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1aed77-b9ab-434e-a0a5-d7680bb70488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:38.076288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aed77-b9ab-434e-a0a5-d7680bb70488 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:38.076288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aed77-b9ab-434e-a0a5-d7680bb70488 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:38.076288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1aed77-b9ab-434e-a0a5-d7680bb70488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:38.094582 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7a1aed77-b9ab-434e-a0a5-d7680bb70488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:38.170516 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:38.222256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1aed77-b9ab-434e-a0a5-d7680bb70488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:38.224239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1aed77-b9ab-434e-a0a5-d7680bb70488 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:38.231017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ebb90-eb0e-485a-af1d-2b6bb30973f4 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:38.237737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:38.238715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:38.239006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:38.239524 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] PATH_INFO: `/v3/projects/97844f7f01f84ea783934679e06fcc6d` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:38.240922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97844f7f01f84ea783934679e06fcc6d)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:38.243093 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:38.261110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1146/2302] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:38:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:38:38.428509 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97844f7f01f84ea783934679e06fcc6d', 'request_id': 'req-c194f562-0366-46f5-be20-0129ac2b7fe2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:38.499112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97844f7f01f84ea783934679e06fcc6d', 'request_id': 'req-c194f562-0366-46f5-be20-0129ac2b7fe2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:38.524590 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97844f7f01f84ea783934679e06fcc6d', 'request_id': 'req-c194f562-0366-46f5-be20-0129ac2b7fe2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:38.560166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] The token cache is being invalidate because project 97844f7f01f84ea783934679e06fcc6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:38:38.563787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:38.567320 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:38.569886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1157/2303] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:38:38 2022] DELETE /identity/v3/projects/97844f7f01f84ea783934679e06fcc6d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:39.220500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80241b-5266-449b-8a78-8ec7509522c8 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:39.221057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80241b-5266-449b-8a78-8ec7509522c8 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:39.221057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80241b-5266-449b-8a78-8ec7509522c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:39.253772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-3d80241b-5266-449b-8a78-8ec7509522c8 None None] MFA Rules not processed for user `e775b9e1dfde44a0bfe23523399f8f22`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:39.255087 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-3d80241b-5266-449b-8a78-8ec7509522c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:39.349297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1147/2304] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:39.844903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:41.411391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:42.382938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:43.614289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:43.708376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:43.710019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:43.785679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:43.828500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194f562-0366-46f5-be20-0129ac2b7fe2 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:43.839542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:43.840636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:43.841143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:43.841670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] PATH_INFO: `/v3/users/8426d6f0856348089db4dc55159b1e03` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:43.843730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8426d6f0856348089db4dc55159b1e03)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:43.847497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:44.157970 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8426d6f0856348089db4dc55159b1e03'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:44.178188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8426d6f0856348089db4dc55159b1e03'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:44.189190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8426d6f0856348089db4dc55159b1e03'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:44.319317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8426d6f0856348089db4dc55159b1e03'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:44.320451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8426d6f0856348089db4dc55159b1e03'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:44.329219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1158/2305] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:38:43 2022] DELETE /identity/v3/users/8426d6f0856348089db4dc55159b1e03 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:44.333820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db78a86-5664-4f34-b032-1545bd09adcd None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:44.334379 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db78a86-5664-4f34-b032-1545bd09adcd None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:44.334917 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db78a86-5664-4f34-b032-1545bd09adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:44.369091 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2db78a86-5664-4f34-b032-1545bd09adcd None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:44.371966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2db78a86-5664-4f34-b032-1545bd09adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:44.452724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1148/2306] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:44.463858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:44.465468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:44.516974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:44.549030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550bf83-3ed3-4604-833e-d711849e3e5f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:44.557950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef68db2-1af4-4055-adda-c455a5fabad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:44.558743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef68db2-1af4-4055-adda-c455a5fabad6 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:44.559016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef68db2-1af4-4055-adda-c455a5fabad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:44.559288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef68db2-1af4-4055-adda-c455a5fabad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:44.569669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef68db2-1af4-4055-adda-c455a5fabad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:44.571216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef68db2-1af4-4055-adda-c455a5fabad6 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:44.601686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1159/2307] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:38:44.775636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:45.125385 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:45.374404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db78a86-5664-4f34-b032-1545bd09adcd None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:45.376462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2db78a86-5664-4f34-b032-1545bd09adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:45.402184 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db78a86-5664-4f34-b032-1545bd09adcd None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:45.424923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:45.426080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:45.426640 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:45.427176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] PATH_INFO: `/v3/projects/9c158651374147ceacea004c434dac05` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:45.428634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c158651374147ceacea004c434dac05)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:45.432579 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:46.182420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c158651374147ceacea004c434dac05', 'request_id': 'req-bb9c915a-a809-487f-a32c-2f63b88a35b5'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:46.190975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c158651374147ceacea004c434dac05', 'request_id': 'req-bb9c915a-a809-487f-a32c-2f63b88a35b5'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:46.210987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c158651374147ceacea004c434dac05', 'request_id': 'req-bb9c915a-a809-487f-a32c-2f63b88a35b5'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:46.329375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] The token cache is being invalidate because project 9c158651374147ceacea004c434dac05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:38:46.329893 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:46.331356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:46.339411 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef68db2-1af4-4055-adda-c455a5fabad6 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:46.340143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1149/2308] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:38:45 2022] DELETE /identity/v3/projects/9c158651374147ceacea004c434dac05 => generated 0 bytes in 972 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:46.368417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef68db2-1af4-4055-adda-c455a5fabad6 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:46.418546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:46.491231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:46.561021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1fed6-da56-4ef0-8cd3-33c511227ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:46.562180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1fed6-da56-4ef0-8cd3-33c511227ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:46.562639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1fed6-da56-4ef0-8cd3-33c511227ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:46.563099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1fed6-da56-4ef0-8cd3-33c511227ad2 admin admin] PATH_INFO: `/v3/users/f071fe6c583048419a4ef22526b57558` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:46.565376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1fed6-da56-4ef0-8cd3-33c511227ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f071fe6c583048419a4ef22526b57558)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:46.570346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1fed6-da56-4ef0-8cd3-33c511227ad2 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:46.929964 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-61d1fed6-da56-4ef0-8cd3-33c511227ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f071fe6c583048419a4ef22526b57558'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:47.015825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-61d1fed6-da56-4ef0-8cd3-33c511227ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f071fe6c583048419a4ef22526b57558'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:47.050802 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-61d1fed6-da56-4ef0-8cd3-33c511227ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f071fe6c583048419a4ef22526b57558'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:47.241234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-61d1fed6-da56-4ef0-8cd3-33c511227ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f071fe6c583048419a4ef22526b57558'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:47.242193 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-61d1fed6-da56-4ef0-8cd3-33c511227ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f071fe6c583048419a4ef22526b57558'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:47.255178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1160/2309] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:38:46 2022] DELETE /identity/v3/users/f071fe6c583048419a4ef22526b57558 => generated 0 bytes in 917 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:47.908584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:48.003141 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:48.005769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:48.028584 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c915a-a809-487f-a32c-2f63b88a35b5 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:48.082875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:48.143575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:48.144671 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:48.145099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:48.145608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] PATH_INFO: `/v3/projects/f5280b9f459349e1ab4a32b60c3b8c53` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:48.147077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5280b9f459349e1ab4a32b60c3b8c53)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:48.149512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:48.349945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5280b9f459349e1ab4a32b60c3b8c53', 'request_id': 'req-f768dff5-207b-422c-a938-209377547ab4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:48.381982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5280b9f459349e1ab4a32b60c3b8c53', 'request_id': 'req-f768dff5-207b-422c-a938-209377547ab4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:48.408794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5280b9f459349e1ab4a32b60c3b8c53', 'request_id': 'req-f768dff5-207b-422c-a938-209377547ab4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:48.561143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] The token cache is being invalidate because project f5280b9f459349e1ab4a32b60c3b8c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:38:48.561818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:48.564529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f768dff5-207b-422c-a938-209377547ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:38:48.566614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1150/2310] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:38:48 2022] DELETE /identity/v3/projects/f5280b9f459349e1ab4a32b60c3b8c53 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:48.574833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda1cc5-807a-44cf-8830-cc6bd20595e4 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:48.575159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda1cc5-807a-44cf-8830-cc6bd20595e4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:48.575442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda1cc5-807a-44cf-8830-cc6bd20595e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:48.619309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2dda1cc5-807a-44cf-8830-cc6bd20595e4 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:48.621134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2dda1cc5-807a-44cf-8830-cc6bd20595e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:48.687742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18db0de-ddb3-4ba9-aaec-40b698ff8642 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:48.691074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18db0de-ddb3-4ba9-aaec-40b698ff8642 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:48.691074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18db0de-ddb3-4ba9-aaec-40b698ff8642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:48.731115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-d18db0de-ddb3-4ba9-aaec-40b698ff8642 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:48.735053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d18db0de-ddb3-4ba9-aaec-40b698ff8642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:48.778069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1161/2311] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:48.786883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f51ff6-4380-4c00-a6d4-bf20d8f9a7fb None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:48.788561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f51ff6-4380-4c00-a6d4-bf20d8f9a7fb None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:48.788944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f51ff6-4380-4c00-a6d4-bf20d8f9a7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:48.831887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-c6f51ff6-4380-4c00-a6d4-bf20d8f9a7fb None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:48.833243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c6f51ff6-4380-4c00-a6d4-bf20d8f9a7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:48.864793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1162/2312] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:38:48.868064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f51ff6-4380-4c00-a6d4-bf20d8f9a7fb None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:48.904117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f51ff6-4380-4c00-a6d4-bf20d8f9a7fb None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:48.911795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4841520-8941-44bb-9025-f706b1984ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:48.912481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4841520-8941-44bb-9025-f706b1984ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:48.912766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4841520-8941-44bb-9025-f706b1984ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:48.913037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4841520-8941-44bb-9025-f706b1984ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:48.913742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4841520-8941-44bb-9025-f706b1984ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:38:48.914049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4841520-8941-44bb-9025-f706b1984ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:48.915933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4841520-8941-44bb-9025-f706b1984ec7 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:48.947916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1151/2313] 10.222.0.78 () {58 vars in 1016 bytes} [Wed Aug 31 00:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:48.954518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1163/2314] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:38:48.957530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18db0de-ddb3-4ba9-aaec-40b698ff8642 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:48.972579 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18db0de-ddb3-4ba9-aaec-40b698ff8642 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:48.976202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4841520-8941-44bb-9025-f706b1984ec7 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:48.978857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b4841520-8941-44bb-9025-f706b1984ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:48.992097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94cc65-5c83-4b27-be17-90e68bb60ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:48.993030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94cc65-5c83-4b27-be17-90e68bb60ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:48.994105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94cc65-5c83-4b27-be17-90e68bb60ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:48.994570 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94cc65-5c83-4b27-be17-90e68bb60ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:48.995881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94cc65-5c83-4b27-be17-90e68bb60ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:48.998774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94cc65-5c83-4b27-be17-90e68bb60ea7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:49.113072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1152/2315] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:38:48 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:38:49.115163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94cc65-5c83-4b27-be17-90e68bb60ea7 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:49.129634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4841520-8941-44bb-9025-f706b1984ec7 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:49.202029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:49.258752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94cc65-5c83-4b27-be17-90e68bb60ea7 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:49.265350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8847bac-c0c9-44d4-afc5-3eaa63ecd347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:49.267051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8847bac-c0c9-44d4-afc5-3eaa63ecd347 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:49.267051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8847bac-c0c9-44d4-afc5-3eaa63ecd347 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:49.267051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8847bac-c0c9-44d4-afc5-3eaa63ecd347 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:49.268079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8847bac-c0c9-44d4-afc5-3eaa63ecd347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:49.270245 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8847bac-c0c9-44d4-afc5-3eaa63ecd347 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:49.292061 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3a150-640f-40c7-b088-a45c92a30ab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:49.292722 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3a150-640f-40c7-b088-a45c92a30ab4 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:49.292988 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3a150-640f-40c7-b088-a45c92a30ab4 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:49.293278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3a150-640f-40c7-b088-a45c92a30ab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:49.308095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3a150-640f-40c7-b088-a45c92a30ab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:49.310279 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3a150-640f-40c7-b088-a45c92a30ab4 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:49.326381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1164/2316] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:38:49.393111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1153/2317] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:38:49 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:38:49.396752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3a150-640f-40c7-b088-a45c92a30ab4 service nova] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:49.408014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3a150-640f-40c7-b088-a45c92a30ab4 service nova] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:49.433054 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d6a67-2975-4560-8273-c006b92f6233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:49.433785 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6a67-2975-4560-8273-c006b92f6233 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:49.434119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6a67-2975-4560-8273-c006b92f6233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:49.434350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6a67-2975-4560-8273-c006b92f6233 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:49.435391 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d6a67-2975-4560-8273-c006b92f6233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:49.436697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d6a67-2975-4560-8273-c006b92f6233 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:49.466432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1165/2318] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:38:49.468056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8847bac-c0c9-44d4-afc5-3eaa63ecd347 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:49.495121 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8847bac-c0c9-44d4-afc5-3eaa63ecd347 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:49.505010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06cdfa-4e57-43f7-b66c-c21a41d5a1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:49.506025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06cdfa-4e57-43f7-b66c-c21a41d5a1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:49.509649 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06cdfa-4e57-43f7-b66c-c21a41d5a1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:49.510350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06cdfa-4e57-43f7-b66c-c21a41d5a1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:49.510972 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06cdfa-4e57-43f7-b66c-c21a41d5a1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:49.515386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef06cdfa-4e57-43f7-b66c-c21a41d5a1d5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:49.540957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1154/2319] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:38:49.552579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d6a67-2975-4560-8273-c006b92f6233 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:49.567203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d6a67-2975-4560-8273-c006b92f6233 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:49.576401 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab42c3-2aa3-46d5-8302-2d6ac794f30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:49.578626 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab42c3-2aa3-46d5-8302-2d6ac794f30b admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:49.579108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab42c3-2aa3-46d5-8302-2d6ac794f30b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:49.580224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab42c3-2aa3-46d5-8302-2d6ac794f30b admin admin] PATH_INFO: `/v3/projects/d645cac527c54af5ba6cbf23f415cad9/users/f274d68521c04430878c74f09709fe9b/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:49.619335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab42c3-2aa3-46d5-8302-2d6ac794f30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d645cac527c54af5ba6cbf23f415cad9, user_id=f274d68521c04430878c74f09709fe9b, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:49.624209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab42c3-2aa3-46d5-8302-2d6ac794f30b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:49.715216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:49.775298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eaca7-6b4d-429f-88e8-f1d81b931330 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:49.775589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eaca7-6b4d-429f-88e8-f1d81b931330 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:49.775930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747eaca7-6b4d-429f-88e8-f1d81b931330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:49.779321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1166/2320] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:38:49 2022] PUT /identity/v3/projects/d645cac527c54af5ba6cbf23f415cad9/users/f274d68521c04430878c74f09709fe9b/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:38:49.862131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-747eaca7-6b4d-429f-88e8-f1d81b931330 None None] MFA Rules not processed for user `f274d68521c04430878c74f09709fe9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:49.867762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-747eaca7-6b4d-429f-88e8-f1d81b931330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:50.046614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1155/2321] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:38:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:50.059231 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab42c3-2aa3-46d5-8302-2d6ac794f30b admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:50.061206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-53ab42c3-2aa3-46d5-8302-2d6ac794f30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:50.215295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab42c3-2aa3-46d5-8302-2d6ac794f30b admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:50.226541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eac67-e3e1-4c8e-a09b-e50a46ff7d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:50.227294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eac67-e3e1-4c8e-a09b-e50a46ff7d12 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:50.228329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eac67-e3e1-4c8e-a09b-e50a46ff7d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:50.228845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075eac67-e3e1-4c8e-a09b-e50a46ff7d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:50.255822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075eac67-e3e1-4c8e-a09b-e50a46ff7d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:50.257339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075eac67-e3e1-4c8e-a09b-e50a46ff7d12 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:50.296238 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1167/2322] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:38:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:38:51.971149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:53.046270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e95f5-ccd5-41f8-ac6e-7e20d5facaa9 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:53.046834 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e95f5-ccd5-41f8-ac6e-7e20d5facaa9 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:53.046834 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e95f5-ccd5-41f8-ac6e-7e20d5facaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:53.068452 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-443e95f5-ccd5-41f8-ac6e-7e20d5facaa9 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:53.070092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-443e95f5-ccd5-41f8-ac6e-7e20d5facaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:53.124836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:53.128271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1156/2323] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:38:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:53.141157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eac67-e3e1-4c8e-a09b-e50a46ff7d12 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:53.142710 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-075eac67-e3e1-4c8e-a09b-e50a46ff7d12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:53.217346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075eac67-e3e1-4c8e-a09b-e50a46ff7d12 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:53.222390 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d782f38-a1c7-44c7-8ad0-4c023c4baa9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:53.223019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d782f38-a1c7-44c7-8ad0-4c023c4baa9b service swift] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:53.223299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d782f38-a1c7-44c7-8ad0-4c023c4baa9b service swift] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:53.223570 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d782f38-a1c7-44c7-8ad0-4c023c4baa9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:53.232438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d782f38-a1c7-44c7-8ad0-4c023c4baa9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:53.234059 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d782f38-a1c7-44c7-8ad0-4c023c4baa9b service swift] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:53.242069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1168/2324] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:38:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:38:54.673955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:54.766627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:55.126458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739ce37-00f9-483a-bbd2-ed8967b9b1fb None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:55.127638 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739ce37-00f9-483a-bbd2-ed8967b9b1fb None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:55.130077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739ce37-00f9-483a-bbd2-ed8967b9b1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:55.170882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:55.184621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2739ce37-00f9-483a-bbd2-ed8967b9b1fb None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:38:55.191405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2739ce37-00f9-483a-bbd2-ed8967b9b1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:38:55.296461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1157/2325] 10.222.0.78 () {58 vars in 1016 bytes} [Wed Aug 31 00:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:38:55.327095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d782f38-a1c7-44c7-8ad0-4c023c4baa9b service swift] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:38:55.474031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d782f38-a1c7-44c7-8ad0-4c023c4baa9b service swift] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:38:55.496472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a83c65-cf49-49bb-b554-7105cdd593f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:38:55.497608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a83c65-cf49-49bb-b554-7105cdd593f8 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:38:55.501386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a83c65-cf49-49bb-b554-7105cdd593f8 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:38:55.501886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a83c65-cf49-49bb-b554-7105cdd593f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:38:55.514381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a83c65-cf49-49bb-b554-7105cdd593f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:38:55.516706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a83c65-cf49-49bb-b554-7105cdd593f8 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:38:55.535346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1169/2326] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:38:55.988445 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:57.033604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:57.536391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:57.896330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:58.513794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:59.095102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:59.154164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:59.327845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:59.453328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:59.845044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:38:59.990774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:00.471541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:00.919076 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:01.088553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:01.496624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:01.921954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:02.185038 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:02.330058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:02.584544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb63e7d-1d8b-4ad1-8116-3c54fd13ff10 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:02.584916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb63e7d-1d8b-4ad1-8116-3c54fd13ff10 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:02.592904 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb63e7d-1d8b-4ad1-8116-3c54fd13ff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:02.641602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-7fb63e7d-1d8b-4ad1-8116-3c54fd13ff10 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:02.643125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7fb63e7d-1d8b-4ad1-8116-3c54fd13ff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:02.654942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1158/2327] 10.222.0.78 () {58 vars in 1016 bytes} [Wed Aug 31 00:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:02.766657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a83c65-cf49-49bb-b554-7105cdd593f8 service nova] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:02.770864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b5a83c65-cf49-49bb-b554-7105cdd593f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:02.790596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a83c65-cf49-49bb-b554-7105cdd593f8 service nova] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:02.797348 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a329c5-ee44-4a1a-bc87-64a51b481959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:02.798309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a329c5-ee44-4a1a-bc87-64a51b481959 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:02.798798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a329c5-ee44-4a1a-bc87-64a51b481959 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:02.799279 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a329c5-ee44-4a1a-bc87-64a51b481959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:02.809941 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a329c5-ee44-4a1a-bc87-64a51b481959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:02.811883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a329c5-ee44-4a1a-bc87-64a51b481959 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:02.826677 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:02.856179 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1170/2328] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:03.070137 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199518e-285c-4e4a-9c1f-91e78e55f26b None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:03.072472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199518e-285c-4e4a-9c1f-91e78e55f26b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:03.072472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199518e-285c-4e4a-9c1f-91e78e55f26b None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:03.073482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1159/2329] 10.222.0.74 () {54 vars in 921 bytes} [Wed Aug 31 00:39:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:39:03.088689 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f067f1-7693-4435-98e5-270e7e104ba6 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:03.089732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f067f1-7693-4435-98e5-270e7e104ba6 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:03.090232 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f067f1-7693-4435-98e5-270e7e104ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:03.147275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-12f067f1-7693-4435-98e5-270e7e104ba6 None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:03.149527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-12f067f1-7693-4435-98e5-270e7e104ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:03.165863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1171/2330] 10.222.0.74 () {58 vars in 1018 bytes} [Wed Aug 31 00:39:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:39:03.175348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199518e-285c-4e4a-9c1f-91e78e55f26b None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:03.177155 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1199518e-285c-4e4a-9c1f-91e78e55f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:03.257183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199518e-285c-4e4a-9c1f-91e78e55f26b None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:03.266303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16234dd-8e11-44d8-baf3-c89d3caa7631 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8590378b14c49cf9266a0d859db5bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:03.267511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16234dd-8e11-44d8-baf3-c89d3caa7631 service glance] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:03.268041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16234dd-8e11-44d8-baf3-c89d3caa7631 service glance] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:03.268568 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16234dd-8e11-44d8-baf3-c89d3caa7631 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:03.289795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16234dd-8e11-44d8-baf3-c89d3caa7631 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:03.292132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16234dd-8e11-44d8-baf3-c89d3caa7631 service glance] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:03.311532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1160/2331] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:39:03.565193 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:03.650453 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f5b6-7ab5-4c04-91e0-1d7a0dc51406 None None] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:03.653921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f5b6-7ab5-4c04-91e0-1d7a0dc51406 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:03.653921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6f5b6-7ab5-4c04-91e0-1d7a0dc51406 None None] PATH_INFO: `/` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:03.654383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1172/2332] 10.222.0.74 () {54 vars in 921 bytes} [Wed Aug 31 00:39:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:39:03.665988 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:03.668025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2a76e-e5bc-4854-967a-f7f53b28744a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:03.668371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2a76e-e5bc-4854-967a-f7f53b28744a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:03.668892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2a76e-e5bc-4854-967a-f7f53b28744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:03.732663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-4fc2a76e-e5bc-4854-967a-f7f53b28744a None None] MFA Rules not processed for user `6f5149b369e34afca6dd41a0082701e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:03.735214 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4fc2a76e-e5bc-4854-967a-f7f53b28744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:03.959182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1161/2333] 10.222.0.74 () {58 vars in 1018 bytes} [Wed Aug 31 00:39:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:03.986549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6f5b6-7ab5-4c04-91e0-1d7a0dc51406 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:03.993926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-53e6f5b6-7ab5-4c04-91e0-1d7a0dc51406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:04.021942 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6f5b6-7ab5-4c04-91e0-1d7a0dc51406 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:04.026604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765028a-3101-419f-9b63-dbe81288a550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:04.027289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765028a-3101-419f-9b63-dbe81288a550 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:04.027565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765028a-3101-419f-9b63-dbe81288a550 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:04.027836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765028a-3101-419f-9b63-dbe81288a550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:04.037001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765028a-3101-419f-9b63-dbe81288a550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:04.042042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765028a-3101-419f-9b63-dbe81288a550 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:04.049417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1173/2334] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:39:04.160740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a6ed1-edff-4060-b729-eca6674fdcea None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:04.161244 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a6ed1-edff-4060-b729-eca6674fdcea None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:04.161778 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a6ed1-edff-4060-b729-eca6674fdcea None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:04.164009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1162/2335] 10.222.0.74 () {54 vars in 921 bytes} [Wed Aug 31 00:39:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:39:04.173279 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dec504-caf5-411f-9806-b18aceebb031 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:04.178016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dec504-caf5-411f-9806-b18aceebb031 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:04.178016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dec504-caf5-411f-9806-b18aceebb031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:04.199588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-d9dec504-caf5-411f-9806-b18aceebb031 None None] MFA Rules not processed for user `90147848fe604ca9912d10a214a45227`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:04.200820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d9dec504-caf5-411f-9806-b18aceebb031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:04.211059 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1174/2336] 10.222.0.74 () {58 vars in 1018 bytes} [Wed Aug 31 00:39:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:04.228988 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a6ed1-edff-4060-b729-eca6674fdcea None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:04.246485 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a6ed1-edff-4060-b729-eca6674fdcea None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:04.251852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac75d4-0ade-4de2-aad8-94923d2cee32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:04.252760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac75d4-0ade-4de2-aad8-94923d2cee32 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:04.253970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac75d4-0ade-4de2-aad8-94923d2cee32 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:04.253970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac75d4-0ade-4de2-aad8-94923d2cee32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:04.309897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac75d4-0ade-4de2-aad8-94923d2cee32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:04.312317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ac75d4-0ade-4de2-aad8-94923d2cee32 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:04.335441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1163/2337] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:04.444608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:04.735843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:05.631119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:05.824840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:06.134321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:06.549160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:06.683314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:06.920529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:07.064962 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:07.275808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:07.320313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:07.476139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:07.516318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe955f2-7031-46a8-ad57-f0babaeaf1de None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:07.517330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe955f2-7031-46a8-ad57-f0babaeaf1de None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:07.518790 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe955f2-7031-46a8-ad57-f0babaeaf1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:07.554778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-7fe955f2-7031-46a8-ad57-f0babaeaf1de None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:07.557038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7fe955f2-7031-46a8-ad57-f0babaeaf1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:07.578766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1175/2338] 10.222.0.78 () {58 vars in 1016 bytes} [Wed Aug 31 00:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:07.604278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac75d4-0ade-4de2-aad8-94923d2cee32 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:07.632882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ac75d4-0ade-4de2-aad8-94923d2cee32 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:07.640361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b6659-77c9-4260-a0c5-0b65cd43f3c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:07.641616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b6659-77c9-4260-a0c5-0b65cd43f3c9 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:07.642104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b6659-77c9-4260-a0c5-0b65cd43f3c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:07.642572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b6659-77c9-4260-a0c5-0b65cd43f3c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:07.661329 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b6659-77c9-4260-a0c5-0b65cd43f3c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:07.664994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b6659-77c9-4260-a0c5-0b65cd43f3c9 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:07.690301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1164/2339] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:07.694524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:08.022332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:08.301695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:08.468044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:08.609393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:09.008380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:09.086958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:09.349004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:09.394877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:09.710741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:09.758630 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:09.982637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:10.005481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:10.170463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:10.193058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:10.316635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:10.345829 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:10.440133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:10.628528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:10.716817 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:11.077741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:11.389293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:11.590965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:11.873535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4a1c9-83ba-4d88-952d-8d868afa0616 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:11.874438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4a1c9-83ba-4d88-952d-8d868afa0616 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:11.874721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4a1c9-83ba-4d88-952d-8d868afa0616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:11.912414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ace4a1c9-83ba-4d88-952d-8d868afa0616 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:11.913997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ace4a1c9-83ba-4d88-952d-8d868afa0616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:11.926163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1176/2340] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:39:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:11.942207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b6659-77c9-4260-a0c5-0b65cd43f3c9 service nova] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:11.959188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b6659-77c9-4260-a0c5-0b65cd43f3c9 service nova] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:11.973899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31945dab-9e9e-4724-ab36-0596d6b257a1 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:11.974300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31945dab-9e9e-4724-ab36-0596d6b257a1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:11.974681 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31945dab-9e9e-4724-ab36-0596d6b257a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:11.979187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd64f5-0168-4d0c-8c22-721beee3a5e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:11.980049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd64f5-0168-4d0c-8c22-721beee3a5e7 service swift] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:11.980459 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd64f5-0168-4d0c-8c22-721beee3a5e7 service swift] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:11.980841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd64f5-0168-4d0c-8c22-721beee3a5e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:11.996947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd64f5-0168-4d0c-8c22-721beee3a5e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:11.999133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd64f5-0168-4d0c-8c22-721beee3a5e7 service swift] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:12.014996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-31945dab-9e9e-4724-ab36-0596d6b257a1 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:12.017030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-31945dab-9e9e-4724-ab36-0596d6b257a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:12.029218 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1177/2341] 10.222.0.78 () {58 vars in 1016 bytes} [Wed Aug 31 00:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:12.031392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1165/2342] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:39:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:39:12.061161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31945dab-9e9e-4724-ab36-0596d6b257a1 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:12.080794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31945dab-9e9e-4724-ab36-0596d6b257a1 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:12.090689 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d22cd-61a6-4a5a-a002-f644a486ea69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:12.094979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd64f5-0168-4d0c-8c22-721beee3a5e7 service swift] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:12.096300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d22cd-61a6-4a5a-a002-f644a486ea69 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:12.096688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d22cd-61a6-4a5a-a002-f644a486ea69 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:12.097082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d22cd-61a6-4a5a-a002-f644a486ea69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:12.109789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd64f5-0168-4d0c-8c22-721beee3a5e7 service swift] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:12.114246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d22cd-61a6-4a5a-a002-f644a486ea69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:12.115866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d22cd-61a6-4a5a-a002-f644a486ea69 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:12.118471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:12.121683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:12.121683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:12.121683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] PATH_INFO: `/v3/users/f274d68521c04430878c74f09709fe9b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:12.124086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f274d68521c04430878c74f09709fe9b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:12.127463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:12.128803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1178/2343] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:12.360672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f274d68521c04430878c74f09709fe9b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:12.488361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f274d68521c04430878c74f09709fe9b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:12.606206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f274d68521c04430878c74f09709fe9b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:12.635275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f274d68521c04430878c74f09709fe9b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:12.640891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f274d68521c04430878c74f09709fe9b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:12.671032 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1166/2344] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:39:12 2022] DELETE /identity/v3/users/f274d68521c04430878c74f09709fe9b => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:12.676516 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449e440-f26b-4c97-922a-83389e17c034 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:12.677071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449e440-f26b-4c97-922a-83389e17c034 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:12.677071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449e440-f26b-4c97-922a-83389e17c034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:12.708609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-1449e440-f26b-4c97-922a-83389e17c034 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:12.709919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1449e440-f26b-4c97-922a-83389e17c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:12.827424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1179/2345] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:12.850919 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:12.855317 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:12.870313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:12.946776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53669ab-6df7-464d-a95d-2402546a39c9 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:12.952846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a161eb8-a529-4d10-a6a0-1b3a33011f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:12.953489 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a161eb8-a529-4d10-a6a0-1b3a33011f84 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:12.953850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a161eb8-a529-4d10-a6a0-1b3a33011f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:12.954142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a161eb8-a529-4d10-a6a0-1b3a33011f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:12.967665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a161eb8-a529-4d10-a6a0-1b3a33011f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:12.968018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a161eb8-a529-4d10-a6a0-1b3a33011f84 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:12.980690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1167/2346] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:13.666509 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449e440-f26b-4c97-922a-83389e17c034 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:13.668300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1449e440-f26b-4c97-922a-83389e17c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:13.692848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449e440-f26b-4c97-922a-83389e17c034 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:13.714677 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:13.716076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:13.716512 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:13.716945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] PATH_INFO: `/v3/projects/d645cac527c54af5ba6cbf23f415cad9` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:13.724567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d645cac527c54af5ba6cbf23f415cad9)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:13.727662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:13.965494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd645cac527c54af5ba6cbf23f415cad9', 'request_id': 'req-69eecd3e-c701-42be-a159-0732de4ceaf7'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:14.037957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd645cac527c54af5ba6cbf23f415cad9', 'request_id': 'req-69eecd3e-c701-42be-a159-0732de4ceaf7'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:14.064792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd645cac527c54af5ba6cbf23f415cad9', 'request_id': 'req-69eecd3e-c701-42be-a159-0732de4ceaf7'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:14.088446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] The token cache is being invalidate because project d645cac527c54af5ba6cbf23f415cad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:39:14.088744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:14.089449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-69eecd3e-c701-42be-a159-0732de4ceaf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:14.094929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1180/2347] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:39:13 2022] DELETE /identity/v3/projects/d645cac527c54af5ba6cbf23f415cad9 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:39:14.100574 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd559fe6-22db-4511-b52b-5bc1449c2076 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:14.103071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd559fe6-22db-4511-b52b-5bc1449c2076 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:14.103873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd559fe6-22db-4511-b52b-5bc1449c2076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:14.150182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-cd559fe6-22db-4511-b52b-5bc1449c2076 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:14.152069 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cd559fe6-22db-4511-b52b-5bc1449c2076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:14.291263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1168/2348] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:14.299114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72580a6-425b-4a1f-83e0-18a27170bf58 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:14.299114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72580a6-425b-4a1f-83e0-18a27170bf58 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:14.299385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72580a6-425b-4a1f-83e0-18a27170bf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:14.330101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-e72580a6-425b-4a1f-83e0-18a27170bf58 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:14.332118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e72580a6-425b-4a1f-83e0-18a27170bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:14.344773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1181/2349] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:14.349504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd559fe6-22db-4511-b52b-5bc1449c2076 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:14.361544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd559fe6-22db-4511-b52b-5bc1449c2076 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:14.392664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55253c02-729e-4a77-a733-e139bd81b6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:14.393469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253c02-729e-4a77-a733-e139bd81b6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:14.394023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253c02-729e-4a77-a733-e139bd81b6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:14.394312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55253c02-729e-4a77-a733-e139bd81b6a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:14.395097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55253c02-729e-4a77-a733-e139bd81b6a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:39:14.395654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55253c02-729e-4a77-a733-e139bd81b6a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:14.398072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55253c02-729e-4a77-a733-e139bd81b6a7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:14.417618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1169/2350] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:39:14.422678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72580a6-425b-4a1f-83e0-18a27170bf58 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:14.432697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72580a6-425b-4a1f-83e0-18a27170bf58 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:14.438276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79548c-f905-41e5-ab28-68ac67668a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:14.438882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79548c-f905-41e5-ab28-68ac67668a19 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:14.439156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79548c-f905-41e5-ab28-68ac67668a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:14.439424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79548c-f905-41e5-ab28-68ac67668a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:14.440039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79548c-f905-41e5-ab28-68ac67668a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:14.441992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79548c-f905-41e5-ab28-68ac67668a19 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:14.529356 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:14.537214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1182/2351] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:39:14 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:39:14.543150 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55253c02-729e-4a77-a733-e139bd81b6a7 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:14.563133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55253c02-729e-4a77-a733-e139bd81b6a7 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:14.683536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8e95b-5940-4775-bd19-ccda6dfac9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:14.684274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8e95b-5940-4775-bd19-ccda6dfac9ef admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:14.684620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8e95b-5940-4775-bd19-ccda6dfac9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:14.685016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8e95b-5940-4775-bd19-ccda6dfac9ef admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:14.685761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8e95b-5940-4775-bd19-ccda6dfac9ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:14.687851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8e95b-5940-4775-bd19-ccda6dfac9ef admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:14.799298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1170/2352] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:39:14 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:39:14.803669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79548c-f905-41e5-ab28-68ac67668a19 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:14.819949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79548c-f905-41e5-ab28-68ac67668a19 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:14.825847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d1cb7-b9ec-48f7-893f-130546fb3dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:14.827094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d1cb7-b9ec-48f7-893f-130546fb3dff admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:14.827795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d1cb7-b9ec-48f7-893f-130546fb3dff admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:14.828448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d1cb7-b9ec-48f7-893f-130546fb3dff admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:14.829675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d1cb7-b9ec-48f7-893f-130546fb3dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:14.831393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d1cb7-b9ec-48f7-893f-130546fb3dff admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:14.843775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1183/2353] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:39:14.848652 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8e95b-5940-4775-bd19-ccda6dfac9ef admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:14.858781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8e95b-5940-4775-bd19-ccda6dfac9ef admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:14.863914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86df39-ae9e-46b6-8c26-02b7661396c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:14.864614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86df39-ae9e-46b6-8c26-02b7661396c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:14.865168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86df39-ae9e-46b6-8c26-02b7661396c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:14.865610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86df39-ae9e-46b6-8c26-02b7661396c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:14.866344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86df39-ae9e-46b6-8c26-02b7661396c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:14.868258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86df39-ae9e-46b6-8c26-02b7661396c9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:14.901721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1171/2354] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:39:14.903170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d1cb7-b9ec-48f7-893f-130546fb3dff admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:14.919910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d1cb7-b9ec-48f7-893f-130546fb3dff admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:14.927409 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde5d5d-1ac2-4dc7-9d72-516842942166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:14.928299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5d5d-1ac2-4dc7-9d72-516842942166 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:14.928688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5d5d-1ac2-4dc7-9d72-516842942166 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:14.929069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5d5d-1ac2-4dc7-9d72-516842942166 admin admin] PATH_INFO: `/v3/projects/1e7e5f44318b454e8d478188159d526a/users/e6be4a5ac197442990ac259703632b29/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:14.953019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde5d5d-1ac2-4dc7-9d72-516842942166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e7e5f44318b454e8d478188159d526a, user_id=e6be4a5ac197442990ac259703632b29, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:14.957706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde5d5d-1ac2-4dc7-9d72-516842942166 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:15.034092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1184/2355] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:39:14 2022] PUT /identity/v3/projects/1e7e5f44318b454e8d478188159d526a/users/e6be4a5ac197442990ac259703632b29/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:15.046243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf7b4c-0bcb-4c76-829e-bd7fb0a2a12e None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:15.046664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf7b4c-0bcb-4c76-829e-bd7fb0a2a12e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:15.047021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf7b4c-0bcb-4c76-829e-bd7fb0a2a12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:15.083771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:15.089653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-56cf7b4c-0bcb-4c76-829e-bd7fb0a2a12e None None] MFA Rules not processed for user `e6be4a5ac197442990ac259703632b29`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:15.089653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-56cf7b4c-0bcb-4c76-829e-bd7fb0a2a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:15.226861 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde5d5d-1ac2-4dc7-9d72-516842942166 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:15.229462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1172/2356] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:15.324519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde5d5d-1ac2-4dc7-9d72-516842942166 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:15.331993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3ec2d-07a3-4e66-b7b8-75cac9143165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:15.333074 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3ec2d-07a3-4e66-b7b8-75cac9143165 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:15.333536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3ec2d-07a3-4e66-b7b8-75cac9143165 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:15.333995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3ec2d-07a3-4e66-b7b8-75cac9143165 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:15.334958 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3ec2d-07a3-4e66-b7b8-75cac9143165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:15.337508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3ec2d-07a3-4e66-b7b8-75cac9143165 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:15.445215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1185/2357] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:39:15 2022] POST /identity/v3/projects => generated 385 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:39:15.450883 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf7b4c-0bcb-4c76-829e-bd7fb0a2a12e None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:15.471112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf7b4c-0bcb-4c76-829e-bd7fb0a2a12e None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:15.575738 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e1c4e-ee7c-4064-9667-de601529c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:15.578495 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e1c4e-ee7c-4064-9667-de601529c61e admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:15.579062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e1c4e-ee7c-4064-9667-de601529c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:15.583652 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e1c4e-ee7c-4064-9667-de601529c61e admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:15.583652 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e1c4e-ee7c-4064-9667-de601529c61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:15.584856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e1c4e-ee7c-4064-9667-de601529c61e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:15.697356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1173/2358] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:39:15 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:39:15.699319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3ec2d-07a3-4e66-b7b8-75cac9143165 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:15.723062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3ec2d-07a3-4e66-b7b8-75cac9143165 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:15.731467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faedfc1-0180-45b6-b694-300d9da516d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:15.732132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faedfc1-0180-45b6-b694-300d9da516d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:15.732427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faedfc1-0180-45b6-b694-300d9da516d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:15.732784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faedfc1-0180-45b6-b694-300d9da516d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:15.733368 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faedfc1-0180-45b6-b694-300d9da516d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:15.735147 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faedfc1-0180-45b6-b694-300d9da516d6 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:15.762071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1186/2359] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:39:15.762891 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e1c4e-ee7c-4064-9667-de601529c61e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:15.789093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e1c4e-ee7c-4064-9667-de601529c61e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:15.796927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff542c6-bdb0-4510-b5b0-722c848bcc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:15.797940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff542c6-bdb0-4510-b5b0-722c848bcc4e admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:15.798331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff542c6-bdb0-4510-b5b0-722c848bcc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:15.798712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff542c6-bdb0-4510-b5b0-722c848bcc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:15.799493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff542c6-bdb0-4510-b5b0-722c848bcc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:15.801248 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff542c6-bdb0-4510-b5b0-722c848bcc4e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:15.817628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1174/2360] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:39:15.827925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faedfc1-0180-45b6-b694-300d9da516d6 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:15.838253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faedfc1-0180-45b6-b694-300d9da516d6 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:15.849391 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a073d3-c78a-47c5-9f51-c41ac26254c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:15.850120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a073d3-c78a-47c5-9f51-c41ac26254c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:15.850406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a073d3-c78a-47c5-9f51-c41ac26254c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:15.850686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a073d3-c78a-47c5-9f51-c41ac26254c4 admin admin] PATH_INFO: `/v3/projects/0b538f5dfcbd4be2bdfbfa82915bad72/users/008cf41330af41aa8887e704cb44256c/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:15.869060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a073d3-c78a-47c5-9f51-c41ac26254c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b538f5dfcbd4be2bdfbfa82915bad72, user_id=008cf41330af41aa8887e704cb44256c, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:15.872041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a073d3-c78a-47c5-9f51-c41ac26254c4 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:16.410749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30e2b-150b-46ac-bd7b-c0cc923fcf8a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:16.412179 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30e2b-150b-46ac-bd7b-c0cc923fcf8a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:16.412730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30e2b-150b-46ac-bd7b-c0cc923fcf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:16.438234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-e2a30e2b-150b-46ac-bd7b-c0cc923fcf8a None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:16.439588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e2a30e2b-150b-46ac-bd7b-c0cc923fcf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:16.442825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1187/2361] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:39:15 2022] PUT /identity/v3/projects/0b538f5dfcbd4be2bdfbfa82915bad72/users/008cf41330af41aa8887e704cb44256c/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:39:16.455044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e8f1-fc89-4590-be4d-261f371fad3c None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:16.458022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e8f1-fc89-4590-be4d-261f371fad3c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:16.458022 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e8f1-fc89-4590-be4d-261f371fad3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:16.502946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f235e8f1-fc89-4590-be4d-261f371fad3c None None] MFA Rules not processed for user `008cf41330af41aa8887e704cb44256c`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:16.504823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f235e8f1-fc89-4590-be4d-261f371fad3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:16.550587 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1175/2362] 10.222.0.74 () {58 vars in 967 bytes} [Wed Aug 31 00:39:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:39:16.574643 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a30e2b-150b-46ac-bd7b-c0cc923fcf8a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:16.580172 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e2a30e2b-150b-46ac-bd7b-c0cc923fcf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:16.643963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:16.648174 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1188/2363] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:39:16.654975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235e8f1-fc89-4590-be4d-261f371fad3c None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:16.667427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:16.761860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a30e2b-150b-46ac-bd7b-c0cc923fcf8a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:16.782042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38713377-19ea-44c7-8a14-fb283c4e3af6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:16.782974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38713377-19ea-44c7-8a14-fb283c4e3af6 service swift] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:16.783360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38713377-19ea-44c7-8a14-fb283c4e3af6 service swift] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:16.783811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38713377-19ea-44c7-8a14-fb283c4e3af6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:16.810629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235e8f1-fc89-4590-be4d-261f371fad3c None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:16.811402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38713377-19ea-44c7-8a14-fb283c4e3af6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:16.813438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38713377-19ea-44c7-8a14-fb283c4e3af6 service swift] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:16.827149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059497-67be-40fa-856b-99505f854720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:16.828559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059497-67be-40fa-856b-99505f854720 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:16.830204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059497-67be-40fa-856b-99505f854720 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:16.830884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d059497-67be-40fa-856b-99505f854720 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:16.832281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d059497-67be-40fa-856b-99505f854720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:16.835170 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1176/2364] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:39:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:39:16.838374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d059497-67be-40fa-856b-99505f854720 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:16.963671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1189/2365] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:39:16 2022] POST /identity/v3/projects => generated 383 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:39:16.964102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38713377-19ea-44c7-8a14-fb283c4e3af6 service swift] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:16.980392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38713377-19ea-44c7-8a14-fb283c4e3af6 service swift] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:17.091152 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb01af-757f-41ea-8e9d-f5517d222622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:17.092026 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb01af-757f-41ea-8e9d-f5517d222622 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:17.092397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb01af-757f-41ea-8e9d-f5517d222622 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:17.092780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb01af-757f-41ea-8e9d-f5517d222622 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:17.093976 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb01af-757f-41ea-8e9d-f5517d222622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:17.097813 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb01af-757f-41ea-8e9d-f5517d222622 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:17.416708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1177/2366] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:39:16 2022] POST /identity/v3/users => generated 298 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:39:17.422109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059497-67be-40fa-856b-99505f854720 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:17.439426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d059497-67be-40fa-856b-99505f854720 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:17.446314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7f8c-82ec-465e-8791-f1ad7a03e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:17.447074 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7f8c-82ec-465e-8791-f1ad7a03e02d admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:17.447424 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7f8c-82ec-465e-8791-f1ad7a03e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:17.447743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c7f8c-82ec-465e-8791-f1ad7a03e02d admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:17.448514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c7f8c-82ec-465e-8791-f1ad7a03e02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:17.450253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c7f8c-82ec-465e-8791-f1ad7a03e02d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:17.464495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1190/2367] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:39:17.469125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb01af-757f-41ea-8e9d-f5517d222622 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:17.481416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb01af-757f-41ea-8e9d-f5517d222622 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:17.494621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec312a61-5bc4-487e-99d3-c0c3a38621f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:17.497802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec312a61-5bc4-487e-99d3-c0c3a38621f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:17.503789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec312a61-5bc4-487e-99d3-c0c3a38621f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:17.503789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec312a61-5bc4-487e-99d3-c0c3a38621f9 admin admin] PATH_INFO: `/v3/projects/6d0a37f284ef46ed9457065753eaea53/users/821394ca62044098b66ca193fcbc7268/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:17.531034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec312a61-5bc4-487e-99d3-c0c3a38621f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0a37f284ef46ed9457065753eaea53, user_id=821394ca62044098b66ca193fcbc7268, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:17.534074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec312a61-5bc4-487e-99d3-c0c3a38621f9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:17.632439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1178/2368] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:39:17 2022] PUT /identity/v3/projects/6d0a37f284ef46ed9457065753eaea53/users/821394ca62044098b66ca193fcbc7268/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:17.635579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7f8c-82ec-465e-8791-f1ad7a03e02d admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:17.648099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c7f8c-82ec-465e-8791-f1ad7a03e02d admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:17.716212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1412d-44c4-44d1-839a-3faca34f9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:17.716728 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1412d-44c4-44d1-839a-3faca34f9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:17.717081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1412d-44c4-44d1-839a-3faca34f9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:17.717263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1412d-44c4-44d1-839a-3faca34f9b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:17.717950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1412d-44c4-44d1-839a-3faca34f9b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:17.719608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1412d-44c4-44d1-839a-3faca34f9b46 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:17.730648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1191/2369] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:39:17.734857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec312a61-5bc4-487e-99d3-c0c3a38621f9 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:17.745471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec312a61-5bc4-487e-99d3-c0c3a38621f9 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:17.750144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06159bc6-e591-42c6-965d-ec27465617df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:17.750803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06159bc6-e591-42c6-965d-ec27465617df admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:17.751083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06159bc6-e591-42c6-965d-ec27465617df admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:17.751353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06159bc6-e591-42c6-965d-ec27465617df admin admin] PATH_INFO: `/v3/projects/6d0a37f284ef46ed9457065753eaea53/users/821394ca62044098b66ca193fcbc7268/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:17.753235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06159bc6-e591-42c6-965d-ec27465617df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0a37f284ef46ed9457065753eaea53, user_id=821394ca62044098b66ca193fcbc7268, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:17.755930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06159bc6-e591-42c6-965d-ec27465617df admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:17.767614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1179/2370] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:39:17 2022] PUT /identity/v3/projects/6d0a37f284ef46ed9457065753eaea53/users/821394ca62044098b66ca193fcbc7268/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:17.779239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2868c9-3a89-4bdb-9e4e-b5f363007d16 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:17.779620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2868c9-3a89-4bdb-9e4e-b5f363007d16 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:17.779939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2868c9-3a89-4bdb-9e4e-b5f363007d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:17.824873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-bb2868c9-3a89-4bdb-9e4e-b5f363007d16 None None] MFA Rules not processed for user `821394ca62044098b66ca193fcbc7268`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:17.826619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bb2868c9-3a89-4bdb-9e4e-b5f363007d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:17.952024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:18.017146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1192/2371] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:18.029290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06159bc6-e591-42c6-965d-ec27465617df admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:18.031355 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-06159bc6-e591-42c6-965d-ec27465617df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:18.166556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06159bc6-e591-42c6-965d-ec27465617df admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:18.171551 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c876914-ee79-47da-8917-d6a9c0187ee1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:18.172321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c876914-ee79-47da-8917-d6a9c0187ee1 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:18.172710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c876914-ee79-47da-8917-d6a9c0187ee1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:18.172985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c876914-ee79-47da-8917-d6a9c0187ee1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:18.205593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:18.266757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c876914-ee79-47da-8917-d6a9c0187ee1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:18.269533 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c876914-ee79-47da-8917-d6a9c0187ee1 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:18.287088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1180/2372] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:22.093306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2868c9-3a89-4bdb-9e4e-b5f363007d16 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:22.112762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2868c9-3a89-4bdb-9e4e-b5f363007d16 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:22.120285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f6800-c704-472f-adb4-0e96a7f3ba21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:22.121716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f6800-c704-472f-adb4-0e96a7f3ba21 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:22.122433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f6800-c704-472f-adb4-0e96a7f3ba21 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:22.123466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f6800-c704-472f-adb4-0e96a7f3ba21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:22.274876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f6800-c704-472f-adb4-0e96a7f3ba21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:22.276463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f6800-c704-472f-adb4-0e96a7f3ba21 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:22.301201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1193/2373] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:22.926758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c9b0-6f35-4c2a-9efc-ca2290f019b0 None None] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:22.927329 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c9b0-6f35-4c2a-9efc-ca2290f019b0 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:22.927747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c9b0-6f35-4c2a-9efc-ca2290f019b0 None None] PATH_INFO: `/` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:22.929938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1181/2374] 10.222.0.74 () {54 vars in 921 bytes} [Wed Aug 31 00:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 00:39:22.936926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e7271-e72c-4e19-8302-53c614868a02 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:22.937362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e7271-e72c-4e19-8302-53c614868a02 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:22.937771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e7271-e72c-4e19-8302-53c614868a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:22.966881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-392e7271-e72c-4e19-8302-53c614868a02 None None] MFA Rules not processed for user `5f8c004b9fe2402fbe94cfd7c2bf949e`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:22.968099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-392e7271-e72c-4e19-8302-53c614868a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:23.064257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1194/2375] 10.222.0.74 () {58 vars in 1018 bytes} [Wed Aug 31 00:39:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:23.079283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110c9b0-6f35-4c2a-9efc-ca2290f019b0 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:23.081385 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-3110c9b0-6f35-4c2a-9efc-ca2290f019b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:23.105525 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110c9b0-6f35-4c2a-9efc-ca2290f019b0 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:23.111194 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a060fb6-ce41-4b6f-835b-93605a899229 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:23.111801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a060fb6-ce41-4b6f-835b-93605a899229 service placement] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:23.112079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a060fb6-ce41-4b6f-835b-93605a899229 service placement] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:23.112354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a060fb6-ce41-4b6f-835b-93605a899229 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:23.124710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a060fb6-ce41-4b6f-835b-93605a899229 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:23.126549 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a060fb6-ce41-4b6f-835b-93605a899229 service placement] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:23.143647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1182/2376] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:39:23.178264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e7271-e72c-4e19-8302-53c614868a02 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:23.183867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-392e7271-e72c-4e19-8302-53c614868a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:23.283709 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e7271-e72c-4e19-8302-53c614868a02 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:23.290718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c99de1-b87b-4737-bd94-2830a9b5be3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:23.292719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c99de1-b87b-4737-bd94-2830a9b5be3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:23.292719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c99de1-b87b-4737-bd94-2830a9b5be3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:23.292719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c99de1-b87b-4737-bd94-2830a9b5be3c admin admin] PATH_INFO: `/v3/users/7529bc6957284314b72d0bc10c4f7088` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:23.295587 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c99de1-b87b-4737-bd94-2830a9b5be3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7529bc6957284314b72d0bc10c4f7088)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:23.297541 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c99de1-b87b-4737-bd94-2830a9b5be3c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:23.624445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:23.634034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-03c99de1-b87b-4737-bd94-2830a9b5be3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7529bc6957284314b72d0bc10c4f7088'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:23.648873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-03c99de1-b87b-4737-bd94-2830a9b5be3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7529bc6957284314b72d0bc10c4f7088'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:23.661168 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-03c99de1-b87b-4737-bd94-2830a9b5be3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7529bc6957284314b72d0bc10c4f7088'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:23.792390 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-03c99de1-b87b-4737-bd94-2830a9b5be3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7529bc6957284314b72d0bc10c4f7088'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:23.793036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-03c99de1-b87b-4737-bd94-2830a9b5be3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7529bc6957284314b72d0bc10c4f7088'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:23.801048 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1195/2377] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:39:23 2022] DELETE /identity/v3/users/7529bc6957284314b72d0bc10c4f7088 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:24.144762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a060fb6-ce41-4b6f-835b-93605a899229 service placement] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:24.158167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a060fb6-ce41-4b6f-835b-93605a899229 service placement] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:24.248674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:24.249304 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:24.249618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:24.249899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] PATH_INFO: `/v3/projects/527ee490f48c4f5895f8d01dd3595007` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:24.252599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527ee490f48c4f5895f8d01dd3595007)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:24.255506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:24.438550 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527ee490f48c4f5895f8d01dd3595007', 'request_id': 'req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:24.445741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527ee490f48c4f5895f8d01dd3595007', 'request_id': 'req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:24.452816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527ee490f48c4f5895f8d01dd3595007', 'request_id': 'req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:24.559600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] The token cache is being invalidate because project 527ee490f48c4f5895f8d01dd3595007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:39:24.562198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:24.562198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:24.563482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1183/2378] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:39:24 2022] DELETE /identity/v3/projects/527ee490f48c4f5895f8d01dd3595007 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:24.569505 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3965d-e1ac-451a-b9f6-8b5f59e784a8 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:24.570443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3965d-e1ac-451a-b9f6-8b5f59e784a8 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:24.570620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3965d-e1ac-451a-b9f6-8b5f59e784a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:24.602674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f1d3965d-e1ac-451a-b9f6-8b5f59e784a8 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:24.604624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f1d3965d-e1ac-451a-b9f6-8b5f59e784a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:24.677335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:24.679684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:24.732611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1196/2379] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:39:24.735408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a755c15-114e-413f-b323-b3775ebb3fac None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:24.735931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a755c15-114e-413f-b323-b3775ebb3fac None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:24.736449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a755c15-114e-413f-b323-b3775ebb3fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:24.759655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:24.765757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2a755c15-114e-413f-b323-b3775ebb3fac None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:24.767928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2a755c15-114e-413f-b323-b3775ebb3fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:24.778062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4a9aa-aed3-4ea3-949a-101f88eaef97 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:24.782083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1197/2380] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:24.785914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77c314-aeb6-4520-9055-f71be57878bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:24.785914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77c314-aeb6-4520-9055-f71be57878bd service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:24.785914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77c314-aeb6-4520-9055-f71be57878bd service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:24.785914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77c314-aeb6-4520-9055-f71be57878bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:24.786937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bb77c314-aeb6-4520-9055-f71be57878bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:24.797978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a755c15-114e-413f-b323-b3775ebb3fac None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:24.806036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a755c15-114e-413f-b323-b3775ebb3fac None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:24.813870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf252ce3-65d2-4e25-aae9-474db47a080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:24.815065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf252ce3-65d2-4e25-aae9-474db47a080a admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:24.815651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf252ce3-65d2-4e25-aae9-474db47a080a admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:24.816233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf252ce3-65d2-4e25-aae9-474db47a080a admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:24.817529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf252ce3-65d2-4e25-aae9-474db47a080a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:39:24.818256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf252ce3-65d2-4e25-aae9-474db47a080a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:24.822256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf252ce3-65d2-4e25-aae9-474db47a080a admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:24.845611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1198/2381] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:39:24.852142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf252ce3-65d2-4e25-aae9-474db47a080a admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:24.869265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf252ce3-65d2-4e25-aae9-474db47a080a admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:24.877550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69edee-8f1e-4c95-8198-fb8eeeaafc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:24.878287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69edee-8f1e-4c95-8198-fb8eeeaafc1c admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:24.878786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69edee-8f1e-4c95-8198-fb8eeeaafc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:24.879526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69edee-8f1e-4c95-8198-fb8eeeaafc1c admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:24.880453 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69edee-8f1e-4c95-8198-fb8eeeaafc1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:24.884845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69edee-8f1e-4c95-8198-fb8eeeaafc1c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:24.902806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77c314-aeb6-4520-9055-f71be57878bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:24.905223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77c314-aeb6-4520-9055-f71be57878bd service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:24.935849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1184/2382] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:39:25.057811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1199/2383] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:39:24 2022] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:39:25.062191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77c314-aeb6-4520-9055-f71be57878bd service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:25.080779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77c314-aeb6-4520-9055-f71be57878bd service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:25.156344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ebdf-a856-4155-8ba1-b53e34e7772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:25.157053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ebdf-a856-4155-8ba1-b53e34e7772f admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:25.157259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ebdf-a856-4155-8ba1-b53e34e7772f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:25.157540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ebdf-a856-4155-8ba1-b53e34e7772f admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:25.158238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4ebdf-a856-4155-8ba1-b53e34e7772f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:25.160185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4ebdf-a856-4155-8ba1-b53e34e7772f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:25.279796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1185/2384] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:39:25 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:39:25.284413 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69edee-8f1e-4c95-8198-fb8eeeaafc1c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:25.296337 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69edee-8f1e-4c95-8198-fb8eeeaafc1c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:25.303850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3128f8-7c83-446d-a41d-e30d35a417b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:25.305339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3128f8-7c83-446d-a41d-e30d35a417b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:25.305881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3128f8-7c83-446d-a41d-e30d35a417b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:25.306333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3128f8-7c83-446d-a41d-e30d35a417b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:25.307499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3128f8-7c83-446d-a41d-e30d35a417b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:25.310502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3128f8-7c83-446d-a41d-e30d35a417b6 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:25.327355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1200/2385] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:39:25.333490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ebdf-a856-4155-8ba1-b53e34e7772f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:25.345095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ebdf-a856-4155-8ba1-b53e34e7772f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:25.349922 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53a2cf-f830-42a7-b47c-bf068e753c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:25.350630 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a2cf-f830-42a7-b47c-bf068e753c48 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:25.350897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a2cf-f830-42a7-b47c-bf068e753c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:25.351819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a2cf-f830-42a7-b47c-bf068e753c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:25.352352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53a2cf-f830-42a7-b47c-bf068e753c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:25.354133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53a2cf-f830-42a7-b47c-bf068e753c48 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:25.365944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1186/2386] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:39:25.373331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3128f8-7c83-446d-a41d-e30d35a417b6 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:25.383773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3128f8-7c83-446d-a41d-e30d35a417b6 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:25.388867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c682566-e4d8-4f71-bf8c-d52b5f9906f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:25.389558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c682566-e4d8-4f71-bf8c-d52b5f9906f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:25.389871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c682566-e4d8-4f71-bf8c-d52b5f9906f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:25.390143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c682566-e4d8-4f71-bf8c-d52b5f9906f4 admin admin] PATH_INFO: `/v3/projects/64d454f048144c1cbd4f18e48e1ba50c/users/d2bea5c77d2a47759d4ba925630c8d54/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:25.406105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c682566-e4d8-4f71-bf8c-d52b5f9906f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d454f048144c1cbd4f18e48e1ba50c, user_id=d2bea5c77d2a47759d4ba925630c8d54, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:25.409026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c682566-e4d8-4f71-bf8c-d52b5f9906f4 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:25.563190 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1201/2387] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:39:25 2022] PUT /identity/v3/projects/64d454f048144c1cbd4f18e48e1ba50c/users/d2bea5c77d2a47759d4ba925630c8d54/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:25.569831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725527-1b77-45b7-886f-398213d11d81 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:25.570139 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725527-1b77-45b7-886f-398213d11d81 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:25.571074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71725527-1b77-45b7-886f-398213d11d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:25.593285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-71725527-1b77-45b7-886f-398213d11d81 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:25.594558 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-71725527-1b77-45b7-886f-398213d11d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:25.676730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1187/2388] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:25.692049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c682566-e4d8-4f71-bf8c-d52b5f9906f4 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:25.694393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2c682566-e4d8-4f71-bf8c-d52b5f9906f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:25.752896 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:25.780239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c682566-e4d8-4f71-bf8c-d52b5f9906f4 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:25.784290 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83020c-9cae-4604-8cd2-77938b8a832d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:25.784956 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83020c-9cae-4604-8cd2-77938b8a832d service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:25.785245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83020c-9cae-4604-8cd2-77938b8a832d service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:25.785521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83020c-9cae-4604-8cd2-77938b8a832d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:25.796868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83020c-9cae-4604-8cd2-77938b8a832d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:25.799113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83020c-9cae-4604-8cd2-77938b8a832d service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:25.810342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1202/2389] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:26.858234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70614e-bf39-4049-8627-9ad540de2e52 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:26.858721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70614e-bf39-4049-8627-9ad540de2e52 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:26.859374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70614e-bf39-4049-8627-9ad540de2e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:26.880134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-ff70614e-bf39-4049-8627-9ad540de2e52 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:26.881441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ff70614e-bf39-4049-8627-9ad540de2e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:26.890186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1188/2390] 10.222.0.78 () {58 vars in 1016 bytes} [Wed Aug 31 00:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:26.912594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83020c-9cae-4604-8cd2-77938b8a832d service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:26.915738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3e83020c-9cae-4604-8cd2-77938b8a832d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:26.997254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83020c-9cae-4604-8cd2-77938b8a832d service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:27.003383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a423b-8c89-4edd-af22-bc29fffc70af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:27.004002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a423b-8c89-4edd-af22-bc29fffc70af service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:27.004281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a423b-8c89-4edd-af22-bc29fffc70af service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:27.004550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a423b-8c89-4edd-af22-bc29fffc70af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:27.014053 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a423b-8c89-4edd-af22-bc29fffc70af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:27.015713 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a423b-8c89-4edd-af22-bc29fffc70af service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:27.026265 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1203/2391] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:27.307424 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70614e-bf39-4049-8627-9ad540de2e52 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:27.309002 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ff70614e-bf39-4049-8627-9ad540de2e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:27.327344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:27.391415 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70614e-bf39-4049-8627-9ad540de2e52 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:27.396594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa85567-4fa5-4f75-81dd-b0017d3ba930 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:27.397216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85567-4fa5-4f75-81dd-b0017d3ba930 service placement] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:27.397499 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85567-4fa5-4f75-81dd-b0017d3ba930 service placement] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:27.397806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa85567-4fa5-4f75-81dd-b0017d3ba930 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:27.399794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-caa85567-4fa5-4f75-81dd-b0017d3ba930 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:27.416654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa85567-4fa5-4f75-81dd-b0017d3ba930 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:27.419639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa85567-4fa5-4f75-81dd-b0017d3ba930 service placement] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:27.432199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1189/2392] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:30.243350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a423b-8c89-4edd-af22-bc29fffc70af service nova] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:30.245124 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b49a423b-8c89-4edd-af22-bc29fffc70af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:30.266704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a423b-8c89-4edd-af22-bc29fffc70af service nova] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:30.272394 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:30.272682 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:30.273005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:30.273274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] PATH_INFO: `/v3/users/e6be4a5ac197442990ac259703632b29` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:30.274750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6be4a5ac197442990ac259703632b29)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:30.276723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:30.475090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6be4a5ac197442990ac259703632b29'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:30.489622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6be4a5ac197442990ac259703632b29'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:30.498490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6be4a5ac197442990ac259703632b29'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:30.584576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6be4a5ac197442990ac259703632b29'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:30.585758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6be4a5ac197442990ac259703632b29'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:30.594823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1204/2393] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:39:30 2022] DELETE /identity/v3/users/e6be4a5ac197442990ac259703632b29 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:30.599381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90439fdf-52e7-43e0-ad92-f70204be4d93 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:30.599867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90439fdf-52e7-43e0-ad92-f70204be4d93 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:30.600233 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90439fdf-52e7-43e0-ad92-f70204be4d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:30.622527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-90439fdf-52e7-43e0-ad92-f70204be4d93 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:30.623945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-90439fdf-52e7-43e0-ad92-f70204be4d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:30.694433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1190/2394] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:39:30.703250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:30.706247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:30.765401 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:30.784209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b98275-d0ee-4052-ba9e-f2924c63a98c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:30.789211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eee9c-2daf-4dd6-9610-c1a49d3e15c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:30.790103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eee9c-2daf-4dd6-9610-c1a49d3e15c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:30.790693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eee9c-2daf-4dd6-9610-c1a49d3e15c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:30.790970 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eee9c-2daf-4dd6-9610-c1a49d3e15c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:30.800757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296eee9c-2daf-4dd6-9610-c1a49d3e15c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:30.802263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296eee9c-2daf-4dd6-9610-c1a49d3e15c2 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:30.813890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1205/2395] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:31.701556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90439fdf-52e7-43e0-ad92-f70204be4d93 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:31.703052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-90439fdf-52e7-43e0-ad92-f70204be4d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:31.715434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90439fdf-52e7-43e0-ad92-f70204be4d93 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:31.725823 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:31.733050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:31.733050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:31.733050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] PATH_INFO: `/v3/projects/1e7e5f44318b454e8d478188159d526a` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:31.733050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e7e5f44318b454e8d478188159d526a)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:31.733050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:31.934970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e7e5f44318b454e8d478188159d526a', 'request_id': 'req-67b268b4-e92b-4b28-90f6-46827e6599e1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:31.943767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e7e5f44318b454e8d478188159d526a', 'request_id': 'req-67b268b4-e92b-4b28-90f6-46827e6599e1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:31.953090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e7e5f44318b454e8d478188159d526a', 'request_id': 'req-67b268b4-e92b-4b28-90f6-46827e6599e1'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:32.063092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] The token cache is being invalidate because project 1e7e5f44318b454e8d478188159d526a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:39:32.064275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:32.065270 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-67b268b4-e92b-4b28-90f6-46827e6599e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:32.067120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1191/2396] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:39:31 2022] DELETE /identity/v3/projects/1e7e5f44318b454e8d478188159d526a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:32.071406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eee9c-2daf-4dd6-9610-c1a49d3e15c2 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:32.082611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296eee9c-2daf-4dd6-9610-c1a49d3e15c2 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:32.170818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:32.171468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:32.171825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:32.172402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] PATH_INFO: `/v3/users/008cf41330af41aa8887e704cb44256c` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:32.173808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] RBAC: Authorizing `identity:delete_user(user_id=008cf41330af41aa8887e704cb44256c)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:32.176228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:32.377669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008cf41330af41aa8887e704cb44256c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:32.411375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008cf41330af41aa8887e704cb44256c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:32.419354 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008cf41330af41aa8887e704cb44256c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:32.499294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008cf41330af41aa8887e704cb44256c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:32.499967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008cf41330af41aa8887e704cb44256c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:32.514919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1206/2397] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:39:32 2022] DELETE /identity/v3/users/008cf41330af41aa8887e704cb44256c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:32.908773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ad27-fa94-4c24-b454-5bd4448f6dd1 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:32.908773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ad27-fa94-4c24-b454-5bd4448f6dd1 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:32.908773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974ad27-fa94-4c24-b454-5bd4448f6dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:32.935048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0974ad27-fa94-4c24-b454-5bd4448f6dd1 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:32.936987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0974ad27-fa94-4c24-b454-5bd4448f6dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:32.953124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:33.040603 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1192/2398] 10.222.0.74 () {58 vars in 967 bytes} [Wed Aug 31 00:39:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:33.058399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:33.060012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:33.203697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62b81f-8343-4ef9-ac4e-c015444cebb3 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:33.204108 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62b81f-8343-4ef9-ac4e-c015444cebb3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:33.204529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62b81f-8343-4ef9-ac4e-c015444cebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:33.207183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:33.214996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b5dd7-f9f5-4405-bb94-ed7157a2594a admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:33.221157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacb869-adb4-4dd6-8c9a-add4ae23c2a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:33.222712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacb869-adb4-4dd6-8c9a-add4ae23c2a8 service swift] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:33.223180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacb869-adb4-4dd6-8c9a-add4ae23c2a8 service swift] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:33.223605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacb869-adb4-4dd6-8c9a-add4ae23c2a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:33.239881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacb869-adb4-4dd6-8c9a-add4ae23c2a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:33.241694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eacb869-adb4-4dd6-8c9a-add4ae23c2a8 service swift] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:33.248118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0d62b81f-8343-4ef9-ac4e-c015444cebb3 None None] MFA Rules not processed for user `d2bea5c77d2a47759d4ba925630c8d54`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:33.249463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0d62b81f-8343-4ef9-ac4e-c015444cebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:33.253683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1207/2399] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:39:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:39:33.279799 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacb869-adb4-4dd6-8c9a-add4ae23c2a8 service swift] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:33.282308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0eacb869-adb4-4dd6-8c9a-add4ae23c2a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:33.356984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1193/2400] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:33.361642 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62b81f-8343-4ef9-ac4e-c015444cebb3 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:33.363448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0d62b81f-8343-4ef9-ac4e-c015444cebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:33.399700 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eacb869-adb4-4dd6-8c9a-add4ae23c2a8 service swift] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:33.412616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:33.413489 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:33.413698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:33.414130 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] PATH_INFO: `/v3/projects/0b538f5dfcbd4be2bdfbfa82915bad72` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:33.415352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b538f5dfcbd4be2bdfbfa82915bad72)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:33.417347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:33.453181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d62b81f-8343-4ef9-ac4e-c015444cebb3 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:33.458430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2debe-7d13-42c0-b322-967b07071f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:33.459061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2debe-7d13-42c0-b322-967b07071f59 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:33.459359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2debe-7d13-42c0-b322-967b07071f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:33.459629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2debe-7d13-42c0-b322-967b07071f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:33.460926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2debe-7d13-42c0-b322-967b07071f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:33.463263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2debe-7d13-42c0-b322-967b07071f59 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:33.606460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b538f5dfcbd4be2bdfbfa82915bad72', 'request_id': 'req-7300d46d-3b22-4061-9508-76e4cb3ecd33'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:33.607981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1194/2401] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:39:33 2022] POST /identity/v3/projects => generated 371 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:39:33.612238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2debe-7d13-42c0-b322-967b07071f59 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:33.677508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2debe-7d13-42c0-b322-967b07071f59 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:33.682724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a015018-04f7-4d53-bb45-b563a993295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:33.683331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a015018-04f7-4d53-bb45-b563a993295d admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:33.683616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a015018-04f7-4d53-bb45-b563a993295d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:33.684293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a015018-04f7-4d53-bb45-b563a993295d admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:33.684535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a015018-04f7-4d53-bb45-b563a993295d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:33.686792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a015018-04f7-4d53-bb45-b563a993295d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:33.704860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:33.770692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b538f5dfcbd4be2bdfbfa82915bad72', 'request_id': 'req-7300d46d-3b22-4061-9508-76e4cb3ecd33'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:33.780788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b538f5dfcbd4be2bdfbfa82915bad72', 'request_id': 'req-7300d46d-3b22-4061-9508-76e4cb3ecd33'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:33.805486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] The token cache is being invalidate because project 0b538f5dfcbd4be2bdfbfa82915bad72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:39:33.805850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:33.806529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:33.808024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1208/2402] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:39:33 2022] DELETE /identity/v3/projects/0b538f5dfcbd4be2bdfbfa82915bad72 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:33.810247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1195/2403] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:39:33 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:39:33.811835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a015018-04f7-4d53-bb45-b563a993295d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:33.811990 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:33.813342 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:33.814466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2a015018-04f7-4d53-bb45-b563a993295d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:33.829497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a015018-04f7-4d53-bb45-b563a993295d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:33.836128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:33.837769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:33.838045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:33.838327 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] PATH_INFO: `/v3/users/821394ca62044098b66ca193fcbc7268` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:33.839739 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=821394ca62044098b66ca193fcbc7268)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:33.842704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:33.943228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300d46d-3b22-4061-9508-76e4cb3ecd33 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:33.953051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764a015-d519-4f31-b719-99d36bf98d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:33.953816 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764a015-d519-4f31-b719-99d36bf98d42 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:33.954169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764a015-d519-4f31-b719-99d36bf98d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:33.954509 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764a015-d519-4f31-b719-99d36bf98d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:33.955807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764a015-d519-4f31-b719-99d36bf98d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:33.957522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764a015-d519-4f31-b719-99d36bf98d42 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:33.969992 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1209/2404] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:39:33.974416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764a015-d519-4f31-b719-99d36bf98d42 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:33.985957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764a015-d519-4f31-b719-99d36bf98d42 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:33.991084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c89fc-8171-42d0-9cad-8497f90b5232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:33.992402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c89fc-8171-42d0-9cad-8497f90b5232 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:33.992696 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c89fc-8171-42d0-9cad-8497f90b5232 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:33.992988 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c89fc-8171-42d0-9cad-8497f90b5232 admin admin] PATH_INFO: `/v3/projects/6a972396f9b74eaa9bebee0769f2fa8a/users/2d2661bea7684cb29c8b41a966af9112/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:34.010577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c89fc-8171-42d0-9cad-8497f90b5232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a972396f9b74eaa9bebee0769f2fa8a, user_id=2d2661bea7684cb29c8b41a966af9112, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:34.013370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c89fc-8171-42d0-9cad-8497f90b5232 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:34.190781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1210/2405] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:39:33 2022] PUT /identity/v3/projects/6a972396f9b74eaa9bebee0769f2fa8a/users/2d2661bea7684cb29c8b41a966af9112/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:39:34.195776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c89fc-8171-42d0-9cad-8497f90b5232 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:34.201003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821394ca62044098b66ca193fcbc7268'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:34.265661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c89fc-8171-42d0-9cad-8497f90b5232 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:34.270511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9941a-9952-4c46-ac92-e0de0834c791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:34.271124 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9941a-9952-4c46-ac92-e0de0834c791 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:34.271405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9941a-9952-4c46-ac92-e0de0834c791 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:34.271678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9941a-9952-4c46-ac92-e0de0834c791 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:34.272312 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9941a-9952-4c46-ac92-e0de0834c791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:34.275091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9941a-9952-4c46-ac92-e0de0834c791 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:34.275612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821394ca62044098b66ca193fcbc7268'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:34.289506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1211/2406] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:39:34.291068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9941a-9952-4c46-ac92-e0de0834c791 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:34.298772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821394ca62044098b66ca193fcbc7268'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:34.303688 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9941a-9952-4c46-ac92-e0de0834c791 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:34.309107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821394ca62044098b66ca193fcbc7268'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:34.309898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821394ca62044098b66ca193fcbc7268'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:34.310018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5b231-dde5-4b49-88fb-9c26afca31c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:34.311145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5b231-dde5-4b49-88fb-9c26afca31c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:34.311145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5b231-dde5-4b49-88fb-9c26afca31c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:34.311145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5b231-dde5-4b49-88fb-9c26afca31c9 admin admin] PATH_INFO: `/v3/projects/6a972396f9b74eaa9bebee0769f2fa8a/users/2d2661bea7684cb29c8b41a966af9112/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:34.313150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5b231-dde5-4b49-88fb-9c26afca31c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a972396f9b74eaa9bebee0769f2fa8a, user_id=2d2661bea7684cb29c8b41a966af9112, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:34.316100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5b231-dde5-4b49-88fb-9c26afca31c9 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:34.316648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1196/2407] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:39:33 2022] DELETE /identity/v3/users/821394ca62044098b66ca193fcbc7268 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:39:34.331520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1212/2408] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:39:34 2022] PUT /identity/v3/projects/6a972396f9b74eaa9bebee0769f2fa8a/users/2d2661bea7684cb29c8b41a966af9112/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:34.855640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:34.908562 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:34.910124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:35.076167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e6cb4-70d8-40ea-8658-711bb7054f25 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:35.159618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:35.191051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:35.191816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:35.192164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:35.192645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] PATH_INFO: `/v3/projects/6d0a37f284ef46ed9457065753eaea53` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:35.195091 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0a37f284ef46ed9457065753eaea53)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:35.200340 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:35.398395 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0a37f284ef46ed9457065753eaea53', 'request_id': 'req-7d958890-fa8d-4fee-b939-a3dc16a2e83a'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:35.405257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0a37f284ef46ed9457065753eaea53', 'request_id': 'req-7d958890-fa8d-4fee-b939-a3dc16a2e83a'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:35.412336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0a37f284ef46ed9457065753eaea53', 'request_id': 'req-7d958890-fa8d-4fee-b939-a3dc16a2e83a'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:35.519806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] The token cache is being invalidate because project 6d0a37f284ef46ed9457065753eaea53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:39:35.520286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:35.521026 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d958890-fa8d-4fee-b939-a3dc16a2e83a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:39:35.526572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1197/2409] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:39:34 2022] DELETE /identity/v3/projects/6d0a37f284ef46ed9457065753eaea53 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:39:35.531577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517745b7-e1a8-4edb-b3b5-18df8bd9d094 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:35.532459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517745b7-e1a8-4edb-b3b5-18df8bd9d094 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:35.532919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517745b7-e1a8-4edb-b3b5-18df8bd9d094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:35.556157 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-517745b7-e1a8-4edb-b3b5-18df8bd9d094 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:35.563572 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-517745b7-e1a8-4edb-b3b5-18df8bd9d094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:35.626296 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1213/2410] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:35.636630 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b816c4b-0ca9-4e37-9ea6-aebf96062539 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:35.644133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b816c4b-0ca9-4e37-9ea6-aebf96062539 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:35.644133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b816c4b-0ca9-4e37-9ea6-aebf96062539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:35.661873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-3b816c4b-0ca9-4e37-9ea6-aebf96062539 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:35.664231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-3b816c4b-0ca9-4e37-9ea6-aebf96062539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:35.673745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1198/2411] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:35.678589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517745b7-e1a8-4edb-b3b5-18df8bd9d094 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:35.689772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517745b7-e1a8-4edb-b3b5-18df8bd9d094 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:35.695919 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad66ab-612d-4a4f-9c5f-37ac74da4f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:35.696913 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad66ab-612d-4a4f-9c5f-37ac74da4f9e admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:35.697786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad66ab-612d-4a4f-9c5f-37ac74da4f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:35.698298 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad66ab-612d-4a4f-9c5f-37ac74da4f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:35.699043 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad66ab-612d-4a4f-9c5f-37ac74da4f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:39:35.699426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad66ab-612d-4a4f-9c5f-37ac74da4f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:35.701154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad66ab-612d-4a4f-9c5f-37ac74da4f9e admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:35.718679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1214/2412] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:39:35.722711 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b816c4b-0ca9-4e37-9ea6-aebf96062539 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:35.732907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b816c4b-0ca9-4e37-9ea6-aebf96062539 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:35.738504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f5021-15dd-454b-adf9-e3f5f5becf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:35.739237 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f5021-15dd-454b-adf9-e3f5f5becf71 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:35.739634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f5021-15dd-454b-adf9-e3f5f5becf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:35.740023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f5021-15dd-454b-adf9-e3f5f5becf71 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:35.740899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f5021-15dd-454b-adf9-e3f5f5becf71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:35.743374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f5021-15dd-454b-adf9-e3f5f5becf71 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:35.865173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1199/2413] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:39:35 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:39:35.866308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad66ab-612d-4a4f-9c5f-37ac74da4f9e admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:35.879320 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad66ab-612d-4a4f-9c5f-37ac74da4f9e admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:35.949321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedb9f3-ee96-4aba-9b5b-d4ee59225ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:35.949842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb9f3-ee96-4aba-9b5b-d4ee59225ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:35.950118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb9f3-ee96-4aba-9b5b-d4ee59225ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:35.950533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb9f3-ee96-4aba-9b5b-d4ee59225ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:35.951115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedb9f3-ee96-4aba-9b5b-d4ee59225ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:35.953028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedb9f3-ee96-4aba-9b5b-d4ee59225ab1 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:36.044512 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1215/2414] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:39:35 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:39:36.048644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f5021-15dd-454b-adf9-e3f5f5becf71 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:36.060795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f5021-15dd-454b-adf9-e3f5f5becf71 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:36.065881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0f83-6de0-412c-8337-fdb86687ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:36.066481 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0f83-6de0-412c-8337-fdb86687ebba admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:36.066758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0f83-6de0-412c-8337-fdb86687ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:36.067030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0f83-6de0-412c-8337-fdb86687ebba admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:36.067848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d0f83-6de0-412c-8337-fdb86687ebba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:36.070653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d0f83-6de0-412c-8337-fdb86687ebba admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:36.082945 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1200/2415] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:39:36.093369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedb9f3-ee96-4aba-9b5b-d4ee59225ab1 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:36.104310 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedb9f3-ee96-4aba-9b5b-d4ee59225ab1 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:36.109441 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05efd4-9fcb-48a0-a82e-03ac94ccb886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:36.110131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05efd4-9fcb-48a0-a82e-03ac94ccb886 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:36.110415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05efd4-9fcb-48a0-a82e-03ac94ccb886 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:36.110692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05efd4-9fcb-48a0-a82e-03ac94ccb886 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:36.111373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05efd4-9fcb-48a0-a82e-03ac94ccb886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:36.113352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05efd4-9fcb-48a0-a82e-03ac94ccb886 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:36.130253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1216/2416] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:39:36.135333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0f83-6de0-412c-8337-fdb86687ebba admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:36.146463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0f83-6de0-412c-8337-fdb86687ebba admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:36.166314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235141-91fd-4f0a-b348-ddd9259ebe6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:36.166952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235141-91fd-4f0a-b348-ddd9259ebe6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:36.167403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235141-91fd-4f0a-b348-ddd9259ebe6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:36.167835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235141-91fd-4f0a-b348-ddd9259ebe6e admin admin] PATH_INFO: `/v3/projects/8179ee7de4c64c8c8a76b9d5d4a0109b/users/5d279960a08c466eb428f415ace2b3b8/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:36.198949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea235141-91fd-4f0a-b348-ddd9259ebe6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8179ee7de4c64c8c8a76b9d5d4a0109b, user_id=5d279960a08c466eb428f415ace2b3b8, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:36.201784 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea235141-91fd-4f0a-b348-ddd9259ebe6e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:36.255940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:36.307963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1201/2417] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:39:36 2022] PUT /identity/v3/projects/8179ee7de4c64c8c8a76b9d5d4a0109b/users/5d279960a08c466eb428f415ace2b3b8/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:39:36.313049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042162-7b0f-4098-926d-366aa549c24c None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:36.313416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042162-7b0f-4098-926d-366aa549c24c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:36.313794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042162-7b0f-4098-926d-366aa549c24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:36.348463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-fe042162-7b0f-4098-926d-366aa549c24c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:36.350302 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-fe042162-7b0f-4098-926d-366aa549c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:36.450584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1217/2418] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:36.461442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235141-91fd-4f0a-b348-ddd9259ebe6e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:36.463310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ea235141-91fd-4f0a-b348-ddd9259ebe6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:36.565954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235141-91fd-4f0a-b348-ddd9259ebe6e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:36.572958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f8351-43a6-428c-a7d8-1384c67031fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:36.574455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f8351-43a6-428c-a7d8-1384c67031fc service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:36.575114 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f8351-43a6-428c-a7d8-1384c67031fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:36.575652 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f8351-43a6-428c-a7d8-1384c67031fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:36.594625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f8351-43a6-428c-a7d8-1384c67031fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:36.596420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f8351-43a6-428c-a7d8-1384c67031fc service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:36.624559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1202/2419] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:42.346370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029b5a9-121d-4138-aca1-2e5f9417d87e None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:42.346903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029b5a9-121d-4138-aca1-2e5f9417d87e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:42.346903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029b5a9-121d-4138-aca1-2e5f9417d87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:42.394464 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f029b5a9-121d-4138-aca1-2e5f9417d87e None None] MFA Rules not processed for user `2d2661bea7684cb29c8b41a966af9112`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:42.396304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f029b5a9-121d-4138-aca1-2e5f9417d87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:42.490238 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1218/2420] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:42.616951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f8351-43a6-428c-a7d8-1384c67031fc service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:42.620509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-fb7f8351-43a6-428c-a7d8-1384c67031fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:42.642475 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:42.795507 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f8351-43a6-428c-a7d8-1384c67031fc service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:42.810750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa243633-ba3e-44c4-a8de-669779d605ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:42.811326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa243633-ba3e-44c4-a8de-669779d605ed service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:42.811823 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa243633-ba3e-44c4-a8de-669779d605ed service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:42.812089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa243633-ba3e-44c4-a8de-669779d605ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:42.814978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-fa243633-ba3e-44c4-a8de-669779d605ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:43.033990 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa243633-ba3e-44c4-a8de-669779d605ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:43.039692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa243633-ba3e-44c4-a8de-669779d605ed service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:43.076394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1203/2421] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:45.480894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb0de1-83a5-49d7-8e55-1807cd2eb15d None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:45.481384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb0de1-83a5-49d7-8e55-1807cd2eb15d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:45.481672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb0de1-83a5-49d7-8e55-1807cd2eb15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:45.531835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f8bb0de1-83a5-49d7-8e55-1807cd2eb15d None None] MFA Rules not processed for user `5d279960a08c466eb428f415ace2b3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:45.532834 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f8bb0de1-83a5-49d7-8e55-1807cd2eb15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:45.604640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:45.621182 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1219/2422] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:45.626080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa243633-ba3e-44c4-a8de-669779d605ed service nova] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:45.638205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa243633-ba3e-44c4-a8de-669779d605ed service nova] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:45.645166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e0f93-4b0f-49f0-b056-63a32d3fe26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:45.646319 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0f93-4b0f-49f0-b056-63a32d3fe26c admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:45.646807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0f93-4b0f-49f0-b056-63a32d3fe26c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:45.647326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e0f93-4b0f-49f0-b056-63a32d3fe26c admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:45.648809 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e0f93-4b0f-49f0-b056-63a32d3fe26c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:45.651371 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e0f93-4b0f-49f0-b056-63a32d3fe26c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:45.783919 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1204/2423] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:39:45 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:39:45.784825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb0de1-83a5-49d7-8e55-1807cd2eb15d None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:45.798586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb0de1-83a5-49d7-8e55-1807cd2eb15d None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:45.870710 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18578d6-929c-4dc7-938c-01e014607d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:45.872418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18578d6-929c-4dc7-938c-01e014607d8f admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:45.872813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18578d6-929c-4dc7-938c-01e014607d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:45.873273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18578d6-929c-4dc7-938c-01e014607d8f admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:45.874141 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18578d6-929c-4dc7-938c-01e014607d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:45.877444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18578d6-929c-4dc7-938c-01e014607d8f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:45.984861 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1220/2424] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:39:45 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:39:45.990249 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e0f93-4b0f-49f0-b056-63a32d3fe26c admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:46.016877 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e0f93-4b0f-49f0-b056-63a32d3fe26c admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:46.022951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a674966-3a38-437d-9006-b5bfa9cb1fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:46.028572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a674966-3a38-437d-9006-b5bfa9cb1fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:46.029029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a674966-3a38-437d-9006-b5bfa9cb1fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:46.029534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a674966-3a38-437d-9006-b5bfa9cb1fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:46.030498 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a674966-3a38-437d-9006-b5bfa9cb1fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:46.032422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a674966-3a38-437d-9006-b5bfa9cb1fe9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:46.053971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1205/2425] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:39:46.057989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18578d6-929c-4dc7-938c-01e014607d8f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:46.072474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18578d6-929c-4dc7-938c-01e014607d8f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:46.078897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37ef97-f0b1-4ba3-97fb-7cf69b1555f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:46.079116 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37ef97-f0b1-4ba3-97fb-7cf69b1555f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:46.079607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37ef97-f0b1-4ba3-97fb-7cf69b1555f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:46.079840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37ef97-f0b1-4ba3-97fb-7cf69b1555f1 admin admin] PATH_INFO: `/v3/projects/890ebd98e5d244b2ba83e3f2a24dcc0e/users/b16a2fb1f0c147318bdb628d46008ca5/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:46.099123 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37ef97-f0b1-4ba3-97fb-7cf69b1555f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890ebd98e5d244b2ba83e3f2a24dcc0e, user_id=b16a2fb1f0c147318bdb628d46008ca5, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:46.102393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37ef97-f0b1-4ba3-97fb-7cf69b1555f1 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:46.207900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1221/2426] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:39:46 2022] PUT /identity/v3/projects/890ebd98e5d244b2ba83e3f2a24dcc0e/users/b16a2fb1f0c147318bdb628d46008ca5/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:39:46.208882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a674966-3a38-437d-9006-b5bfa9cb1fe9 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:46.222428 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a674966-3a38-437d-9006-b5bfa9cb1fe9 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:46.315524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab35d5-a90f-4321-96f8-7e3da476915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:46.316163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab35d5-a90f-4321-96f8-7e3da476915c admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:46.316446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab35d5-a90f-4321-96f8-7e3da476915c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:46.316725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab35d5-a90f-4321-96f8-7e3da476915c admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:46.318177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab35d5-a90f-4321-96f8-7e3da476915c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:46.321318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab35d5-a90f-4321-96f8-7e3da476915c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:46.339281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1206/2427] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:39:46.345038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37ef97-f0b1-4ba3-97fb-7cf69b1555f1 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:46.358562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37ef97-f0b1-4ba3-97fb-7cf69b1555f1 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:46.372844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fb343-8f3f-4145-9dff-aa77b3925df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:46.372844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fb343-8f3f-4145-9dff-aa77b3925df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:46.372844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fb343-8f3f-4145-9dff-aa77b3925df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:46.372844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fb343-8f3f-4145-9dff-aa77b3925df0 admin admin] PATH_INFO: `/v3/projects/890ebd98e5d244b2ba83e3f2a24dcc0e/users/b16a2fb1f0c147318bdb628d46008ca5/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:46.373299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fb343-8f3f-4145-9dff-aa77b3925df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890ebd98e5d244b2ba83e3f2a24dcc0e, user_id=b16a2fb1f0c147318bdb628d46008ca5, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:46.373299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fb343-8f3f-4145-9dff-aa77b3925df0 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:46.386928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1222/2428] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:39:46 2022] PUT /identity/v3/projects/890ebd98e5d244b2ba83e3f2a24dcc0e/users/b16a2fb1f0c147318bdb628d46008ca5/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:39:47.192062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5186616-91af-4ec2-87b9-01303ab55031 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:47.192693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5186616-91af-4ec2-87b9-01303ab55031 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:47.192984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5186616-91af-4ec2-87b9-01303ab55031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:47.223256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b5186616-91af-4ec2-87b9-01303ab55031 None None] MFA Rules not processed for user `d2bea5c77d2a47759d4ba925630c8d54`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:47.224790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b5186616-91af-4ec2-87b9-01303ab55031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:47.235632 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:47.312780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1207/2429] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:49.921609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3346-f8f3-4a12-bbad-434e148ea499 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:49.922937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3346-f8f3-4a12-bbad-434e148ea499 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:49.923364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3346-f8f3-4a12-bbad-434e148ea499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:49.947024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ff3b3346-f8f3-4a12-bbad-434e148ea499 None None] MFA Rules not processed for user `af6b2c3b389c4fecad11a78ebf526b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:49.948269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ff3b3346-f8f3-4a12-bbad-434e148ea499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:50.021772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1223/2430] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:53.939889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5f586-886e-42a7-a1db-93fc37b0aefd None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:53.940448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5f586-886e-42a7-a1db-93fc37b0aefd None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:53.940448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5f586-886e-42a7-a1db-93fc37b0aefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:53.978043 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-23f5f586-886e-42a7-a1db-93fc37b0aefd None None] MFA Rules not processed for user `b16a2fb1f0c147318bdb628d46008ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:53.979673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-23f5f586-886e-42a7-a1db-93fc37b0aefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:54.076257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1208/2431] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:39:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:54.091546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b3346-f8f3-4a12-bbad-434e148ea499 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:54.093179 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ff3b3346-f8f3-4a12-bbad-434e148ea499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:54.157710 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b3346-f8f3-4a12-bbad-434e148ea499 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:54.161288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563acb1-3e2c-4617-9f31-e1ded0b109de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8590378b14c49cf9266a0d859db5bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:54.162034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563acb1-3e2c-4617-9f31-e1ded0b109de service glance] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:54.162315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563acb1-3e2c-4617-9f31-e1ded0b109de service glance] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:54.162655 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563acb1-3e2c-4617-9f31-e1ded0b109de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:54.169270 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:39:54.238188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563acb1-3e2c-4617-9f31-e1ded0b109de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:54.239781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563acb1-3e2c-4617-9f31-e1ded0b109de service glance] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:54.258544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1224/2432] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:39:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:39:54.570602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088f1b-2b0a-4f40-b256-cca61667a52b None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:54.570992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088f1b-2b0a-4f40-b256-cca61667a52b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:54.571350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088f1b-2b0a-4f40-b256-cca61667a52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:54.595614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-ec088f1b-2b0a-4f40-b256-cca61667a52b None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:39:54.597766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ec088f1b-2b0a-4f40-b256-cca61667a52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:54.671341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1209/2433] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:39:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:39:54.697984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563acb1-3e2c-4617-9f31-e1ded0b109de service glance] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:39:54.699558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b563acb1-3e2c-4617-9f31-e1ded0b109de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:39:54.802155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563acb1-3e2c-4617-9f31-e1ded0b109de service glance] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:39:54.807918 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52411c-8ee3-4a9a-a38c-5feb8fb31fa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:39:54.813370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52411c-8ee3-4a9a-a38c-5feb8fb31fa7 service swift] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:39:54.813370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52411c-8ee3-4a9a-a38c-5feb8fb31fa7 service swift] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:39:54.813370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52411c-8ee3-4a9a-a38c-5feb8fb31fa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:39:54.817931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52411c-8ee3-4a9a-a38c-5feb8fb31fa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:39:54.820433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52411c-8ee3-4a9a-a38c-5feb8fb31fa7 service swift] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:39:54.830228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1225/2434] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:39:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:40:04.667838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=78 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:04.825527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=56 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:06.602840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672940-bdae-4884-8891-99e2d4061dc2 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:06.603422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672940-bdae-4884-8891-99e2d4061dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:06.603422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8672940-bdae-4884-8891-99e2d4061dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:06.622657 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-f8672940-bdae-4884-8891-99e2d4061dc2 None None] MFA Rules not processed for user `5d279960a08c466eb428f415ace2b3b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:40:06.623954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f8672940-bdae-4884-8891-99e2d4061dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:40:06.630897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1210/2435] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:40:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:40:14.251269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260554c2-df80-4498-9973-5482b3efd5e5 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:14.251909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260554c2-df80-4498-9973-5482b3efd5e5 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:14.251909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260554c2-df80-4498-9973-5482b3efd5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:14.273564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-260554c2-df80-4498-9973-5482b3efd5e5 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:40:14.274818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-260554c2-df80-4498-9973-5482b3efd5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:40:14.354862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1226/2436] 10.222.0.78 () {58 vars in 1016 bytes} [Wed Aug 31 00:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:40:14.381531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8672940-bdae-4884-8891-99e2d4061dc2 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:40:14.383010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f8672940-bdae-4884-8891-99e2d4061dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:40:14.475122 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8672940-bdae-4884-8891-99e2d4061dc2 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:40:14.481136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13926217-f597-47c7-a650-dbffca5da5f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:40:14.481784 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13926217-f597-47c7-a650-dbffca5da5f5 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:14.482061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13926217-f597-47c7-a650-dbffca5da5f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:14.482333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13926217-f597-47c7-a650-dbffca5da5f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:14.492076 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13926217-f597-47c7-a650-dbffca5da5f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:40:14.493849 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13926217-f597-47c7-a650-dbffca5da5f5 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:40:14.503572 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1211/2437] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:40:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:40:15.540219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fac552-7f60-437e-9b67-4ec7b6cd7dd8 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:15.540770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fac552-7f60-437e-9b67-4ec7b6cd7dd8 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:15.540770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fac552-7f60-437e-9b67-4ec7b6cd7dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:15.560140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-77fac552-7f60-437e-9b67-4ec7b6cd7dd8 None None] MFA Rules not processed for user `e775b9e1dfde44a0bfe23523399f8f22`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:40:15.561347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-77fac552-7f60-437e-9b67-4ec7b6cd7dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:40:15.600130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026d26a-0b96-4396-8e7c-ebff72a7fd94 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:15.603478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026d26a-0b96-4396-8e7c-ebff72a7fd94 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:15.603478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026d26a-0b96-4396-8e7c-ebff72a7fd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:15.634142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-c026d26a-0b96-4396-8e7c-ebff72a7fd94 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:40:15.636159 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c026d26a-0b96-4396-8e7c-ebff72a7fd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:40:15.643664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1227/2438] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:40:15.652854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1212/2439] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:40:15.672906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fac552-7f60-437e-9b67-4ec7b6cd7dd8 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:40:15.695044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fac552-7f60-437e-9b67-4ec7b6cd7dd8 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:40:15.700925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc811c-9c51-4f46-a62d-3610be31469f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:40:15.701550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc811c-9c51-4f46-a62d-3610be31469f service swift] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:15.702480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc811c-9c51-4f46-a62d-3610be31469f service swift] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:15.702480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc811c-9c51-4f46-a62d-3610be31469f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:15.712045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc811c-9c51-4f46-a62d-3610be31469f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:40:15.713685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc811c-9c51-4f46-a62d-3610be31469f service swift] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:40:15.723186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1228/2440] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:40:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:40:25.619456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=40 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:25.719412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=58 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:29.287015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078afc-9417-48bd-8f98-37e3a366074e None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:29.287728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078afc-9417-48bd-8f98-37e3a366074e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:29.287728 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac078afc-9417-48bd-8f98-37e3a366074e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:29.308267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-ac078afc-9417-48bd-8f98-37e3a366074e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:40:29.309504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ac078afc-9417-48bd-8f98-37e3a366074e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:40:29.318229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1213/2441] 10.222.0.78 () {58 vars in 1016 bytes} [Wed Aug 31 00:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:40:29.343446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc811c-9c51-4f46-a62d-3610be31469f service swift] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:40:29.356769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc811c-9c51-4f46-a62d-3610be31469f service swift] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:40:29.362603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6dc46-9193-4a1e-b15a-d58af2cbf3e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:40:29.367015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dc46-9193-4a1e-b15a-d58af2cbf3e7 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:29.367015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dc46-9193-4a1e-b15a-d58af2cbf3e7 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:29.367015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dc46-9193-4a1e-b15a-d58af2cbf3e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:29.373298 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6dc46-9193-4a1e-b15a-d58af2cbf3e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:40:29.375012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6dc46-9193-4a1e-b15a-d58af2cbf3e7 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:40:29.389151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1229/2442] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:40:31.923681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078afc-9417-48bd-8f98-37e3a366074e None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:40:31.925394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ac078afc-9417-48bd-8f98-37e3a366074e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:40:31.987645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac078afc-9417-48bd-8f98-37e3a366074e None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:40:31.992267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba47cb-d7a0-4269-9789-ccb95b7478f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:40:31.992914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba47cb-d7a0-4269-9789-ccb95b7478f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:31.993233 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba47cb-d7a0-4269-9789-ccb95b7478f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:31.993548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba47cb-d7a0-4269-9789-ccb95b7478f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:32.059093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba47cb-d7a0-4269-9789-ccb95b7478f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:40:32.060463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba47cb-d7a0-4269-9789-ccb95b7478f1 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:40:32.071070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1214/2443] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:40:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:40:38.316055 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe557e-1888-4a09-915b-8e82f0a22793 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:38.316571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe557e-1888-4a09-915b-8e82f0a22793 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:38.316750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe557e-1888-4a09-915b-8e82f0a22793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:38.346191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-5efe557e-1888-4a09-915b-8e82f0a22793 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:40:38.347500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5efe557e-1888-4a09-915b-8e82f0a22793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:40:38.374989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1230/2444] 10.222.0.78 () {58 vars in 1016 bytes} [Wed Aug 31 00:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:40:38.397832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba47cb-d7a0-4269-9789-ccb95b7478f1 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:40:38.412020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba47cb-d7a0-4269-9789-ccb95b7478f1 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:40:38.420193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9332e-5744-42bd-8e03-316794abdaf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:40:38.420822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9332e-5744-42bd-8e03-316794abdaf3 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:38.421104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9332e-5744-42bd-8e03-316794abdaf3 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:38.421777 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9332e-5744-42bd-8e03-316794abdaf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:38.432472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9332e-5744-42bd-8e03-316794abdaf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:40:38.434121 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9332e-5744-42bd-8e03-316794abdaf3 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:40:38.447166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1215/2445] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:40:42.707668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59321d-bb8a-4245-835b-525d381996a9 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:42.708256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59321d-bb8a-4245-835b-525d381996a9 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:42.708256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59321d-bb8a-4245-835b-525d381996a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:42.730809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0e59321d-bb8a-4245-835b-525d381996a9 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:40:42.732435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0e59321d-bb8a-4245-835b-525d381996a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:40:42.741319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1231/2446] 10.222.0.78 () {58 vars in 1016 bytes} [Wed Aug 31 00:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:40:42.763936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9332e-5744-42bd-8e03-316794abdaf3 service nova] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:40:42.776300 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9332e-5744-42bd-8e03-316794abdaf3 service nova] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:40:42.782074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9ec2-c134-4025-842c-265110cf32d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:40:42.782683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9ec2-c134-4025-842c-265110cf32d5 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:42.782967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9ec2-c134-4025-842c-265110cf32d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:42.783239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9ec2-c134-4025-842c-265110cf32d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:42.793230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9ec2-c134-4025-842c-265110cf32d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:40:42.794933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9ec2-c134-4025-842c-265110cf32d5 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:40:42.808879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1216/2447] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:40:47.015973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbf5ad-6ea1-4692-bf43-bbb80c54e7ee None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:47.016954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbf5ad-6ea1-4692-bf43-bbb80c54e7ee None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:47.018581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbf5ad-6ea1-4692-bf43-bbb80c54e7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:47.049282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8dfbf5ad-6ea1-4692-bf43-bbb80c54e7ee None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:40:47.050641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8dfbf5ad-6ea1-4692-bf43-bbb80c54e7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:40:47.060158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1232/2448] 10.222.0.78 () {58 vars in 1016 bytes} [Wed Aug 31 00:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:40:47.085062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9ec2-c134-4025-842c-265110cf32d5 service nova] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:40:47.104362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9ec2-c134-4025-842c-265110cf32d5 service nova] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:40:47.110615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3f147-8ec3-44ec-9657-afd30363ca1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:40:47.111259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3f147-8ec3-44ec-9657-afd30363ca1a service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:47.111541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3f147-8ec3-44ec-9657-afd30363ca1a service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:47.111820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3f147-8ec3-44ec-9657-afd30363ca1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:47.121098 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3f147-8ec3-44ec-9657-afd30363ca1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:40:47.122719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3f147-8ec3-44ec-9657-afd30363ca1a service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:40:47.138798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1217/2449] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:40:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:40:47.140369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b4c2-76f1-4960-b794-e43c133ed7ad None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:47.146395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b4c2-76f1-4960-b794-e43c133ed7ad None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:47.146395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824b4c2-76f1-4960-b794-e43c133ed7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:47.162903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8824b4c2-76f1-4960-b794-e43c133ed7ad None None] MFA Rules not processed for user `b049ee00b6404a678a010587074aba66`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:40:47.164122 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8824b4c2-76f1-4960-b794-e43c133ed7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:40:47.224316 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1233/2450] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:40:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:40:56.084781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3f147-8ec3-44ec-9657-afd30363ca1a service nova] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:40:56.091253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=72 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:40:56.098362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3f147-8ec3-44ec-9657-afd30363ca1a service nova] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:40:56.102803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5aafe-bab7-4c50-b247-b57ed8f40539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:40:56.112913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5aafe-bab7-4c50-b247-b57ed8f40539 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:40:56.112913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5aafe-bab7-4c50-b247-b57ed8f40539 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:40:56.112913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5aafe-bab7-4c50-b247-b57ed8f40539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:40:56.117806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5aafe-bab7-4c50-b247-b57ed8f40539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:40:56.120388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5aafe-bab7-4c50-b247-b57ed8f40539 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:40:56.135488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1218/2451] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:40:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:40:57.216507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=40 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:06.225274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:08.366414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445309ad-6597-4a03-b62c-c7c3c21746ca None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:08.366946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445309ad-6597-4a03-b62c-c7c3c21746ca None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:08.366946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445309ad-6597-4a03-b62c-c7c3c21746ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:08.386704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-445309ad-6597-4a03-b62c-c7c3c21746ca None None] MFA Rules not processed for user `7b2f116fd01d46ddab8096d0f3214307`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:08.387921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-445309ad-6597-4a03-b62c-c7c3c21746ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:08.451013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1234/2452] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:41:18.441894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=25 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:18.468466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5aafe-bab7-4c50-b247-b57ed8f40539 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:18.477858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5aafe-bab7-4c50-b247-b57ed8f40539 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:18.481528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a91ace-f41a-4caa-8552-d6aa7c8ce017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:18.482151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a91ace-f41a-4caa-8552-d6aa7c8ce017 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:18.482436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a91ace-f41a-4caa-8552-d6aa7c8ce017 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:18.482712 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a91ace-f41a-4caa-8552-d6aa7c8ce017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:18.484470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d3a91ace-f41a-4caa-8552-d6aa7c8ce017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:18.498061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a91ace-f41a-4caa-8552-d6aa7c8ce017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:18.499491 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a91ace-f41a-4caa-8552-d6aa7c8ce017 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:18.511134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1219/2453] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:41:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:41:19.499575 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445309ad-6597-4a03-b62c-c7c3c21746ca None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:19.501166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-445309ad-6597-4a03-b62c-c7c3c21746ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:19.563460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445309ad-6597-4a03-b62c-c7c3c21746ca None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:19.567432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5ae8-5188-47c7-922b-5f645bea6729 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:19.568060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5ae8-5188-47c7-922b-5f645bea6729 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:19.568339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5ae8-5188-47c7-922b-5f645bea6729 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:19.568613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5ae8-5188-47c7-922b-5f645bea6729 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:19.570819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e1bc5ae8-5188-47c7-922b-5f645bea6729 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:19.585883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc5ae8-5188-47c7-922b-5f645bea6729 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:19.587373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc5ae8-5188-47c7-922b-5f645bea6729 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:19.603500 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1235/2454] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:41:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:41:27.054362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a91ace-f41a-4caa-8552-d6aa7c8ce017 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:27.059047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d3a91ace-f41a-4caa-8552-d6aa7c8ce017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:27.069254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a91ace-f41a-4caa-8552-d6aa7c8ce017 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:27.074097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:27.074716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:27.074993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:27.075267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] PATH_INFO: `/v3/users/af6b2c3b389c4fecad11a78ebf526b4f` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:27.076376 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6b2c3b389c4fecad11a78ebf526b4f)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:27.078383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:27.275871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6b2c3b389c4fecad11a78ebf526b4f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:27.361128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6b2c3b389c4fecad11a78ebf526b4f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:27.375637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6b2c3b389c4fecad11a78ebf526b4f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:27.390570 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6b2c3b389c4fecad11a78ebf526b4f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:27.391356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6b2c3b389c4fecad11a78ebf526b4f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:27.398461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1220/2455] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:41:27 2022] DELETE /identity/v3/users/af6b2c3b389c4fecad11a78ebf526b4f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:41:27.675930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5ae8-5188-47c7-922b-5f645bea6729 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:27.686973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5ae8-5188-47c7-922b-5f645bea6729 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:27.747433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:27.748067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:27.748347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:27.748620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] PATH_INFO: `/v3/projects/19ef394d28714744878387b3447adf1b` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:27.749798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ef394d28714744878387b3447adf1b)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:27.751704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:27.909369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ef394d28714744878387b3447adf1b', 'request_id': 'req-70d9081b-11b7-48d8-89b9-932307603e40'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:27.967286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:27.968917 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:28.016338 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ef394d28714744878387b3447adf1b', 'request_id': 'req-70d9081b-11b7-48d8-89b9-932307603e40'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:28.024347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ef394d28714744878387b3447adf1b', 'request_id': 'req-70d9081b-11b7-48d8-89b9-932307603e40'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:28.034262 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce62f0-5516-4644-8600-4f407a7ce75f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:28.037595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] The token cache is being invalidate because project 19ef394d28714744878387b3447adf1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:41:28.037915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:28.038619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-70d9081b-11b7-48d8-89b9-932307603e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:28.040286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1236/2456] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:41:27 2022] DELETE /identity/v3/projects/19ef394d28714744878387b3447adf1b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:41:28.044983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fec11-27bf-4d97-ba26-3e99630ca6d5 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:28.046471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fec11-27bf-4d97-ba26-3e99630ca6d5 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:28.046471 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fec11-27bf-4d97-ba26-3e99630ca6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:28.067639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-fc1fec11-27bf-4d97-ba26-3e99630ca6d5 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:28.068869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-fc1fec11-27bf-4d97-ba26-3e99630ca6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:28.101902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1d149-d8b0-4d18-b0d4-2e5dd4288830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:28.102617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:28.102734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1d149-d8b0-4d18-b0d4-2e5dd4288830 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:28.102734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1d149-d8b0-4d18-b0d4-2e5dd4288830 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:28.103081 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1d149-d8b0-4d18-b0d4-2e5dd4288830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:28.104956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0aa1d149-d8b0-4d18-b0d4-2e5dd4288830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:28.142623 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:28.157390 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1237/2457] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:41:28.160268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f709272-d305-4b36-ab7c-373551952ef0 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:28.160567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f709272-d305-4b36-ab7c-373551952ef0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:28.160915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f709272-d305-4b36-ab7c-373551952ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:28.183990 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1d149-d8b0-4d18-b0d4-2e5dd4288830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:28.186060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-5f709272-d305-4b36-ab7c-373551952ef0 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:28.186860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1d149-d8b0-4d18-b0d4-2e5dd4288830 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:28.187314 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-5f709272-d305-4b36-ab7c-373551952ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:28.200313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1238/2458] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:41:28.205880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f709272-d305-4b36-ab7c-373551952ef0 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:28.210139 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1221/2459] 10.222.0.74 () {60 vars in 1396 bytes} [Wed Aug 31 00:41:27 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:41:28.219051 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f709272-d305-4b36-ab7c-373551952ef0 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:28.225321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727b334-2e92-48ba-ad92-8f16c277878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:28.225984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b334-2e92-48ba-ad92-8f16c277878e admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:28.226684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b334-2e92-48ba-ad92-8f16c277878e admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:28.227301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727b334-2e92-48ba-ad92-8f16c277878e admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:28.228050 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727b334-2e92-48ba-ad92-8f16c277878e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:41:28.229433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727b334-2e92-48ba-ad92-8f16c277878e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:28.231178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727b334-2e92-48ba-ad92-8f16c277878e admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:28.248892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1239/2460] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:41:28.250318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1d149-d8b0-4d18-b0d4-2e5dd4288830 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:28.263490 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1d149-d8b0-4d18-b0d4-2e5dd4288830 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:28.269439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a2aaa-ff87-4267-a928-bc0657127ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:28.270277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a2aaa-ff87-4267-a928-bc0657127ecf admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:28.270400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a2aaa-ff87-4267-a928-bc0657127ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:28.270610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a2aaa-ff87-4267-a928-bc0657127ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:28.271243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a2aaa-ff87-4267-a928-bc0657127ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:28.273204 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a2aaa-ff87-4267-a928-bc0657127ecf admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:28.360324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1222/2461] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:41:28 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:41:28.363924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727b334-2e92-48ba-ad92-8f16c277878e admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:28.376440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727b334-2e92-48ba-ad92-8f16c277878e admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:28.445199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237dc3-718e-4e86-91a7-c6d725daff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:28.446319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237dc3-718e-4e86-91a7-c6d725daff07 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:28.446876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237dc3-718e-4e86-91a7-c6d725daff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:28.447437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237dc3-718e-4e86-91a7-c6d725daff07 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:28.448268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c237dc3-718e-4e86-91a7-c6d725daff07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:28.450511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c237dc3-718e-4e86-91a7-c6d725daff07 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:28.587303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1240/2462] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:41:28 2022] POST /identity/v3/users => generated 300 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:41:28.591510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a2aaa-ff87-4267-a928-bc0657127ecf admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:28.605840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a2aaa-ff87-4267-a928-bc0657127ecf admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:28.613294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72ea85-c455-4d8b-9941-1f1a06259a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:28.615308 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ea85-c455-4d8b-9941-1f1a06259a8b admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:28.615599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ea85-c455-4d8b-9941-1f1a06259a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:28.615881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72ea85-c455-4d8b-9941-1f1a06259a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:28.617594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72ea85-c455-4d8b-9941-1f1a06259a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:28.619331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72ea85-c455-4d8b-9941-1f1a06259a8b admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:28.638689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1223/2463] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:41:28.642666 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237dc3-718e-4e86-91a7-c6d725daff07 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:28.662443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237dc3-718e-4e86-91a7-c6d725daff07 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:28.669842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d0947-3b15-4dac-ae5a-cd50a1535dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:28.670583 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d0947-3b15-4dac-ae5a-cd50a1535dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:28.670870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d0947-3b15-4dac-ae5a-cd50a1535dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:28.671502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d0947-3b15-4dac-ae5a-cd50a1535dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:28.671873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d0947-3b15-4dac-ae5a-cd50a1535dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:28.673683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d0947-3b15-4dac-ae5a-cd50a1535dc3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:28.691751 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1241/2464] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:41:28.696013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72ea85-c455-4d8b-9941-1f1a06259a8b admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:28.710802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72ea85-c455-4d8b-9941-1f1a06259a8b admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:28.717313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7692a-3c23-4c27-96d8-c75d815f6b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:28.718003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7692a-3c23-4c27-96d8-c75d815f6b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:28.718598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7692a-3c23-4c27-96d8-c75d815f6b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:28.718876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7692a-3c23-4c27-96d8-c75d815f6b08 admin admin] PATH_INFO: `/v3/projects/134b9cd5a7d34df1a1752bd3355cc76a/users/275988c251134be19eba255bba1b5d81/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:28.738718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7692a-3c23-4c27-96d8-c75d815f6b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=134b9cd5a7d34df1a1752bd3355cc76a, user_id=275988c251134be19eba255bba1b5d81, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:28.745378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7692a-3c23-4c27-96d8-c75d815f6b08 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:28.853770 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1224/2465] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:41:28 2022] PUT /identity/v3/projects/134b9cd5a7d34df1a1752bd3355cc76a/users/275988c251134be19eba255bba1b5d81/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:41:28.927031 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745478e5-3056-4d16-92ae-7bd62a45ef91 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:28.927318 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745478e5-3056-4d16-92ae-7bd62a45ef91 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:28.927593 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745478e5-3056-4d16-92ae-7bd62a45ef91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:28.967474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-745478e5-3056-4d16-92ae-7bd62a45ef91 None None] MFA Rules not processed for user `275988c251134be19eba255bba1b5d81`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:28.968804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-745478e5-3056-4d16-92ae-7bd62a45ef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:29.071887 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1242/2466] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:41:29.086921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7692a-3c23-4c27-96d8-c75d815f6b08 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:29.088941 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bbb7692a-3c23-4c27-96d8-c75d815f6b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:29.177348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7692a-3c23-4c27-96d8-c75d815f6b08 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:29.183674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332d140-2ddf-415c-b750-f85217976b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:29.184382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332d140-2ddf-415c-b750-f85217976b2a service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:29.184736 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332d140-2ddf-415c-b750-f85217976b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:29.185650 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332d140-2ddf-415c-b750-f85217976b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:29.199659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332d140-2ddf-415c-b750-f85217976b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:29.201232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332d140-2ddf-415c-b750-f85217976b2a service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:29.215231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1225/2467] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:41:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:41:34.611198 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745478e5-3056-4d16-92ae-7bd62a45ef91 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:34.625845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745478e5-3056-4d16-92ae-7bd62a45ef91 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:34.633235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fbc4fd-9f62-4331-9308-4114099e13db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:34.633235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbc4fd-9f62-4331-9308-4114099e13db service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:34.633235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbc4fd-9f62-4331-9308-4114099e13db service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:34.633235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbc4fd-9f62-4331-9308-4114099e13db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:34.633699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f9fbc4fd-9f62-4331-9308-4114099e13db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:34.656895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:34.699373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbc4fd-9f62-4331-9308-4114099e13db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:34.700860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fbc4fd-9f62-4331-9308-4114099e13db service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:34.710823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1243/2468] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:41:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:41:35.426269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332d140-2ddf-415c-b750-f85217976b2a service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:35.491980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332d140-2ddf-415c-b750-f85217976b2a service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:35.496747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:35.497372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:35.497775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:35.498051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] PATH_INFO: `/v3/users/275988c251134be19eba255bba1b5d81` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:35.499315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=275988c251134be19eba255bba1b5d81)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:35.501357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:35.519854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:35.718285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275988c251134be19eba255bba1b5d81'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:35.800960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275988c251134be19eba255bba1b5d81'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:35.813776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275988c251134be19eba255bba1b5d81'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:35.821633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275988c251134be19eba255bba1b5d81'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:35.822366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275988c251134be19eba255bba1b5d81'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:35.828386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1226/2469] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:41:35 2022] DELETE /identity/v3/users/275988c251134be19eba255bba1b5d81 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:41:35.832996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3483-68f7-4ed5-9363-b6e60aabea1a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:35.833519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3483-68f7-4ed5-9363-b6e60aabea1a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:35.833519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d3483-68f7-4ed5-9363-b6e60aabea1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:35.853355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-bd7d3483-68f7-4ed5-9363-b6e60aabea1a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:35.854658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bd7d3483-68f7-4ed5-9363-b6e60aabea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:35.915308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1244/2470] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:41:35.925959 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:35.927365 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:36.005261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f205f-ae07-4c23-9a5f-d8c65e19c9eb admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:36.008869 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4c01c-991b-407f-a2fe-45c6781b41f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:36.009469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4c01c-991b-407f-a2fe-45c6781b41f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:36.009781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4c01c-991b-407f-a2fe-45c6781b41f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:36.010052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4c01c-991b-407f-a2fe-45c6781b41f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:36.019548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4c01c-991b-407f-a2fe-45c6781b41f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:36.020974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4c01c-991b-407f-a2fe-45c6781b41f2 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:36.030802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1227/2471] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:41:36.487135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d3483-68f7-4ed5-9363-b6e60aabea1a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:36.489517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bd7d3483-68f7-4ed5-9363-b6e60aabea1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:36.502856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d3483-68f7-4ed5-9363-b6e60aabea1a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:36.507660 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:36.508235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:36.508518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:36.508913 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] PATH_INFO: `/v3/projects/134b9cd5a7d34df1a1752bd3355cc76a` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:36.509991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=134b9cd5a7d34df1a1752bd3355cc76a)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:36.512102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:36.610110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '134b9cd5a7d34df1a1752bd3355cc76a', 'request_id': 'req-a29c08fe-c144-410c-930e-4fb94710cd6e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:36.697678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '134b9cd5a7d34df1a1752bd3355cc76a', 'request_id': 'req-a29c08fe-c144-410c-930e-4fb94710cd6e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:36.704302 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '134b9cd5a7d34df1a1752bd3355cc76a', 'request_id': 'req-a29c08fe-c144-410c-930e-4fb94710cd6e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:36.717553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] The token cache is being invalidate because project 134b9cd5a7d34df1a1752bd3355cc76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:41:36.717897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:36.718538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:36.720128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1245/2472] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:41:36 2022] DELETE /identity/v3/projects/134b9cd5a7d34df1a1752bd3355cc76a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:41:46.026307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:DELETE=9,keystone:SELECT=46,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:46.713863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:47.145426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4c01c-991b-407f-a2fe-45c6781b41f2 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:47.146919 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-42a4c01c-991b-407f-a2fe-45c6781b41f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:47.158978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4c01c-991b-407f-a2fe-45c6781b41f2 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:47.207816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66ce8b-51c8-436e-b1b0-12602e92eee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:47.208419 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66ce8b-51c8-436e-b1b0-12602e92eee7 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:47.208701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66ce8b-51c8-436e-b1b0-12602e92eee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:47.208982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66ce8b-51c8-436e-b1b0-12602e92eee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:47.210755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8f66ce8b-51c8-436e-b1b0-12602e92eee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:47.273008 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66ce8b-51c8-436e-b1b0-12602e92eee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:47.274608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66ce8b-51c8-436e-b1b0-12602e92eee7 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:47.285020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1228/2473] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:41:51.144040 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:51.147015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:51.166697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c08fe-c144-410c-930e-4fb94710cd6e admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:51.172582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c841e-b261-421e-b8fc-48377fb42d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:51.174100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c841e-b261-421e-b8fc-48377fb42d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:51.174615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c841e-b261-421e-b8fc-48377fb42d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:51.175091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c841e-b261-421e-b8fc-48377fb42d02 admin admin] PATH_INFO: `/v3/users/e775b9e1dfde44a0bfe23523399f8f22` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:51.176499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c841e-b261-421e-b8fc-48377fb42d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e775b9e1dfde44a0bfe23523399f8f22)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:51.179399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c841e-b261-421e-b8fc-48377fb42d02 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:51.375713 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-498c841e-b261-421e-b8fc-48377fb42d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e775b9e1dfde44a0bfe23523399f8f22'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:51.388607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-498c841e-b261-421e-b8fc-48377fb42d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e775b9e1dfde44a0bfe23523399f8f22'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:51.395880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-498c841e-b261-421e-b8fc-48377fb42d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e775b9e1dfde44a0bfe23523399f8f22'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:51.469089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-498c841e-b261-421e-b8fc-48377fb42d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e775b9e1dfde44a0bfe23523399f8f22'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:51.469747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-498c841e-b261-421e-b8fc-48377fb42d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e775b9e1dfde44a0bfe23523399f8f22'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:51.476549 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1246/2474] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:41:51 2022] DELETE /identity/v3/users/e775b9e1dfde44a0bfe23523399f8f22 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:41:51.754841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66ce8b-51c8-436e-b1b0-12602e92eee7 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:51.765096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66ce8b-51c8-436e-b1b0-12602e92eee7 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:51.838567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:51.839246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:51.839524 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:51.839799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] PATH_INFO: `/v3/projects/ab774f704fe2495b8124eee291341628` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:51.841133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab774f704fe2495b8124eee291341628)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:51.843614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:51.954234 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab774f704fe2495b8124eee291341628', 'request_id': 'req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:51.960737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:51.962454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab774f704fe2495b8124eee291341628', 'request_id': 'req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:51.970511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab774f704fe2495b8124eee291341628', 'request_id': 'req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:52.029111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] The token cache is being invalidate because project ab774f704fe2495b8124eee291341628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:41:52.029455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:52.030097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f8902488-2d94-4a7f-9af5-0efd2dc2b1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:52.035590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1229/2475] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:41:51 2022] DELETE /identity/v3/projects/ab774f704fe2495b8124eee291341628 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:41:52.042334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585167b5-680b-47ef-8679-f26b88438aad None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:52.042650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585167b5-680b-47ef-8679-f26b88438aad None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:52.042959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585167b5-680b-47ef-8679-f26b88438aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:52.066630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-585167b5-680b-47ef-8679-f26b88438aad None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:52.067869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-585167b5-680b-47ef-8679-f26b88438aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:52.142271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1247/2476] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:41:52.150185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8758c-fd08-42c2-ba9b-a4dfe18e42fd None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:52.150469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8758c-fd08-42c2-ba9b-a4dfe18e42fd None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:52.150747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8758c-fd08-42c2-ba9b-a4dfe18e42fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:52.171103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0dd8758c-fd08-42c2-ba9b-a4dfe18e42fd None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:52.172292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0dd8758c-fd08-42c2-ba9b-a4dfe18e42fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:52.181264 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1230/2477] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:41:52.185734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585167b5-680b-47ef-8679-f26b88438aad None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:52.198036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585167b5-680b-47ef-8679-f26b88438aad None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:52.203430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe231a-e77d-4bed-aaa5-a50cfa07d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:52.204064 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe231a-e77d-4bed-aaa5-a50cfa07d8df admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:52.204726 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe231a-e77d-4bed-aaa5-a50cfa07d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:52.204951 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe231a-e77d-4bed-aaa5-a50cfa07d8df admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:52.205624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe231a-e77d-4bed-aaa5-a50cfa07d8df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:41:52.205934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe231a-e77d-4bed-aaa5-a50cfa07d8df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:52.207544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe231a-e77d-4bed-aaa5-a50cfa07d8df admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:52.219282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1248/2478] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:41:52.223950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8758c-fd08-42c2-ba9b-a4dfe18e42fd None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:52.233229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8758c-fd08-42c2-ba9b-a4dfe18e42fd None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:52.239388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0d9d0-01cd-497b-add6-0ac17668d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:52.240015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d9d0-01cd-497b-add6-0ac17668d374 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:52.240295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d9d0-01cd-497b-add6-0ac17668d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:52.241797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0d9d0-01cd-497b-add6-0ac17668d374 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:52.241797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0d9d0-01cd-497b-add6-0ac17668d374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:52.243158 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0d9d0-01cd-497b-add6-0ac17668d374 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:52.379264 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1231/2479] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:41:52 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:41:52.383359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe231a-e77d-4bed-aaa5-a50cfa07d8df admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:52.393788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe231a-e77d-4bed-aaa5-a50cfa07d8df admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:52.462214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cdb61-44be-46c6-ace7-8befb4bc5840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:52.462757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cdb61-44be-46c6-ace7-8befb4bc5840 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:52.463067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cdb61-44be-46c6-ace7-8befb4bc5840 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:52.463269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cdb61-44be-46c6-ace7-8befb4bc5840 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:52.463891 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cdb61-44be-46c6-ace7-8befb4bc5840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:52.465867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cdb61-44be-46c6-ace7-8befb4bc5840 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:52.474466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:52.550458 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1249/2480] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:41:52 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:41:52.553907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0d9d0-01cd-497b-add6-0ac17668d374 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:52.569672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0d9d0-01cd-497b-add6-0ac17668d374 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:52.574750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b28813-c0b0-484b-9143-ab8d6ee7b232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:52.575339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b28813-c0b0-484b-9143-ab8d6ee7b232 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:52.575613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b28813-c0b0-484b-9143-ab8d6ee7b232 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:52.575965 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b28813-c0b0-484b-9143-ab8d6ee7b232 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:52.576598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b28813-c0b0-484b-9143-ab8d6ee7b232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:52.578227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b28813-c0b0-484b-9143-ab8d6ee7b232 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:52.588637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1232/2481] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:41:52.593015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cdb61-44be-46c6-ace7-8befb4bc5840 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:52.603791 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cdb61-44be-46c6-ace7-8befb4bc5840 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:52.609245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958042f4-e8a0-47e1-a892-bf07f782de6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:52.616805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958042f4-e8a0-47e1-a892-bf07f782de6a admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:52.616805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958042f4-e8a0-47e1-a892-bf07f782de6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:52.616805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958042f4-e8a0-47e1-a892-bf07f782de6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:52.616805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958042f4-e8a0-47e1-a892-bf07f782de6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:52.616805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958042f4-e8a0-47e1-a892-bf07f782de6a admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:52.625506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1250/2482] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:41:52.630686 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b28813-c0b0-484b-9143-ab8d6ee7b232 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:52.642219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b28813-c0b0-484b-9143-ab8d6ee7b232 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:52.650420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6351baf-cdca-4f02-8f06-2ee2b86b05d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:52.651104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6351baf-cdca-4f02-8f06-2ee2b86b05d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:52.653394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6351baf-cdca-4f02-8f06-2ee2b86b05d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:52.653394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6351baf-cdca-4f02-8f06-2ee2b86b05d7 admin admin] PATH_INFO: `/v3/projects/3e819b9488054313bdd9850d8042492a/users/2cef93f9699749b492c460830d4b2982/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:52.668229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6351baf-cdca-4f02-8f06-2ee2b86b05d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e819b9488054313bdd9850d8042492a, user_id=2cef93f9699749b492c460830d4b2982, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:52.671107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6351baf-cdca-4f02-8f06-2ee2b86b05d7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:52.749224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1233/2483] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:41:52 2022] PUT /identity/v3/projects/3e819b9488054313bdd9850d8042492a/users/2cef93f9699749b492c460830d4b2982/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:41:52.762987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3b8f-0f45-4b3b-8748-0d027e16c99b None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:52.763272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3b8f-0f45-4b3b-8748-0d027e16c99b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:52.763547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3b8f-0f45-4b3b-8748-0d027e16c99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:52.794214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-67ee3b8f-0f45-4b3b-8748-0d027e16c99b None None] MFA Rules not processed for user `2cef93f9699749b492c460830d4b2982`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:52.795461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-67ee3b8f-0f45-4b3b-8748-0d027e16c99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:52.859097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1251/2484] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:41:52.870967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6351baf-cdca-4f02-8f06-2ee2b86b05d7 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:52.872735 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a6351baf-cdca-4f02-8f06-2ee2b86b05d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:52.948731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6351baf-cdca-4f02-8f06-2ee2b86b05d7 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:52.955016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8715144-0079-47a9-be79-ded6b2d8395b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:52.955847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715144-0079-47a9-be79-ded6b2d8395b service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:52.956126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715144-0079-47a9-be79-ded6b2d8395b service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:52.956392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8715144-0079-47a9-be79-ded6b2d8395b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:52.968136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8715144-0079-47a9-be79-ded6b2d8395b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:52.971281 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8715144-0079-47a9-be79-ded6b2d8395b service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:52.984946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1234/2485] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:41:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:41:56.296234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee3b8f-0f45-4b3b-8748-0d027e16c99b None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:56.364876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee3b8f-0f45-4b3b-8748-0d027e16c99b None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:56.369588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:56.370238 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:56.370521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:56.370840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] PATH_INFO: `/v3/users/2cef93f9699749b492c460830d4b2982` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:56.371945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cef93f9699749b492c460830d4b2982)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:56.373945 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:56.580854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cef93f9699749b492c460830d4b2982'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:56.593139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cef93f9699749b492c460830d4b2982'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:56.599280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:56.602422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cef93f9699749b492c460830d4b2982'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:56.669004 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cef93f9699749b492c460830d4b2982'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:56.669896 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cef93f9699749b492c460830d4b2982'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:56.677649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1252/2486] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:41:56 2022] DELETE /identity/v3/users/2cef93f9699749b492c460830d4b2982 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:41:56.682292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439022c-779b-40e5-b3c5-6e6c495acc82 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:56.682791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439022c-779b-40e5-b3c5-6e6c495acc82 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:56.682898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439022c-779b-40e5-b3c5-6e6c495acc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:56.703217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-c439022c-779b-40e5-b3c5-6e6c495acc82 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:56.705262 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c439022c-779b-40e5-b3c5-6e6c495acc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:56.764544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1235/2487] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:41:56.775207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:56.776618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:56.843073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c216d34-c3cf-4a2a-8a5a-79886c262aeb admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:56.850978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c9fe8-48d6-425d-ba37-c77cb3a4075f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:56.851590 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c9fe8-48d6-425d-ba37-c77cb3a4075f service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:56.851865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c9fe8-48d6-425d-ba37-c77cb3a4075f service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:56.852137 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c9fe8-48d6-425d-ba37-c77cb3a4075f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:56.862767 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c9fe8-48d6-425d-ba37-c77cb3a4075f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:56.864213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c9fe8-48d6-425d-ba37-c77cb3a4075f service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:56.874043 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1253/2488] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:41:57.371741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439022c-779b-40e5-b3c5-6e6c495acc82 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:57.371741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c439022c-779b-40e5-b3c5-6e6c495acc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:57.372692 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:57.379977 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439022c-779b-40e5-b3c5-6e6c495acc82 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:57.386653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:57.387411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:57.387853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:57.388136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] PATH_INFO: `/v3/projects/3e819b9488054313bdd9850d8042492a` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:57.390094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e819b9488054313bdd9850d8042492a)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:57.393391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:57.507603 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e819b9488054313bdd9850d8042492a', 'request_id': 'req-51f28c6b-65d6-4674-9328-4349f9911bf5'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:57.513003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e819b9488054313bdd9850d8042492a', 'request_id': 'req-51f28c6b-65d6-4674-9328-4349f9911bf5'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:57.521239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e819b9488054313bdd9850d8042492a', 'request_id': 'req-51f28c6b-65d6-4674-9328-4349f9911bf5'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:57.628522 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] The token cache is being invalidate because project 3e819b9488054313bdd9850d8042492a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:41:57.628944 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:57.629370 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-51f28c6b-65d6-4674-9328-4349f9911bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:41:57.630952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1236/2489] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:41:57 2022] DELETE /identity/v3/projects/3e819b9488054313bdd9850d8042492a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:41:57.636532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935bc8b-2690-4fa9-a3a5-1e1b1a4c0000 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:57.637361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935bc8b-2690-4fa9-a3a5-1e1b1a4c0000 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:57.637361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935bc8b-2690-4fa9-a3a5-1e1b1a4c0000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:57.658446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-6935bc8b-2690-4fa9-a3a5-1e1b1a4c0000 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:57.659698 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6935bc8b-2690-4fa9-a3a5-1e1b1a4c0000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:57.722196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1254/2490] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:41:57.730065 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f2803-5454-4683-a86f-b4acebaad9f9 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:57.730580 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f2803-5454-4683-a86f-b4acebaad9f9 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:57.730688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f2803-5454-4683-a86f-b4acebaad9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:57.752336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-753f2803-5454-4683-a86f-b4acebaad9f9 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:57.754136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-753f2803-5454-4683-a86f-b4acebaad9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:57.764179 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1237/2491] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:41:57.769558 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935bc8b-2690-4fa9-a3a5-1e1b1a4c0000 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:57.779530 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935bc8b-2690-4fa9-a3a5-1e1b1a4c0000 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:57.784726 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3835c-bae1-4b7c-8b52-ed157a6df0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:57.785395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3835c-bae1-4b7c-8b52-ed157a6df0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:57.785722 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3835c-bae1-4b7c-8b52-ed157a6df0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:57.785998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3835c-bae1-4b7c-8b52-ed157a6df0a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:57.786651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3835c-bae1-4b7c-8b52-ed157a6df0a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:41:57.786953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3835c-bae1-4b7c-8b52-ed157a6df0a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:57.788562 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3835c-bae1-4b7c-8b52-ed157a6df0a2 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:57.802447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1255/2492] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:41:57.806837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f2803-5454-4683-a86f-b4acebaad9f9 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:57.817113 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f2803-5454-4683-a86f-b4acebaad9f9 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:57.822239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8963d6-d8bb-4303-91d0-2263da627470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:57.822850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8963d6-d8bb-4303-91d0-2263da627470 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:57.823130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8963d6-d8bb-4303-91d0-2263da627470 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:57.823411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8963d6-d8bb-4303-91d0-2263da627470 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:57.824052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8963d6-d8bb-4303-91d0-2263da627470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:57.826024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8963d6-d8bb-4303-91d0-2263da627470 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:57.940314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1238/2493] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:41:57 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:41:57.944697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3835c-bae1-4b7c-8b52-ed157a6df0a2 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:57.956315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3835c-bae1-4b7c-8b52-ed157a6df0a2 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:58.012753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b59d22-ed1d-405f-8ea9-6eeead614baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:58.013353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b59d22-ed1d-405f-8ea9-6eeead614baa admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:58.013667 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b59d22-ed1d-405f-8ea9-6eeead614baa admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:58.013939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b59d22-ed1d-405f-8ea9-6eeead614baa admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:58.014574 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b59d22-ed1d-405f-8ea9-6eeead614baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:58.016517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b59d22-ed1d-405f-8ea9-6eeead614baa admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:58.125317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1256/2494] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:41:57 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:41:58.130310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8963d6-d8bb-4303-91d0-2263da627470 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:58.141161 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8963d6-d8bb-4303-91d0-2263da627470 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:58.147447 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696141b-f5e7-4598-ab0d-06f0dddbb68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:58.148061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696141b-f5e7-4598-ab0d-06f0dddbb68f admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:58.148339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696141b-f5e7-4598-ab0d-06f0dddbb68f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:58.148612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696141b-f5e7-4598-ab0d-06f0dddbb68f admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:58.149259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696141b-f5e7-4598-ab0d-06f0dddbb68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:58.150949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696141b-f5e7-4598-ab0d-06f0dddbb68f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:58.162830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1239/2495] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:41:58.166949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b59d22-ed1d-405f-8ea9-6eeead614baa admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:58.178053 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b59d22-ed1d-405f-8ea9-6eeead614baa admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:58.182973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3b8eb-6fc7-4d29-80e6-6bc4c5ee377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:58.183583 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3b8eb-6fc7-4d29-80e6-6bc4c5ee377a admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:58.183868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3b8eb-6fc7-4d29-80e6-6bc4c5ee377a admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:58.184145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3b8eb-6fc7-4d29-80e6-6bc4c5ee377a admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:58.184789 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3b8eb-6fc7-4d29-80e6-6bc4c5ee377a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:58.186498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3b8eb-6fc7-4d29-80e6-6bc4c5ee377a admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:58.187978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:58.200073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1257/2496] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:41:58.208931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696141b-f5e7-4598-ab0d-06f0dddbb68f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:58.219790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696141b-f5e7-4598-ab0d-06f0dddbb68f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:58.224561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f7f9c-32cd-46e4-bafa-e580e75b20d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:58.225206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7f9c-32cd-46e4-bafa-e580e75b20d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:58.225483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7f9c-32cd-46e4-bafa-e580e75b20d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:58.225785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7f9c-32cd-46e4-bafa-e580e75b20d3 admin admin] PATH_INFO: `/v3/projects/2e0500555b294ab58f9ed45571feec68/users/554c170a8e7c4b6d8ab2bea508baef68/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:58.241865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f7f9c-32cd-46e4-bafa-e580e75b20d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0500555b294ab58f9ed45571feec68, user_id=554c170a8e7c4b6d8ab2bea508baef68, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:58.244519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f7f9c-32cd-46e4-bafa-e580e75b20d3 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:58.306875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1240/2497] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:41:58 2022] PUT /identity/v3/projects/2e0500555b294ab58f9ed45571feec68/users/554c170a8e7c4b6d8ab2bea508baef68/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:41:58.317518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a910a4-f973-448e-b7cb-091449512ab3 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:58.317838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a910a4-f973-448e-b7cb-091449512ab3 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:58.318114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a910a4-f973-448e-b7cb-091449512ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:58.352450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a6a910a4-f973-448e-b7cb-091449512ab3 None None] MFA Rules not processed for user `554c170a8e7c4b6d8ab2bea508baef68`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:58.353716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a6a910a4-f973-448e-b7cb-091449512ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:58.390005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f7f9c-32cd-46e4-bafa-e580e75b20d3 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:58.392311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b18f7f9c-32cd-46e4-bafa-e580e75b20d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:58.422180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1258/2498] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:41:58.427618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a910a4-f973-448e-b7cb-091449512ab3 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:58.482984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f7f9c-32cd-46e4-bafa-e580e75b20d3 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:58.489866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bda1ff-9581-4bf1-a3d2-14f39164aa79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:58.490472 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bda1ff-9581-4bf1-a3d2-14f39164aa79 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:58.490779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bda1ff-9581-4bf1-a3d2-14f39164aa79 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:58.491030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bda1ff-9581-4bf1-a3d2-14f39164aa79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:58.492794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-36bda1ff-9581-4bf1-a3d2-14f39164aa79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:58.501495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a910a4-f973-448e-b7cb-091449512ab3 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:58.506514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acc982-7d60-4058-8d08-be5974235194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:58.507126 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc982-7d60-4058-8d08-be5974235194 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:58.507408 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc982-7d60-4058-8d08-be5974235194 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:58.507690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc982-7d60-4058-8d08-be5974235194 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:58.508333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acc982-7d60-4058-8d08-be5974235194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:58.510309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acc982-7d60-4058-8d08-be5974235194 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:58.511844 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:58.554336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bda1ff-9581-4bf1-a3d2-14f39164aa79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:58.555928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bda1ff-9581-4bf1-a3d2-14f39164aa79 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:58.565542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1241/2499] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:41:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:41:58.635047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1259/2500] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:41:58 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:41:58.645868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bda1ff-9581-4bf1-a3d2-14f39164aa79 service nova] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:58.658745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bda1ff-9581-4bf1-a3d2-14f39164aa79 service nova] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:58.721675 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667fa11-117c-4faa-9faf-255bb6a3d258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:58.722295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667fa11-117c-4faa-9faf-255bb6a3d258 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:58.722606 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667fa11-117c-4faa-9faf-255bb6a3d258 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:58.722876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667fa11-117c-4faa-9faf-255bb6a3d258 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:58.723527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667fa11-117c-4faa-9faf-255bb6a3d258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:58.725502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667fa11-117c-4faa-9faf-255bb6a3d258 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:58.834205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1242/2501] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:41:58 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:41:58.838243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acc982-7d60-4058-8d08-be5974235194 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:58.850564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acc982-7d60-4058-8d08-be5974235194 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:58.855790 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3ed97-7e59-4b9b-bb8b-2b021efb2ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:58.856402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3ed97-7e59-4b9b-bb8b-2b021efb2ded admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:58.856681 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3ed97-7e59-4b9b-bb8b-2b021efb2ded admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:58.856951 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3ed97-7e59-4b9b-bb8b-2b021efb2ded admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:58.857622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3ed97-7e59-4b9b-bb8b-2b021efb2ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:58.859282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3ed97-7e59-4b9b-bb8b-2b021efb2ded admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:58.870450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1260/2502] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:41:58.874774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667fa11-117c-4faa-9faf-255bb6a3d258 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:58.885818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667fa11-117c-4faa-9faf-255bb6a3d258 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:58.890588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeef99a-0e25-4932-96a2-a8e3453b8b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:58.891278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef99a-0e25-4932-96a2-a8e3453b8b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:58.892212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef99a-0e25-4932-96a2-a8e3453b8b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:58.892433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeef99a-0e25-4932-96a2-a8e3453b8b4c admin admin] PATH_INFO: `/v3/projects/2253a3c8030c4eb4aefa0d5876be6491/users/a6261b59b8d443cca498c4d8b62acf9a/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:58.913286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeef99a-0e25-4932-96a2-a8e3453b8b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2253a3c8030c4eb4aefa0d5876be6491, user_id=a6261b59b8d443cca498c4d8b62acf9a, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:58.913286 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeef99a-0e25-4932-96a2-a8e3453b8b4c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:59.018599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1243/2503] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:41:58 2022] PUT /identity/v3/projects/2253a3c8030c4eb4aefa0d5876be6491/users/a6261b59b8d443cca498c4d8b62acf9a/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:41:59.022614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3ed97-7e59-4b9b-bb8b-2b021efb2ded admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:59.034097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3ed97-7e59-4b9b-bb8b-2b021efb2ded admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:59.098011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1894777-24a9-42da-952c-13b5a2c18657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:59.098621 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894777-24a9-42da-952c-13b5a2c18657 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:59.098903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894777-24a9-42da-952c-13b5a2c18657 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:59.099174 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1894777-24a9-42da-952c-13b5a2c18657 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:59.099811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1894777-24a9-42da-952c-13b5a2c18657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:59.101491 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1894777-24a9-42da-952c-13b5a2c18657 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:59.102876 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:41:59.118025 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1261/2504] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:41:59.119191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeef99a-0e25-4932-96a2-a8e3453b8b4c admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:59.130520 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeef99a-0e25-4932-96a2-a8e3453b8b4c admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:59.137850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30cd8b-ad87-459d-897c-72db9c328eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:59.137850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30cd8b-ad87-459d-897c-72db9c328eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:59.137850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30cd8b-ad87-459d-897c-72db9c328eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:59.137850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30cd8b-ad87-459d-897c-72db9c328eb7 admin admin] PATH_INFO: `/v3/projects/2253a3c8030c4eb4aefa0d5876be6491/users/a6261b59b8d443cca498c4d8b62acf9a/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:59.141354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30cd8b-ad87-459d-897c-72db9c328eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2253a3c8030c4eb4aefa0d5876be6491, user_id=a6261b59b8d443cca498c4d8b62acf9a, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:59.144895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30cd8b-ad87-459d-897c-72db9c328eb7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:59.157162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1244/2505] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:41:59 2022] PUT /identity/v3/projects/2253a3c8030c4eb4aefa0d5876be6491/users/a6261b59b8d443cca498c4d8b62acf9a/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:41:59.169940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3421ed-0194-42fc-bc68-430655693ff0 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:59.170138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3421ed-0194-42fc-bc68-430655693ff0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:59.170414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3421ed-0194-42fc-bc68-430655693ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:59.206967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ad3421ed-0194-42fc-bc68-430655693ff0 None None] MFA Rules not processed for user `a6261b59b8d443cca498c4d8b62acf9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:41:59.208214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ad3421ed-0194-42fc-bc68-430655693ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:59.285014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1262/2506] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:41:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:41:59.297240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30cd8b-ad87-459d-897c-72db9c328eb7 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:41:59.299433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-fa30cd8b-ad87-459d-897c-72db9c328eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:41:59.362180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30cd8b-ad87-459d-897c-72db9c328eb7 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:41:59.366072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a519-5de1-443d-9846-02c8747e2741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:41:59.372955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a519-5de1-443d-9846-02c8747e2741 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:41:59.372955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a519-5de1-443d-9846-02c8747e2741 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:41:59.372955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a519-5de1-443d-9846-02c8747e2741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:41:59.377109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45a519-5de1-443d-9846-02c8747e2741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:41:59.378636 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45a519-5de1-443d-9846-02c8747e2741 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:41:59.394719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1245/2507] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:41:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:00.525961 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3421ed-0194-42fc-bc68-430655693ff0 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:00.602638 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3421ed-0194-42fc-bc68-430655693ff0 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:00.607478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:00.608119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:00.608403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:00.608678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] PATH_INFO: `/v3/users/554c170a8e7c4b6d8ab2bea508baef68` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:00.609886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554c170a8e7c4b6d8ab2bea508baef68)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:00.611833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:00.864080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554c170a8e7c4b6d8ab2bea508baef68'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:00.878765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554c170a8e7c4b6d8ab2bea508baef68'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:00.886368 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554c170a8e7c4b6d8ab2bea508baef68'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:00.965734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554c170a8e7c4b6d8ab2bea508baef68'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:00.966360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554c170a8e7c4b6d8ab2bea508baef68'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:00.968863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:00.974150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1263/2508] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:42:00 2022] DELETE /identity/v3/users/554c170a8e7c4b6d8ab2bea508baef68 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:00.978773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337f69-b62b-4412-a80e-e9fad453edaf None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:00.979276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337f69-b62b-4412-a80e-e9fad453edaf None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:00.979464 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82337f69-b62b-4412-a80e-e9fad453edaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:01.002848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-82337f69-b62b-4412-a80e-e9fad453edaf None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:01.004096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-82337f69-b62b-4412-a80e-e9fad453edaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:01.012925 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:01.066975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1246/2509] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:01.083417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:01.084954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:01.149302 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fcb91-aa66-4785-b16a-43a277b5a528 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:01.154359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f74845-b5de-4630-b51e-0847200ae88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:01.155159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74845-b5de-4630-b51e-0847200ae88e service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:01.155564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74845-b5de-4630-b51e-0847200ae88e service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:01.155939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f74845-b5de-4630-b51e-0847200ae88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:01.168741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f74845-b5de-4630-b51e-0847200ae88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:01.170252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f74845-b5de-4630-b51e-0847200ae88e service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:01.181614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1264/2510] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:01.670175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82337f69-b62b-4412-a80e-e9fad453edaf None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:01.673833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-82337f69-b62b-4412-a80e-e9fad453edaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:01.684583 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82337f69-b62b-4412-a80e-e9fad453edaf None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:01.689497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:01.690339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:01.690463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:01.690705 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] PATH_INFO: `/v3/projects/2e0500555b294ab58f9ed45571feec68` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:01.691880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0500555b294ab58f9ed45571feec68)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:01.693814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:01.842009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0500555b294ab58f9ed45571feec68', 'request_id': 'req-c23851ed-ec1b-401f-b5f3-83815c24dd0c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:01.848583 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0500555b294ab58f9ed45571feec68', 'request_id': 'req-c23851ed-ec1b-401f-b5f3-83815c24dd0c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:01.857275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0500555b294ab58f9ed45571feec68', 'request_id': 'req-c23851ed-ec1b-401f-b5f3-83815c24dd0c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:01.989001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] The token cache is being invalidate because project 2e0500555b294ab58f9ed45571feec68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:42:01.989722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:01.990165 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:01.991747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1247/2511] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:42:01 2022] DELETE /identity/v3/projects/2e0500555b294ab58f9ed45571feec68 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:42:01.995897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f74845-b5de-4630-b51e-0847200ae88e service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:02.006608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f74845-b5de-4630-b51e-0847200ae88e service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:02.075501 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159bedf-1967-4319-b919-65c3b2421167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:02.076242 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159bedf-1967-4319-b919-65c3b2421167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:02.076527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159bedf-1967-4319-b919-65c3b2421167 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:02.076805 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159bedf-1967-4319-b919-65c3b2421167 admin admin] PATH_INFO: `/v3/users/a6261b59b8d443cca498c4d8b62acf9a` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:02.078120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159bedf-1967-4319-b919-65c3b2421167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6261b59b8d443cca498c4d8b62acf9a)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:02.081241 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159bedf-1967-4319-b919-65c3b2421167 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:02.333232 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8159bedf-1967-4319-b919-65c3b2421167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6261b59b8d443cca498c4d8b62acf9a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:02.348196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8159bedf-1967-4319-b919-65c3b2421167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6261b59b8d443cca498c4d8b62acf9a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:02.357328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8159bedf-1967-4319-b919-65c3b2421167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6261b59b8d443cca498c4d8b62acf9a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:02.469899 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8159bedf-1967-4319-b919-65c3b2421167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6261b59b8d443cca498c4d8b62acf9a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:02.470708 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8159bedf-1967-4319-b919-65c3b2421167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6261b59b8d443cca498c4d8b62acf9a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:02.477281 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1265/2512] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:42:01 2022] DELETE /identity/v3/users/a6261b59b8d443cca498c4d8b62acf9a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:02.996412 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:02.998055 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:03.013139 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23851ed-ec1b-401f-b5f3-83815c24dd0c admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:03.076664 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:03.077332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:03.077641 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:03.078025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] PATH_INFO: `/v3/projects/2253a3c8030c4eb4aefa0d5876be6491` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:03.080595 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2253a3c8030c4eb4aefa0d5876be6491)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:03.082129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:03.193670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:03.201748 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2253a3c8030c4eb4aefa0d5876be6491', 'request_id': 'req-c77e7294-8147-44e8-bc2a-727be648f0f0'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:03.207350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2253a3c8030c4eb4aefa0d5876be6491', 'request_id': 'req-c77e7294-8147-44e8-bc2a-727be648f0f0'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:03.213873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2253a3c8030c4eb4aefa0d5876be6491', 'request_id': 'req-c77e7294-8147-44e8-bc2a-727be648f0f0'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:03.308302 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] The token cache is being invalidate because project 2253a3c8030c4eb4aefa0d5876be6491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:42:03.308585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:03.309274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c77e7294-8147-44e8-bc2a-727be648f0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:03.310827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1248/2513] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:42:02 2022] DELETE /identity/v3/projects/2253a3c8030c4eb4aefa0d5876be6491 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:03.316511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da01ba-5e18-46e2-96f0-3898aa2ab248 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:03.317073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da01ba-5e18-46e2-96f0-3898aa2ab248 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:03.317181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da01ba-5e18-46e2-96f0-3898aa2ab248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:03.337942 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-e2da01ba-5e18-46e2-96f0-3898aa2ab248 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:03.340294 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e2da01ba-5e18-46e2-96f0-3898aa2ab248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:03.356528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:03.399860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1266/2514] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:03.407942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3cb4-ae1b-4845-9de7-552aea4ad01b None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:03.408363 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3cb4-ae1b-4845-9de7-552aea4ad01b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:03.409100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa3cb4-ae1b-4845-9de7-552aea4ad01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:03.429865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-cdaa3cb4-ae1b-4845-9de7-552aea4ad01b None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:03.431077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cdaa3cb4-ae1b-4845-9de7-552aea4ad01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:03.439777 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1249/2515] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:03.444405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da01ba-5e18-46e2-96f0-3898aa2ab248 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:03.454275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da01ba-5e18-46e2-96f0-3898aa2ab248 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:03.459138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf31b-ca87-429c-99c7-862c76666676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:03.459742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf31b-ca87-429c-99c7-862c76666676 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:03.460016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf31b-ca87-429c-99c7-862c76666676 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:03.460285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf31b-ca87-429c-99c7-862c76666676 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:03.460933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf31b-ca87-429c-99c7-862c76666676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:42:03.461230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf31b-ca87-429c-99c7-862c76666676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:03.462859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf31b-ca87-429c-99c7-862c76666676 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:03.476866 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1267/2516] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:42:03.481479 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa3cb4-ae1b-4845-9de7-552aea4ad01b None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:03.491514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa3cb4-ae1b-4845-9de7-552aea4ad01b None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:03.496357 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e674740-048c-42b0-90a4-9add921abfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:03.496954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e674740-048c-42b0-90a4-9add921abfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:03.497235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e674740-048c-42b0-90a4-9add921abfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:03.497508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e674740-048c-42b0-90a4-9add921abfd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:03.498180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e674740-048c-42b0-90a4-9add921abfd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:03.500086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e674740-048c-42b0-90a4-9add921abfd8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:03.590344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1250/2517] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:42:03 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:03.595186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf31b-ca87-429c-99c7-862c76666676 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:03.605853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf31b-ca87-429c-99c7-862c76666676 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:03.665114 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b29645-10e6-47db-b8f8-2b8f92f09a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:03.665768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b29645-10e6-47db-b8f8-2b8f92f09a0b admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:03.666050 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b29645-10e6-47db-b8f8-2b8f92f09a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:03.666326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b29645-10e6-47db-b8f8-2b8f92f09a0b admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:03.666969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b29645-10e6-47db-b8f8-2b8f92f09a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:03.668896 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b29645-10e6-47db-b8f8-2b8f92f09a0b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:03.766288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1268/2518] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:42:03 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:03.770836 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e674740-048c-42b0-90a4-9add921abfd8 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:03.781265 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e674740-048c-42b0-90a4-9add921abfd8 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:03.786958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70c4d0-1d9d-4da3-97ff-9f7cd8ecf73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:03.787533 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c4d0-1d9d-4da3-97ff-9f7cd8ecf73e admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:03.787830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c4d0-1d9d-4da3-97ff-9f7cd8ecf73e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:03.788149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70c4d0-1d9d-4da3-97ff-9f7cd8ecf73e admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:03.788734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70c4d0-1d9d-4da3-97ff-9f7cd8ecf73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:03.790378 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70c4d0-1d9d-4da3-97ff-9f7cd8ecf73e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:03.801308 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1251/2519] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:42:03.805354 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b29645-10e6-47db-b8f8-2b8f92f09a0b admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:03.817047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b29645-10e6-47db-b8f8-2b8f92f09a0b admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:03.822624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd4025-1388-4e69-8f89-e8ea91e74387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:03.823521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd4025-1388-4e69-8f89-e8ea91e74387 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:03.823902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd4025-1388-4e69-8f89-e8ea91e74387 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:03.824325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd4025-1388-4e69-8f89-e8ea91e74387 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:03.825510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd4025-1388-4e69-8f89-e8ea91e74387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:03.828024 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd4025-1388-4e69-8f89-e8ea91e74387 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:03.843425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1269/2520] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:03.845649 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70c4d0-1d9d-4da3-97ff-9f7cd8ecf73e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:03.856282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70c4d0-1d9d-4da3-97ff-9f7cd8ecf73e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:03.862143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100de5b-5d1b-47cc-a397-295b1358e98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:03.862803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100de5b-5d1b-47cc-a397-295b1358e98d admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:03.863079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100de5b-5d1b-47cc-a397-295b1358e98d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:03.863351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100de5b-5d1b-47cc-a397-295b1358e98d admin admin] PATH_INFO: `/v3/projects/33e0dd9154a54227b51c07c1270c91fb/users/9483ee41fb78407787f35430724b581c/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:04.006438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100de5b-5d1b-47cc-a397-295b1358e98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e0dd9154a54227b51c07c1270c91fb, user_id=9483ee41fb78407787f35430724b581c, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:04.009138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100de5b-5d1b-47cc-a397-295b1358e98d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:04.098730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1252/2521] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:03 2022] PUT /identity/v3/projects/33e0dd9154a54227b51c07c1270c91fb/users/9483ee41fb78407787f35430724b581c/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:04.109237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b06e5d-aa1f-409d-a9ce-5f6b5a4b4458 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:04.109521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b06e5d-aa1f-409d-a9ce-5f6b5a4b4458 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:04.109825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b06e5d-aa1f-409d-a9ce-5f6b5a4b4458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:04.139487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-02b06e5d-aa1f-409d-a9ce-5f6b5a4b4458 None None] MFA Rules not processed for user `9483ee41fb78407787f35430724b581c`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:04.140701 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-02b06e5d-aa1f-409d-a9ce-5f6b5a4b4458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:04.205509 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1270/2522] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:04.210048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100de5b-5d1b-47cc-a397-295b1358e98d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:04.271471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100de5b-5d1b-47cc-a397-295b1358e98d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:04.276144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd77a9a-d70b-457a-bacc-09a2b2b4e1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:04.276740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd77a9a-d70b-457a-bacc-09a2b2b4e1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:04.277020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd77a9a-d70b-457a-bacc-09a2b2b4e1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:04.277292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd77a9a-d70b-457a-bacc-09a2b2b4e1e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:04.277954 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd77a9a-d70b-457a-bacc-09a2b2b4e1e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:04.279878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd77a9a-d70b-457a-bacc-09a2b2b4e1e6 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:04.385257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1253/2523] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:42:04 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:04.389046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b06e5d-aa1f-409d-a9ce-5f6b5a4b4458 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:04.402027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b06e5d-aa1f-409d-a9ce-5f6b5a4b4458 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:04.418336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:04.467417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eefa3-0d2a-4ebb-ab15-6c59bbd64747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:04.468026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eefa3-0d2a-4ebb-ab15-6c59bbd64747 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:04.468306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eefa3-0d2a-4ebb-ab15-6c59bbd64747 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:04.468604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eefa3-0d2a-4ebb-ab15-6c59bbd64747 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:04.469235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03eefa3-0d2a-4ebb-ab15-6c59bbd64747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:04.471323 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03eefa3-0d2a-4ebb-ab15-6c59bbd64747 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:04.567141 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1271/2524] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:42:04 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:04.571680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd77a9a-d70b-457a-bacc-09a2b2b4e1e6 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:04.582639 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd77a9a-d70b-457a-bacc-09a2b2b4e1e6 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:04.587249 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12484787-d4e7-46bf-8f7a-9220425da6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:04.587851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484787-d4e7-46bf-8f7a-9220425da6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:04.588123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484787-d4e7-46bf-8f7a-9220425da6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:04.588398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484787-d4e7-46bf-8f7a-9220425da6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:04.589044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12484787-d4e7-46bf-8f7a-9220425da6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:04.590684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12484787-d4e7-46bf-8f7a-9220425da6a3 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:04.600950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1254/2525] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:04.605189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eefa3-0d2a-4ebb-ab15-6c59bbd64747 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:04.615545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eefa3-0d2a-4ebb-ab15-6c59bbd64747 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:04.624115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cecf28-e02e-4dff-a9a0-e421d1cc6137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:04.624769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cecf28-e02e-4dff-a9a0-e421d1cc6137 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:04.625046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cecf28-e02e-4dff-a9a0-e421d1cc6137 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:04.625319 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cecf28-e02e-4dff-a9a0-e421d1cc6137 admin admin] PATH_INFO: `/v3/projects/75ec97505f9543d3b68b649a10a5c1e9/users/f526b635d1294922bc3261fec4624cd9/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:04.646012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cecf28-e02e-4dff-a9a0-e421d1cc6137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ec97505f9543d3b68b649a10a5c1e9, user_id=f526b635d1294922bc3261fec4624cd9, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:04.648633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cecf28-e02e-4dff-a9a0-e421d1cc6137 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:04.834944 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1272/2526] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:04 2022] PUT /identity/v3/projects/75ec97505f9543d3b68b649a10a5c1e9/users/f526b635d1294922bc3261fec4624cd9/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:04.844240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12484787-d4e7-46bf-8f7a-9220425da6a3 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:04.854197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12484787-d4e7-46bf-8f7a-9220425da6a3 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:04.891982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:04.921842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ace25-2b25-4e63-a4d5-ae6f9e27a705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:04.921842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ace25-2b25-4e63-a4d5-ae6f9e27a705 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:04.921842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ace25-2b25-4e63-a4d5-ae6f9e27a705 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:04.921842 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ace25-2b25-4e63-a4d5-ae6f9e27a705 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:04.922350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ace25-2b25-4e63-a4d5-ae6f9e27a705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:04.922350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ace25-2b25-4e63-a4d5-ae6f9e27a705 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:04.930121 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1255/2527] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:04.934304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cecf28-e02e-4dff-a9a0-e421d1cc6137 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:04.945651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cecf28-e02e-4dff-a9a0-e421d1cc6137 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:04.950493 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc5d2c-538a-4f55-a3c2-3628735f3df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:04.951153 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc5d2c-538a-4f55-a3c2-3628735f3df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:04.951436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc5d2c-538a-4f55-a3c2-3628735f3df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:04.956219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc5d2c-538a-4f55-a3c2-3628735f3df0 admin admin] PATH_INFO: `/v3/projects/75ec97505f9543d3b68b649a10a5c1e9/users/f526b635d1294922bc3261fec4624cd9/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:04.956219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc5d2c-538a-4f55-a3c2-3628735f3df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ec97505f9543d3b68b649a10a5c1e9, user_id=f526b635d1294922bc3261fec4624cd9, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:04.956518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc5d2c-538a-4f55-a3c2-3628735f3df0 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:04.966731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1273/2528] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:04 2022] PUT /identity/v3/projects/75ec97505f9543d3b68b649a10a5c1e9/users/f526b635d1294922bc3261fec4624cd9/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:04.978330 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95adff-17f3-4915-881c-e6f2e3e72d82 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:04.978676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95adff-17f3-4915-881c-e6f2e3e72d82 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:04.978955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95adff-17f3-4915-881c-e6f2e3e72d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:05.007193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-3c95adff-17f3-4915-881c-e6f2e3e72d82 None None] MFA Rules not processed for user `f526b635d1294922bc3261fec4624cd9`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:05.009331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-3c95adff-17f3-4915-881c-e6f2e3e72d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:05.084459 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1256/2529] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:05.097030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc5d2c-538a-4f55-a3c2-3628735f3df0 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:05.099138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a8cc5d2c-538a-4f55-a3c2-3628735f3df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:05.169560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc5d2c-538a-4f55-a3c2-3628735f3df0 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:05.174590 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13612cfb-5758-4d25-ab3d-df45355e8c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:05.175495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13612cfb-5758-4d25-ab3d-df45355e8c5b service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:05.175782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13612cfb-5758-4d25-ab3d-df45355e8c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:05.176061 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13612cfb-5758-4d25-ab3d-df45355e8c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:05.186062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13612cfb-5758-4d25-ab3d-df45355e8c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:05.187301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13612cfb-5758-4d25-ab3d-df45355e8c5b service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:05.198151 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1274/2530] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:05.391149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95adff-17f3-4915-881c-e6f2e3e72d82 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:05.401872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95adff-17f3-4915-881c-e6f2e3e72d82 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:05.405469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba74eb-e968-45e2-9075-1b58d79f5d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:05.406134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba74eb-e968-45e2-9075-1b58d79f5d5b service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:05.406411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba74eb-e968-45e2-9075-1b58d79f5d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:05.406681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba74eb-e968-45e2-9075-1b58d79f5d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:05.467628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba74eb-e968-45e2-9075-1b58d79f5d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:05.468951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba74eb-e968-45e2-9075-1b58d79f5d5b service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:05.478367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1257/2531] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:09.120538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13612cfb-5758-4d25-ab3d-df45355e8c5b service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:09.188885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13612cfb-5758-4d25-ab3d-df45355e8c5b service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:09.194003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:09.201172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:09.201172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:09.201172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] PATH_INFO: `/v3/users/9483ee41fb78407787f35430724b581c` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:09.201172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9483ee41fb78407787f35430724b581c)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:09.201172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:09.213468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:09.432291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9483ee41fb78407787f35430724b581c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:09.445175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9483ee41fb78407787f35430724b581c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:09.452047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9483ee41fb78407787f35430724b581c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:09.514149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9483ee41fb78407787f35430724b581c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:09.514775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9483ee41fb78407787f35430724b581c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:09.521684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1275/2532] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:42:09 2022] DELETE /identity/v3/users/9483ee41fb78407787f35430724b581c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:09.526241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1311-ec3b-47b9-9b40-46f2af5bddec None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:09.526731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1311-ec3b-47b9-9b40-46f2af5bddec None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:09.526875 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe1311-ec3b-47b9-9b40-46f2af5bddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:09.546576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0ebe1311-ec3b-47b9-9b40-46f2af5bddec None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:09.547791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0ebe1311-ec3b-47b9-9b40-46f2af5bddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:09.602151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:09.611943 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1258/2533] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:09.622788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:09.624659 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:09.683337 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31f971-8118-43d7-b9ac-fea3e5f506d9 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:09.686761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdf9b5-5f51-4a1f-a10b-41bcbf5d9f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:09.687360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdf9b5-5f51-4a1f-a10b-41bcbf5d9f18 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:09.687635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdf9b5-5f51-4a1f-a10b-41bcbf5d9f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:09.687903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdf9b5-5f51-4a1f-a10b-41bcbf5d9f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:09.698459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdf9b5-5f51-4a1f-a10b-41bcbf5d9f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:09.699897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babdf9b5-5f51-4a1f-a10b-41bcbf5d9f18 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:09.710322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1276/2534] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:10.162341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe1311-ec3b-47b9-9b40-46f2af5bddec None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:10.163766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0ebe1311-ec3b-47b9-9b40-46f2af5bddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:10.182203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe1311-ec3b-47b9-9b40-46f2af5bddec None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:10.186939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:10.187619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:10.187840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:10.188112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] PATH_INFO: `/v3/projects/33e0dd9154a54227b51c07c1270c91fb` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:10.189355 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e0dd9154a54227b51c07c1270c91fb)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:10.199847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:10.326454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e0dd9154a54227b51c07c1270c91fb', 'request_id': 'req-efebe35b-66ab-42fa-97df-96962ebcb0bc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:10.332318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e0dd9154a54227b51c07c1270c91fb', 'request_id': 'req-efebe35b-66ab-42fa-97df-96962ebcb0bc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:10.338832 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e0dd9154a54227b51c07c1270c91fb', 'request_id': 'req-efebe35b-66ab-42fa-97df-96962ebcb0bc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:10.424332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] The token cache is being invalidate because project 33e0dd9154a54227b51c07c1270c91fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:42:10.424332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:10.425262 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:10.426989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1259/2535] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:42:10 2022] DELETE /identity/v3/projects/33e0dd9154a54227b51c07c1270c91fb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:10.431237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdf9b5-5f51-4a1f-a10b-41bcbf5d9f18 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:10.444283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdf9b5-5f51-4a1f-a10b-41bcbf5d9f18 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:10.511363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e6202-53f5-495a-a66f-190dd222e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:10.512141 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e6202-53f5-495a-a66f-190dd222e9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:10.512266 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e6202-53f5-495a-a66f-190dd222e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:10.517589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e6202-53f5-495a-a66f-190dd222e9af admin admin] PATH_INFO: `/v3/users/f526b635d1294922bc3261fec4624cd9` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:10.517589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e6202-53f5-495a-a66f-190dd222e9af admin admin] RBAC: Authorizing `identity:delete_user(user_id=f526b635d1294922bc3261fec4624cd9)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:10.517589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e6202-53f5-495a-a66f-190dd222e9af admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:10.761762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:10.771364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-933e6202-53f5-495a-a66f-190dd222e9af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f526b635d1294922bc3261fec4624cd9'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:10.787062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-933e6202-53f5-495a-a66f-190dd222e9af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f526b635d1294922bc3261fec4624cd9'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:10.794211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-933e6202-53f5-495a-a66f-190dd222e9af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f526b635d1294922bc3261fec4624cd9'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:10.914484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-933e6202-53f5-495a-a66f-190dd222e9af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f526b635d1294922bc3261fec4624cd9'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:10.915886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-933e6202-53f5-495a-a66f-190dd222e9af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f526b635d1294922bc3261fec4624cd9'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:10.924780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1277/2536] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:42:10 2022] DELETE /identity/v3/users/f526b635d1294922bc3261fec4624cd9 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:11.485653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:11.487791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:11.501419 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebe35b-66ab-42fa-97df-96962ebcb0bc admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:11.563239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:11.563856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:11.564130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:11.564404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] PATH_INFO: `/v3/projects/75ec97505f9543d3b68b649a10a5c1e9` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:11.566476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ec97505f9543d3b68b649a10a5c1e9)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:11.568505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:11.692714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ec97505f9543d3b68b649a10a5c1e9', 'request_id': 'req-28f8c39f-760a-4e16-b2e6-54106bb01143'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:11.699198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ec97505f9543d3b68b649a10a5c1e9', 'request_id': 'req-28f8c39f-760a-4e16-b2e6-54106bb01143'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:11.706947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ec97505f9543d3b68b649a10a5c1e9', 'request_id': 'req-28f8c39f-760a-4e16-b2e6-54106bb01143'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:11.828108 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] The token cache is being invalidate because project 75ec97505f9543d3b68b649a10a5c1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:42:11.828399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:11.829035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-28f8c39f-760a-4e16-b2e6-54106bb01143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:11.830697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1260/2537] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:42:11 2022] DELETE /identity/v3/projects/75ec97505f9543d3b68b649a10a5c1e9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:11.837184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f907a49-106d-4c09-86af-509c0f056e07 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:11.837677 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f907a49-106d-4c09-86af-509c0f056e07 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:11.837827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f907a49-106d-4c09-86af-509c0f056e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:11.858687 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0f907a49-106d-4c09-86af-509c0f056e07 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:11.860062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0f907a49-106d-4c09-86af-509c0f056e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:11.921841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1278/2538] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:42:11.931195 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65e20-14d7-4625-b17d-7bf0b148a721 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:11.931497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65e20-14d7-4625-b17d-7bf0b148a721 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:11.932258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef65e20-14d7-4625-b17d-7bf0b148a721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:11.954691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-bef65e20-14d7-4625-b17d-7bf0b148a721 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:11.956590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bef65e20-14d7-4625-b17d-7bf0b148a721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:11.965320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1261/2539] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:11.969885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f907a49-106d-4c09-86af-509c0f056e07 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:11.990804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f907a49-106d-4c09-86af-509c0f056e07 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:11.995815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eca45e-52f7-4e40-b9a5-241708ea756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:11.996432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eca45e-52f7-4e40-b9a5-241708ea756c admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:11.996716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eca45e-52f7-4e40-b9a5-241708ea756c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:11.996989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eca45e-52f7-4e40-b9a5-241708ea756c admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:11.997669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eca45e-52f7-4e40-b9a5-241708ea756c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:42:11.997981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eca45e-52f7-4e40-b9a5-241708ea756c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:11.999589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eca45e-52f7-4e40-b9a5-241708ea756c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:12.013868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1279/2540] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:42:12.018467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef65e20-14d7-4625-b17d-7bf0b148a721 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:12.024138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:12.028086 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef65e20-14d7-4625-b17d-7bf0b148a721 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:12.033123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81da2c-09b3-4239-a1cb-b9a6672fb819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:12.034280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81da2c-09b3-4239-a1cb-b9a6672fb819 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:12.034569 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81da2c-09b3-4239-a1cb-b9a6672fb819 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:12.034841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81da2c-09b3-4239-a1cb-b9a6672fb819 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:12.035680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81da2c-09b3-4239-a1cb-b9a6672fb819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:12.037623 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81da2c-09b3-4239-a1cb-b9a6672fb819 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:12.120768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1262/2541] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:42:12 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:12.125252 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eca45e-52f7-4e40-b9a5-241708ea756c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:12.135783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eca45e-52f7-4e40-b9a5-241708ea756c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:12.197196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cd615-2be3-4250-9be9-b9c4982cc785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:12.197864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cd615-2be3-4250-9be9-b9c4982cc785 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:12.198140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cd615-2be3-4250-9be9-b9c4982cc785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:12.198413 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cd615-2be3-4250-9be9-b9c4982cc785 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:12.199079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cd615-2be3-4250-9be9-b9c4982cc785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:12.201065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cd615-2be3-4250-9be9-b9c4982cc785 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:12.273483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1280/2542] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:42:12 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:42:12.277678 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81da2c-09b3-4239-a1cb-b9a6672fb819 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:12.288850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81da2c-09b3-4239-a1cb-b9a6672fb819 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:12.293747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f32aa-c196-43d3-bb9c-d4428737751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:12.294348 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f32aa-c196-43d3-bb9c-d4428737751c admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:12.294629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f32aa-c196-43d3-bb9c-d4428737751c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:12.294902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f32aa-c196-43d3-bb9c-d4428737751c admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:12.295547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f32aa-c196-43d3-bb9c-d4428737751c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:12.297231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f32aa-c196-43d3-bb9c-d4428737751c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:12.311684 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1263/2543] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:12.312881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cd615-2be3-4250-9be9-b9c4982cc785 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:12.323649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cd615-2be3-4250-9be9-b9c4982cc785 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:12.328637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830d25b-2cd3-4f4b-ac1a-53181f2ab7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:12.329906 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830d25b-2cd3-4f4b-ac1a-53181f2ab7ae admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:12.330192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830d25b-2cd3-4f4b-ac1a-53181f2ab7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:12.330482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830d25b-2cd3-4f4b-ac1a-53181f2ab7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:12.332035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830d25b-2cd3-4f4b-ac1a-53181f2ab7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:12.333773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830d25b-2cd3-4f4b-ac1a-53181f2ab7ae admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:12.354987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1281/2544] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:42:12.356680 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f32aa-c196-43d3-bb9c-d4428737751c admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:12.368429 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f32aa-c196-43d3-bb9c-d4428737751c admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:12.374984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2bcdb-9d7e-44d9-b3ae-ee20dbadf41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:12.375916 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2bcdb-9d7e-44d9-b3ae-ee20dbadf41e admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:12.376301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2bcdb-9d7e-44d9-b3ae-ee20dbadf41e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:12.376666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2bcdb-9d7e-44d9-b3ae-ee20dbadf41e admin admin] PATH_INFO: `/v3/projects/3c37f15d2bd34a2a9263b8ec8a0f64f8/users/6ebe6d1963194e1b930586f7324311f8/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:12.393322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2bcdb-9d7e-44d9-b3ae-ee20dbadf41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c37f15d2bd34a2a9263b8ec8a0f64f8, user_id=6ebe6d1963194e1b930586f7324311f8, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:12.396075 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2bcdb-9d7e-44d9-b3ae-ee20dbadf41e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:12.514952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1264/2545] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:12 2022] PUT /identity/v3/projects/3c37f15d2bd34a2a9263b8ec8a0f64f8/users/6ebe6d1963194e1b930586f7324311f8/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:12.525837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39c576-c875-400e-8776-385800a13345 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:12.526039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39c576-c875-400e-8776-385800a13345 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:12.526295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39c576-c875-400e-8776-385800a13345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:12.555345 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8a39c576-c875-400e-8776-385800a13345 None None] MFA Rules not processed for user `6ebe6d1963194e1b930586f7324311f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:12.556564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8a39c576-c875-400e-8776-385800a13345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:12.565948 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:12.626191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1282/2546] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:12.631608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2bcdb-9d7e-44d9-b3ae-ee20dbadf41e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:12.694813 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2bcdb-9d7e-44d9-b3ae-ee20dbadf41e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:12.699985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61560dd0-7231-4963-b060-5beecdd7afdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:12.700590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61560dd0-7231-4963-b060-5beecdd7afdc admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:12.700871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61560dd0-7231-4963-b060-5beecdd7afdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:12.701146 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61560dd0-7231-4963-b060-5beecdd7afdc admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:12.701820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61560dd0-7231-4963-b060-5beecdd7afdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:12.703724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61560dd0-7231-4963-b060-5beecdd7afdc admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:12.824964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1265/2547] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:42:12 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:12.829016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39c576-c875-400e-8776-385800a13345 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:12.845905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39c576-c875-400e-8776-385800a13345 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:12.927616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab8b4e-52a7-4806-a889-39debabe36ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:12.928243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8b4e-52a7-4806-a889-39debabe36ec admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:12.928531 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8b4e-52a7-4806-a889-39debabe36ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:12.928807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8b4e-52a7-4806-a889-39debabe36ec admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:12.929529 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab8b4e-52a7-4806-a889-39debabe36ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:12.931669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab8b4e-52a7-4806-a889-39debabe36ec admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:13.021783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1283/2548] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:42:12 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:42:13.026132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61560dd0-7231-4963-b060-5beecdd7afdc admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:13.036753 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61560dd0-7231-4963-b060-5beecdd7afdc admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:13.041619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bd47d-20a1-4735-a85c-c755214f6d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:13.042175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bd47d-20a1-4735-a85c-c755214f6d52 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:13.042458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bd47d-20a1-4735-a85c-c755214f6d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:13.042732 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bd47d-20a1-4735-a85c-c755214f6d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:13.043375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bd47d-20a1-4735-a85c-c755214f6d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:13.044975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bd47d-20a1-4735-a85c-c755214f6d52 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:13.059582 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1266/2549] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:13.060508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab8b4e-52a7-4806-a889-39debabe36ec admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:13.071713 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab8b4e-52a7-4806-a889-39debabe36ec admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:13.076429 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f80ff0-7f8f-43ae-ac21-8f4cf4963e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:13.077073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80ff0-7f8f-43ae-ac21-8f4cf4963e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:13.077353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80ff0-7f8f-43ae-ac21-8f4cf4963e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:13.077666 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f80ff0-7f8f-43ae-ac21-8f4cf4963e76 admin admin] PATH_INFO: `/v3/projects/d225655d44b341738b38e183a8da6b7f/users/dc9b46bfde5740d9bb85cb3607f68edc/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:13.092745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f80ff0-7f8f-43ae-ac21-8f4cf4963e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d225655d44b341738b38e183a8da6b7f, user_id=dc9b46bfde5740d9bb85cb3607f68edc, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:13.095597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f80ff0-7f8f-43ae-ac21-8f4cf4963e76 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:13.247228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1284/2550] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:13 2022] PUT /identity/v3/projects/d225655d44b341738b38e183a8da6b7f/users/dc9b46bfde5740d9bb85cb3607f68edc/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:13.251311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bd47d-20a1-4735-a85c-c755214f6d52 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:13.262148 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bd47d-20a1-4735-a85c-c755214f6d52 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:13.332225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ba3ac-d544-40b1-8d6c-54d1f2308a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:13.332864 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ba3ac-d544-40b1-8d6c-54d1f2308a4f admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:13.333147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ba3ac-d544-40b1-8d6c-54d1f2308a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:13.333420 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ba3ac-d544-40b1-8d6c-54d1f2308a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:13.334102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ba3ac-d544-40b1-8d6c-54d1f2308a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:13.335727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ba3ac-d544-40b1-8d6c-54d1f2308a4f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:13.345742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1267/2551] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:13.356649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f80ff0-7f8f-43ae-ac21-8f4cf4963e76 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:13.369963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f80ff0-7f8f-43ae-ac21-8f4cf4963e76 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:13.375527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5556ba3-8ba5-4199-b0e7-02eb112813ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:13.376183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5556ba3-8ba5-4199-b0e7-02eb112813ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:13.376462 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5556ba3-8ba5-4199-b0e7-02eb112813ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:13.376775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5556ba3-8ba5-4199-b0e7-02eb112813ef admin admin] PATH_INFO: `/v3/projects/d225655d44b341738b38e183a8da6b7f/users/dc9b46bfde5740d9bb85cb3607f68edc/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:13.378927 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5556ba3-8ba5-4199-b0e7-02eb112813ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d225655d44b341738b38e183a8da6b7f, user_id=dc9b46bfde5740d9bb85cb3607f68edc, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:13.381660 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5556ba3-8ba5-4199-b0e7-02eb112813ef admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:13.392496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1285/2552] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:13 2022] PUT /identity/v3/projects/d225655d44b341738b38e183a8da6b7f/users/dc9b46bfde5740d9bb85cb3607f68edc/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:13.406139 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec96d6-d8a0-47ab-8c7c-a0b19f94bbe6 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:13.406470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec96d6-d8a0-47ab-8c7c-a0b19f94bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:13.406787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec96d6-d8a0-47ab-8c7c-a0b19f94bbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:13.435499 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-eeec96d6-d8a0-47ab-8c7c-a0b19f94bbe6 None None] MFA Rules not processed for user `dc9b46bfde5740d9bb85cb3607f68edc`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:13.436731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-eeec96d6-d8a0-47ab-8c7c-a0b19f94bbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:13.441971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:13.510347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1268/2553] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:13.523423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5556ba3-8ba5-4199-b0e7-02eb112813ef admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:13.525594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e5556ba3-8ba5-4199-b0e7-02eb112813ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:13.597828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5556ba3-8ba5-4199-b0e7-02eb112813ef admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:13.603595 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea6a2b-7c42-4d7a-b549-e1d078e04b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:13.604372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6a2b-7c42-4d7a-b549-e1d078e04b64 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:13.604796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6a2b-7c42-4d7a-b549-e1d078e04b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:13.605373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea6a2b-7c42-4d7a-b549-e1d078e04b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:13.624697 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:13.681837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea6a2b-7c42-4d7a-b549-e1d078e04b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:13.682704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea6a2b-7c42-4d7a-b549-e1d078e04b64 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:13.697767 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1286/2554] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:15.541311 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec96d6-d8a0-47ab-8c7c-a0b19f94bbe6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:15.551802 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec96d6-d8a0-47ab-8c7c-a0b19f94bbe6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:15.555436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faa0f8-9e2b-40e1-b82c-795b3adba671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:15.556038 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faa0f8-9e2b-40e1-b82c-795b3adba671 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:15.556318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faa0f8-9e2b-40e1-b82c-795b3adba671 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:15.556591 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faa0f8-9e2b-40e1-b82c-795b3adba671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:15.568827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faa0f8-9e2b-40e1-b82c-795b3adba671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:15.568827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faa0f8-9e2b-40e1-b82c-795b3adba671 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:15.578062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1269/2555] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:15.773833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea6a2b-7c42-4d7a-b549-e1d078e04b64 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:15.775439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2dea6a2b-7c42-4d7a-b549-e1d078e04b64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:15.894416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea6a2b-7c42-4d7a-b549-e1d078e04b64 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:15.919389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ee462-426d-483d-a2cb-43ea07989f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:15.920028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ee462-426d-483d-a2cb-43ea07989f3c service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:15.920311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ee462-426d-483d-a2cb-43ea07989f3c service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:15.920590 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ee462-426d-483d-a2cb-43ea07989f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:15.922905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-348ee462-426d-483d-a2cb-43ea07989f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:15.968392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ee462-426d-483d-a2cb-43ea07989f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:15.972261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ee462-426d-483d-a2cb-43ea07989f3c service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:15.990076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1287/2556] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:42:16.370582 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a2f58-ad79-4b6d-bc04-011c508a6541 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:16.371288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a2f58-ad79-4b6d-bc04-011c508a6541 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:16.371288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a2f58-ad79-4b6d-bc04-011c508a6541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:16.394468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-e87a2f58-ad79-4b6d-bc04-011c508a6541 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:16.395800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e87a2f58-ad79-4b6d-bc04-011c508a6541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:16.454339 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1270/2557] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:42:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:16.498934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ee462-426d-483d-a2cb-43ea07989f3c service nova] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:16.500589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-348ee462-426d-483d-a2cb-43ea07989f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:16.582670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ee462-426d-483d-a2cb-43ea07989f3c service nova] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:16.587753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491c0e0-0319-4543-a3a7-1e7a14fd13c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:16.588380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491c0e0-0319-4543-a3a7-1e7a14fd13c1 service swift] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:16.588658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491c0e0-0319-4543-a3a7-1e7a14fd13c1 service swift] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:16.588921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491c0e0-0319-4543-a3a7-1e7a14fd13c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:16.598769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491c0e0-0319-4543-a3a7-1e7a14fd13c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:16.600379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491c0e0-0319-4543-a3a7-1e7a14fd13c1 service swift] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:16.609084 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1288/2558] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:42:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:20.891740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a2f58-ad79-4b6d-bc04-011c508a6541 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:21.056523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a2f58-ad79-4b6d-bc04-011c508a6541 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:21.074772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:21.074772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:21.074772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:21.074772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] PATH_INFO: `/v3/users/6ebe6d1963194e1b930586f7324311f8` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:21.076275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebe6d1963194e1b930586f7324311f8)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:21.076275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:21.306440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:21.318801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebe6d1963194e1b930586f7324311f8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:21.407300 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebe6d1963194e1b930586f7324311f8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:21.435803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebe6d1963194e1b930586f7324311f8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:21.450008 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebe6d1963194e1b930586f7324311f8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:21.451129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebe6d1963194e1b930586f7324311f8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:21.460399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1271/2559] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:42:20 2022] DELETE /identity/v3/users/6ebe6d1963194e1b930586f7324311f8 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:21.466010 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8016-b971-466d-bcba-3c33232c529d None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:21.466694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8016-b971-466d-bcba-3c33232c529d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:21.466694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b8016-b971-466d-bcba-3c33232c529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:21.500165 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a54b8016-b971-466d-bcba-3c33232c529d None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:21.501704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a54b8016-b971-466d-bcba-3c33232c529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:21.543823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:21.596274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1289/2560] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:21.606707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:21.608235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:21.686622 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc668a65-717c-4de6-9b78-4666e33873d5 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:21.696733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0c3d9-9c30-4dac-876a-993018ea5252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:21.696733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0c3d9-9c30-4dac-876a-993018ea5252 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:21.696733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0c3d9-9c30-4dac-876a-993018ea5252 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:21.696733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0c3d9-9c30-4dac-876a-993018ea5252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:21.707093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0c3d9-9c30-4dac-876a-993018ea5252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:21.708646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0c3d9-9c30-4dac-876a-993018ea5252 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:21.723637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1272/2561] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:22.228362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b8016-b971-466d-bcba-3c33232c529d None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:22.229895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a54b8016-b971-466d-bcba-3c33232c529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:22.264672 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b8016-b971-466d-bcba-3c33232c529d None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:22.277863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:22.280204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:22.280564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:22.281782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] PATH_INFO: `/v3/projects/3c37f15d2bd34a2a9263b8ec8a0f64f8` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:22.284096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c37f15d2bd34a2a9263b8ec8a0f64f8)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:22.288019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:22.492753 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c37f15d2bd34a2a9263b8ec8a0f64f8', 'request_id': 'req-2660281d-03ea-476c-ae11-e5da53002a15'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:22.602807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c37f15d2bd34a2a9263b8ec8a0f64f8', 'request_id': 'req-2660281d-03ea-476c-ae11-e5da53002a15'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:22.609489 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c37f15d2bd34a2a9263b8ec8a0f64f8', 'request_id': 'req-2660281d-03ea-476c-ae11-e5da53002a15'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:22.622610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] The token cache is being invalidate because project 3c37f15d2bd34a2a9263b8ec8a0f64f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:42:22.623033 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:22.624346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:22.626922 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1290/2562] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:42:22 2022] DELETE /identity/v3/projects/3c37f15d2bd34a2a9263b8ec8a0f64f8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:22.630892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0c3d9-9c30-4dac-876a-993018ea5252 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:22.642403 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0c3d9-9c30-4dac-876a-993018ea5252 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:22.734500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6c38e-6754-49e0-8aba-bb29425bb881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:22.735049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6c38e-6754-49e0-8aba-bb29425bb881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:22.735350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6c38e-6754-49e0-8aba-bb29425bb881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:22.735644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6c38e-6754-49e0-8aba-bb29425bb881 admin admin] PATH_INFO: `/v3/users/dc9b46bfde5740d9bb85cb3607f68edc` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:22.736757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6c38e-6754-49e0-8aba-bb29425bb881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc9b46bfde5740d9bb85cb3607f68edc)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:22.739272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6c38e-6754-49e0-8aba-bb29425bb881 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:22.962866 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-35d6c38e-6754-49e0-8aba-bb29425bb881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc9b46bfde5740d9bb85cb3607f68edc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:23.266391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-35d6c38e-6754-49e0-8aba-bb29425bb881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc9b46bfde5740d9bb85cb3607f68edc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:23.271911 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:23.280182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-35d6c38e-6754-49e0-8aba-bb29425bb881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc9b46bfde5740d9bb85cb3607f68edc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:23.287725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-35d6c38e-6754-49e0-8aba-bb29425bb881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc9b46bfde5740d9bb85cb3607f68edc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:23.288453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-35d6c38e-6754-49e0-8aba-bb29425bb881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc9b46bfde5740d9bb85cb3607f68edc'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:23.294661 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1273/2563] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:42:22 2022] DELETE /identity/v3/users/dc9b46bfde5740d9bb85cb3607f68edc => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:23.953118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:23.955775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:23.978952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660281d-03ea-476c-ae11-e5da53002a15 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:24.069106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:24.070665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:24.071071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:24.071391 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] PATH_INFO: `/v3/projects/d225655d44b341738b38e183a8da6b7f` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:24.072671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d225655d44b341738b38e183a8da6b7f)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:24.074878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:24.200066 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd225655d44b341738b38e183a8da6b7f', 'request_id': 'req-1ab52e80-219f-44a4-9493-6043c58d0414'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:24.275083 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd225655d44b341738b38e183a8da6b7f', 'request_id': 'req-1ab52e80-219f-44a4-9493-6043c58d0414'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:24.279207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:24.283472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd225655d44b341738b38e183a8da6b7f', 'request_id': 'req-1ab52e80-219f-44a4-9493-6043c58d0414'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:24.296976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] The token cache is being invalidate because project d225655d44b341738b38e183a8da6b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:42:24.297273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:24.299818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1ab52e80-219f-44a4-9493-6043c58d0414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:24.299818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1291/2564] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:42:23 2022] DELETE /identity/v3/projects/d225655d44b341738b38e183a8da6b7f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:24.305088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97030f-0af5-4610-bb43-cc140420f193 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:24.305671 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97030f-0af5-4610-bb43-cc140420f193 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:24.305671 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97030f-0af5-4610-bb43-cc140420f193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:24.332438 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-9b97030f-0af5-4610-bb43-cc140420f193 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:24.334196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-9b97030f-0af5-4610-bb43-cc140420f193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:24.407898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1274/2565] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:24.416699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34865-56fc-493f-8c22-a3d790368bb6 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:24.417219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34865-56fc-493f-8c22-a3d790368bb6 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:24.417808 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb34865-56fc-493f-8c22-a3d790368bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:24.440545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-bcb34865-56fc-493f-8c22-a3d790368bb6 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:24.442593 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bcb34865-56fc-493f-8c22-a3d790368bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:24.452037 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1292/2566] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:24.458411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97030f-0af5-4610-bb43-cc140420f193 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:24.468543 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97030f-0af5-4610-bb43-cc140420f193 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:24.473985 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d9bc7-8532-4884-9e38-94fd5c8bbfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:24.474598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d9bc7-8532-4884-9e38-94fd5c8bbfac admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:24.474880 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d9bc7-8532-4884-9e38-94fd5c8bbfac admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:24.475163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d9bc7-8532-4884-9e38-94fd5c8bbfac admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:24.475814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d9bc7-8532-4884-9e38-94fd5c8bbfac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:42:24.476120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d9bc7-8532-4884-9e38-94fd5c8bbfac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:24.477740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d9bc7-8532-4884-9e38-94fd5c8bbfac admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:24.493266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1275/2567] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:42:24.497504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb34865-56fc-493f-8c22-a3d790368bb6 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:24.510432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb34865-56fc-493f-8c22-a3d790368bb6 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:24.515751 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d933e97-2db7-4cc2-8a12-8a261af0bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:24.516519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d933e97-2db7-4cc2-8a12-8a261af0bc33 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:24.516796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d933e97-2db7-4cc2-8a12-8a261af0bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:24.517075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d933e97-2db7-4cc2-8a12-8a261af0bc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:24.517764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d933e97-2db7-4cc2-8a12-8a261af0bc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:24.520582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d933e97-2db7-4cc2-8a12-8a261af0bc33 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:24.624324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1293/2568] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:42:24 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:24.629516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d9bc7-8532-4884-9e38-94fd5c8bbfac admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:24.645443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d9bc7-8532-4884-9e38-94fd5c8bbfac admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:24.720853 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffce1c6-444e-4a4d-a118-ed67595504c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:24.721373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffce1c6-444e-4a4d-a118-ed67595504c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:24.722046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffce1c6-444e-4a4d-a118-ed67595504c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:24.722503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffce1c6-444e-4a4d-a118-ed67595504c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:24.723169 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffce1c6-444e-4a4d-a118-ed67595504c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:24.725112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffce1c6-444e-4a4d-a118-ed67595504c2 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:24.823237 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1276/2569] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:42:24 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:42:24.825858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d933e97-2db7-4cc2-8a12-8a261af0bc33 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:24.857187 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d933e97-2db7-4cc2-8a12-8a261af0bc33 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:24.874779 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ac859-f8c4-4415-bbfb-b9fdea375b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:24.876536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ac859-f8c4-4415-bbfb-b9fdea375b70 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:24.876536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ac859-f8c4-4415-bbfb-b9fdea375b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:24.876536 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ac859-f8c4-4415-bbfb-b9fdea375b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:24.877725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ac859-f8c4-4415-bbfb-b9fdea375b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:24.881661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ac859-f8c4-4415-bbfb-b9fdea375b70 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:24.904573 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1294/2570] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:24.908574 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffce1c6-444e-4a4d-a118-ed67595504c2 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:24.921608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffce1c6-444e-4a4d-a118-ed67595504c2 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:24.949776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090984db-9a0a-48c0-8691-6b9d6848deac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:24.955060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090984db-9a0a-48c0-8691-6b9d6848deac admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:24.956846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090984db-9a0a-48c0-8691-6b9d6848deac admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:24.958827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090984db-9a0a-48c0-8691-6b9d6848deac admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:24.959785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090984db-9a0a-48c0-8691-6b9d6848deac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:24.963907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090984db-9a0a-48c0-8691-6b9d6848deac admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:24.993183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1277/2571] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:24.994649 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ac859-f8c4-4415-bbfb-b9fdea375b70 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:25.014365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ac859-f8c4-4415-bbfb-b9fdea375b70 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:25.021373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0875a-ac68-4a9d-ac87-5acd7129fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:25.022120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0875a-ac68-4a9d-ac87-5acd7129fd3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:25.022402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0875a-ac68-4a9d-ac87-5acd7129fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:25.022676 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0875a-ac68-4a9d-ac87-5acd7129fd3c admin admin] PATH_INFO: `/v3/projects/b4f11bd089cc4692bf7f074d33d73b07/users/d6db7ede42204dafb81a87c4e813c914/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:25.044965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0875a-ac68-4a9d-ac87-5acd7129fd3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f11bd089cc4692bf7f074d33d73b07, user_id=d6db7ede42204dafb81a87c4e813c914, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:25.048230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0875a-ac68-4a9d-ac87-5acd7129fd3c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:25.136553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1295/2572] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:24 2022] PUT /identity/v3/projects/b4f11bd089cc4692bf7f074d33d73b07/users/d6db7ede42204dafb81a87c4e813c914/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:42:25.148955 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33764385-7e2b-4b0a-9082-5ff4dec678b8 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:25.149239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33764385-7e2b-4b0a-9082-5ff4dec678b8 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:25.149511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33764385-7e2b-4b0a-9082-5ff4dec678b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:25.180855 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-33764385-7e2b-4b0a-9082-5ff4dec678b8 None None] MFA Rules not processed for user `d6db7ede42204dafb81a87c4e813c914`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:25.182211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-33764385-7e2b-4b0a-9082-5ff4dec678b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:25.240503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:25.286463 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1278/2573] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:25.298828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0875a-ac68-4a9d-ac87-5acd7129fd3c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:25.300890 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-20a0875a-ac68-4a9d-ac87-5acd7129fd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:25.367127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0875a-ac68-4a9d-ac87-5acd7129fd3c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:25.371855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea290c3-f685-4c18-ae41-638238eb327a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8590378b14c49cf9266a0d859db5bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:25.372583 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea290c3-f685-4c18-ae41-638238eb327a service glance] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:25.372863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea290c3-f685-4c18-ae41-638238eb327a service glance] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:25.373135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea290c3-f685-4c18-ae41-638238eb327a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:25.383744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea290c3-f685-4c18-ae41-638238eb327a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:25.385623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea290c3-f685-4c18-ae41-638238eb327a service glance] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:25.401669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1296/2574] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:25.536026 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33764385-7e2b-4b0a-9082-5ff4dec678b8 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:25.542232 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-33764385-7e2b-4b0a-9082-5ff4dec678b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:25.607529 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33764385-7e2b-4b0a-9082-5ff4dec678b8 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:25.611979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1a22c-2ca4-4111-b49b-39a2aa0f7d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:25.613350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1a22c-2ca4-4111-b49b-39a2aa0f7d57 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:25.613862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1a22c-2ca4-4111-b49b-39a2aa0f7d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:25.614208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1a22c-2ca4-4111-b49b-39a2aa0f7d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:25.616384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d8e1a22c-2ca4-4111-b49b-39a2aa0f7d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:25.629303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1a22c-2ca4-4111-b49b-39a2aa0f7d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:25.630872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1a22c-2ca4-4111-b49b-39a2aa0f7d57 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:25.641084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1279/2575] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:28.109786 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea290c3-f685-4c18-ae41-638238eb327a service glance] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:28.111514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6ea290c3-f685-4c18-ae41-638238eb327a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:28.258267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea290c3-f685-4c18-ae41-638238eb327a service glance] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:28.266699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e00c87-c693-4196-b046-51a23083efc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:28.267336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e00c87-c693-4196-b046-51a23083efc7 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:28.267619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e00c87-c693-4196-b046-51a23083efc7 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:28.267987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e00c87-c693-4196-b046-51a23083efc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:28.270965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e4e00c87-c693-4196-b046-51a23083efc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:28.289894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e00c87-c693-4196-b046-51a23083efc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:28.291886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e00c87-c693-4196-b046-51a23083efc7 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:28.323481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1297/2576] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:35.024217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1a22c-2ca4-4111-b49b-39a2aa0f7d57 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:35.026462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d8e1a22c-2ca4-4111-b49b-39a2aa0f7d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:35.037694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1a22c-2ca4-4111-b49b-39a2aa0f7d57 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:35.041337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d384d7-ce55-4a16-be86-bf52706ad819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:35.041980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d384d7-ce55-4a16-be86-bf52706ad819 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:35.042262 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d384d7-ce55-4a16-be86-bf52706ad819 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:35.042539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d384d7-ce55-4a16-be86-bf52706ad819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:35.044272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-12d384d7-ce55-4a16-be86-bf52706ad819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:35.119787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d384d7-ce55-4a16-be86-bf52706ad819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:35.121293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d384d7-ce55-4a16-be86-bf52706ad819 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:35.136523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1280/2577] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:36.652357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e00c87-c693-4196-b046-51a23083efc7 service nova] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:36.653884 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e4e00c87-c693-4196-b046-51a23083efc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:36.666859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:36.739783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e00c87-c693-4196-b046-51a23083efc7 service nova] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:36.745559 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4f49-c5c7-4a68-a68b-7476395617d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:36.746220 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4f49-c5c7-4a68-a68b-7476395617d3 service placement] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:36.746652 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4f49-c5c7-4a68-a68b-7476395617d3 service placement] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:36.746938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4f49-c5c7-4a68-a68b-7476395617d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:36.748780 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a16a4f49-c5c7-4a68-a68b-7476395617d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:36.763118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a4f49-c5c7-4a68-a68b-7476395617d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:36.764940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a4f49-c5c7-4a68-a68b-7476395617d3 service placement] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:36.777546 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1298/2578] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:37.371714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d384d7-ce55-4a16-be86-bf52706ad819 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:37.399663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d384d7-ce55-4a16-be86-bf52706ad819 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:37.412495 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954124d5-239c-4a70-aaef-730f9a7d6c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:37.413126 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954124d5-239c-4a70-aaef-730f9a7d6c2e service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:37.413482 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954124d5-239c-4a70-aaef-730f9a7d6c2e service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:37.414032 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954124d5-239c-4a70-aaef-730f9a7d6c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:37.419856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-954124d5-239c-4a70-aaef-730f9a7d6c2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:37.442119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954124d5-239c-4a70-aaef-730f9a7d6c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:37.444198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954124d5-239c-4a70-aaef-730f9a7d6c2e service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:37.465134 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1281/2579] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:40.468058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4f49-c5c7-4a68-a68b-7476395617d3 service placement] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:40.487079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4f49-c5c7-4a68-a68b-7476395617d3 service placement] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:40.496856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b022d-4862-435b-a5d1-9dde9ec417c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:40.498635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b022d-4862-435b-a5d1-9dde9ec417c3 service placement] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:40.499332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b022d-4862-435b-a5d1-9dde9ec417c3 service placement] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:40.499843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b022d-4862-435b-a5d1-9dde9ec417c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:40.503048 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6a4b022d-4862-435b-a5d1-9dde9ec417c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:40.524132 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b022d-4862-435b-a5d1-9dde9ec417c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:40.526268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b022d-4862-435b-a5d1-9dde9ec417c3 service placement] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:40.546285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1299/2580] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:40.692316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954124d5-239c-4a70-aaef-730f9a7d6c2e service nova] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:40.695046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-954124d5-239c-4a70-aaef-730f9a7d6c2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:40.710487 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954124d5-239c-4a70-aaef-730f9a7d6c2e service nova] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:40.715094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8b413-45ac-4163-a502-1c9a10262ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:40.715720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8b413-45ac-4163-a502-1c9a10262ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:40.716000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8b413-45ac-4163-a502-1c9a10262ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:40.716292 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8b413-45ac-4163-a502-1c9a10262ef9 admin admin] PATH_INFO: `/v3/users/7b2f116fd01d46ddab8096d0f3214307` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:40.717469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8b413-45ac-4163-a502-1c9a10262ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b2f116fd01d46ddab8096d0f3214307)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:40.719454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8b413-45ac-4163-a502-1c9a10262ef9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:40.840547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3664ba-f62b-4f40-9917-8f31b91555f3 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:40.840886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3664ba-f62b-4f40-9917-8f31b91555f3 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:40.841372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3664ba-f62b-4f40-9917-8f31b91555f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:40.876175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-db3664ba-f62b-4f40-9917-8f31b91555f3 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:40.876175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-db3664ba-f62b-4f40-9917-8f31b91555f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:40.969305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1300/2581] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:42:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:42:40.984161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3664ba-f62b-4f40-9917-8f31b91555f3 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:40.985693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-db3664ba-f62b-4f40-9917-8f31b91555f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:41.068674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a2e8b413-45ac-4163-a502-1c9a10262ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b2f116fd01d46ddab8096d0f3214307'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:41.082457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3664ba-f62b-4f40-9917-8f31b91555f3 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:41.085868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:41.089888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc2ebb-8fc5-419b-a62e-64f286d137a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:41.090664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc2ebb-8fc5-419b-a62e-64f286d137a3 service swift] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:41.090868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc2ebb-8fc5-419b-a62e-64f286d137a3 service swift] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:41.091080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc2ebb-8fc5-419b-a62e-64f286d137a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:41.105690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc2ebb-8fc5-419b-a62e-64f286d137a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:41.106389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc2ebb-8fc5-419b-a62e-64f286d137a3 service swift] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:41.136891 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1301/2582] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:42:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:41.234085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a2e8b413-45ac-4163-a502-1c9a10262ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b2f116fd01d46ddab8096d0f3214307'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:41.256803 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a2e8b413-45ac-4163-a502-1c9a10262ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b2f116fd01d46ddab8096d0f3214307'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:41.267761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a2e8b413-45ac-4163-a502-1c9a10262ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b2f116fd01d46ddab8096d0f3214307'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:41.268539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-a2e8b413-45ac-4163-a502-1c9a10262ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b2f116fd01d46ddab8096d0f3214307'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:41.276824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1282/2583] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:42:40 2022] DELETE /identity/v3/users/7b2f116fd01d46ddab8096d0f3214307 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:41.625140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc2ebb-8fc5-419b-a62e-64f286d137a3 service swift] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:41.653522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc2ebb-8fc5-419b-a62e-64f286d137a3 service swift] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:41.678895 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=100 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:41.755175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:41.756117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:41.756596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:41.757080 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] PATH_INFO: `/v3/projects/6f773bd4965e49d380c77db1742c7d94` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:41.759530 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f773bd4965e49d380c77db1742c7d94)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:41.762443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:41.962276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f773bd4965e49d380c77db1742c7d94', 'request_id': 'req-c4b1351e-69d1-4e95-8b05-393c8b831465'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:42.044934 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f773bd4965e49d380c77db1742c7d94', 'request_id': 'req-c4b1351e-69d1-4e95-8b05-393c8b831465'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:42.063430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f773bd4965e49d380c77db1742c7d94', 'request_id': 'req-c4b1351e-69d1-4e95-8b05-393c8b831465'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:42.105982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] The token cache is being invalidate because project 6f773bd4965e49d380c77db1742c7d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:42:42.106346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:42.107183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c4b1351e-69d1-4e95-8b05-393c8b831465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:42.109288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1302/2584] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:42:41 2022] DELETE /identity/v3/projects/6f773bd4965e49d380c77db1742c7d94 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:42.114847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82e743-d93f-4102-93ae-70b3e966f77f None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:42.115830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82e743-d93f-4102-93ae-70b3e966f77f None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:42.116380 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82e743-d93f-4102-93ae-70b3e966f77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:42.141696 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-fa82e743-d93f-4102-93ae-70b3e966f77f None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:42.143408 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-fa82e743-d93f-4102-93ae-70b3e966f77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:42.251841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1283/2585] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:42.260101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f324-70fa-4b8f-a794-1cbd2c1f6c72 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:42.260417 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f324-70fa-4b8f-a794-1cbd2c1f6c72 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:42.260678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f324-70fa-4b8f-a794-1cbd2c1f6c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:42.286938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f605f324-70fa-4b8f-a794-1cbd2c1f6c72 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:42.288422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f605f324-70fa-4b8f-a794-1cbd2c1f6c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:42.301683 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1303/2586] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:42.304547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82e743-d93f-4102-93ae-70b3e966f77f None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:42.319230 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82e743-d93f-4102-93ae-70b3e966f77f None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:42.327791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787b554-0e46-4d28-9d46-0d58d887b6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:42.328577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787b554-0e46-4d28-9d46-0d58d887b6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:42.329702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787b554-0e46-4d28-9d46-0d58d887b6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:42.330279 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787b554-0e46-4d28-9d46-0d58d887b6e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:42.331325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787b554-0e46-4d28-9d46-0d58d887b6e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:42:42.332368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787b554-0e46-4d28-9d46-0d58d887b6e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:42.334441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787b554-0e46-4d28-9d46-0d58d887b6e0 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:42.350652 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1284/2587] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:42:42.355662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605f324-70fa-4b8f-a794-1cbd2c1f6c72 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:42.367851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605f324-70fa-4b8f-a794-1cbd2c1f6c72 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:42.373297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ff8d4-9a82-48a4-81da-4295c988a04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:42.374082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ff8d4-9a82-48a4-81da-4295c988a04b admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:42.374754 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ff8d4-9a82-48a4-81da-4295c988a04b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:42.374754 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ff8d4-9a82-48a4-81da-4295c988a04b admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:42.375280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ff8d4-9a82-48a4-81da-4295c988a04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:42.377369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ff8d4-9a82-48a4-81da-4295c988a04b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:42.529646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787b554-0e46-4d28-9d46-0d58d887b6e0 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:42.538635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1304/2588] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:42:42 2022] POST /identity/v3/projects => generated 405 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:42.548852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787b554-0e46-4d28-9d46-0d58d887b6e0 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:42.660173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0efb1-33c4-4a8c-8203-90fa31640d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:42.661380 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0efb1-33c4-4a8c-8203-90fa31640d93 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:42.662028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0efb1-33c4-4a8c-8203-90fa31640d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:42.662594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0efb1-33c4-4a8c-8203-90fa31640d93 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:42.664146 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0efb1-33c4-4a8c-8203-90fa31640d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:42.667360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0efb1-33c4-4a8c-8203-90fa31640d93 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:43.105417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1285/2589] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:42:42 2022] POST /identity/v3/users => generated 303 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:43.107206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ff8d4-9a82-48a4-81da-4295c988a04b admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:43.122766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ff8d4-9a82-48a4-81da-4295c988a04b admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:43.130101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78871a3e-7f16-4649-b2b3-2918f4d62326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:43.131772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871a3e-7f16-4649-b2b3-2918f4d62326 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:43.132465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871a3e-7f16-4649-b2b3-2918f4d62326 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:43.133169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78871a3e-7f16-4649-b2b3-2918f4d62326 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:43.133924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78871a3e-7f16-4649-b2b3-2918f4d62326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:43.135700 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78871a3e-7f16-4649-b2b3-2918f4d62326 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:43.150609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1305/2590] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:43.153375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0efb1-33c4-4a8c-8203-90fa31640d93 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:43.167556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0efb1-33c4-4a8c-8203-90fa31640d93 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:43.174750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3793aba-7429-44e5-8b70-3e2d551bf086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:43.176391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3793aba-7429-44e5-8b70-3e2d551bf086 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:43.176967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3793aba-7429-44e5-8b70-3e2d551bf086 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:43.177503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3793aba-7429-44e5-8b70-3e2d551bf086 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:43.178722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3793aba-7429-44e5-8b70-3e2d551bf086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:43.181629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3793aba-7429-44e5-8b70-3e2d551bf086 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:43.201310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1286/2591] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:43.206721 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78871a3e-7f16-4649-b2b3-2918f4d62326 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:43.223503 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78871a3e-7f16-4649-b2b3-2918f4d62326 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:43.231517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c934aa4-0d2b-4949-8bfb-abf907be7d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:43.232288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934aa4-0d2b-4949-8bfb-abf907be7d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:43.232575 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934aa4-0d2b-4949-8bfb-abf907be7d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:43.233129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934aa4-0d2b-4949-8bfb-abf907be7d42 admin admin] PATH_INFO: `/v3/projects/d0a58e6af0cc495989533b4022516fc0/users/b0b851a5dd9746f6b1a41ce0d00dad9e/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:43.258476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c934aa4-0d2b-4949-8bfb-abf907be7d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a58e6af0cc495989533b4022516fc0, user_id=b0b851a5dd9746f6b1a41ce0d00dad9e, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:43.258476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c934aa4-0d2b-4949-8bfb-abf907be7d42 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:43.395657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1306/2592] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:43 2022] PUT /identity/v3/projects/d0a58e6af0cc495989533b4022516fc0/users/b0b851a5dd9746f6b1a41ce0d00dad9e/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:43.400750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eca81-a9f4-4780-ab66-bca42d3cae7b None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:43.401069 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eca81-a9f4-4780-ab66-bca42d3cae7b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:43.401352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eca81-a9f4-4780-ab66-bca42d3cae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:43.423004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-d63eca81-a9f4-4780-ab66-bca42d3cae7b None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:43.424253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d63eca81-a9f4-4780-ab66-bca42d3cae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:43.480147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:43.513686 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1287/2593] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:43.525126 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c934aa4-0d2b-4949-8bfb-abf907be7d42 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:43.526940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8c934aa4-0d2b-4949-8bfb-abf907be7d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:43.563314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63eca81-a9f4-4780-ab66-bca42d3cae7b None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:43.565045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d63eca81-a9f4-4780-ab66-bca42d3cae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:43.587006 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63eca81-a9f4-4780-ab66-bca42d3cae7b None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:43.598301 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:43.601897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:43.601897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:43.601897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] PATH_INFO: `/v3/users/d6db7ede42204dafb81a87c4e813c914` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:43.602993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6db7ede42204dafb81a87c4e813c914)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:43.605795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:43.617101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:43.623439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c934aa4-0d2b-4949-8bfb-abf907be7d42 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:43.630373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaa3bc-5a1c-402c-aed0-5954526b0857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:43.636386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa3bc-5a1c-402c-aed0-5954526b0857 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:43.636386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa3bc-5a1c-402c-aed0-5954526b0857 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:43.636386 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa3bc-5a1c-402c-aed0-5954526b0857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:43.646074 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa3bc-5a1c-402c-aed0-5954526b0857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:43.647630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa3bc-5a1c-402c-aed0-5954526b0857 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:43.666068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1307/2594] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:43.903742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6db7ede42204dafb81a87c4e813c914'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:44.079459 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6db7ede42204dafb81a87c4e813c914'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:44.104971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6db7ede42204dafb81a87c4e813c914'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:44.134051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6db7ede42204dafb81a87c4e813c914'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:44.135901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6db7ede42204dafb81a87c4e813c914'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:44.159050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1288/2595] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:42:43 2022] DELETE /identity/v3/users/d6db7ede42204dafb81a87c4e813c914 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:42:44.164118 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af299054-8494-41f1-b9b3-d433958e6416 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:44.164675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af299054-8494-41f1-b9b3-d433958e6416 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:44.164675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af299054-8494-41f1-b9b3-d433958e6416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:44.189366 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-af299054-8494-41f1-b9b3-d433958e6416 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:44.191650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-af299054-8494-41f1-b9b3-d433958e6416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:44.322233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1308/2596] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:44.333133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:44.339990 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:44.422990 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37010311-9406-464f-b4b1-c1c591ecac07 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:44.429904 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36923c-0fd4-43a7-a3a4-2c1aab729a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:44.430607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36923c-0fd4-43a7-a3a4-2c1aab729a1e service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:44.431016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36923c-0fd4-43a7-a3a4-2c1aab729a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:44.431297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36923c-0fd4-43a7-a3a4-2c1aab729a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:44.445793 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36923c-0fd4-43a7-a3a4-2c1aab729a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:44.447948 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36923c-0fd4-43a7-a3a4-2c1aab729a1e service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:44.460542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1289/2597] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:45.344172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af299054-8494-41f1-b9b3-d433958e6416 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:45.346422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-af299054-8494-41f1-b9b3-d433958e6416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:45.359616 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af299054-8494-41f1-b9b3-d433958e6416 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:45.365369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:45.366104 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:45.366425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:45.366718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] PATH_INFO: `/v3/projects/b4f11bd089cc4692bf7f074d33d73b07` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:45.367999 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f11bd089cc4692bf7f074d33d73b07)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:45.370050 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:45.602207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f11bd089cc4692bf7f074d33d73b07', 'request_id': 'req-1d03c892-d918-485c-a180-9929c21e5342'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:46.449125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f11bd089cc4692bf7f074d33d73b07', 'request_id': 'req-1d03c892-d918-485c-a180-9929c21e5342'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:46.457693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f11bd089cc4692bf7f074d33d73b07', 'request_id': 'req-1d03c892-d918-485c-a180-9929c21e5342'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:46.482154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] The token cache is being invalidate because project b4f11bd089cc4692bf7f074d33d73b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:42:46.484179 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:46.484179 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1d03c892-d918-485c-a180-9929c21e5342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:46.492769 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1309/2598] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:42:45 2022] DELETE /identity/v3/projects/b4f11bd089cc4692bf7f074d33d73b07 => generated 0 bytes in 1150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:46.498051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66e181-bfd3-48d8-9da2-bf5a91b96ba3 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:46.498573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66e181-bfd3-48d8-9da2-bf5a91b96ba3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:46.498573 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66e181-bfd3-48d8-9da2-bf5a91b96ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:46.542494 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-ad66e181-bfd3-48d8-9da2-bf5a91b96ba3 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:46.543982 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ad66e181-bfd3-48d8-9da2-bf5a91b96ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:46.617907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae84e6-be00-4535-a751-c703ceb15c7b None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:46.618191 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae84e6-be00-4535-a751-c703ceb15c7b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:46.618478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae84e6-be00-4535-a751-c703ceb15c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:46.652878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:46.672886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-bdae84e6-be00-4535-a751-c703ceb15c7b None None] MFA Rules not processed for user `b0b851a5dd9746f6b1a41ce0d00dad9e`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:46.682403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-bdae84e6-be00-4535-a751-c703ceb15c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:46.682578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1290/2599] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:46.687278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31fb59-59f3-4cf9-9e19-195c4b7ded39 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:46.687861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31fb59-59f3-4cf9-9e19-195c4b7ded39 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:46.688377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31fb59-59f3-4cf9-9e19-195c4b7ded39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:46.718565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-ba31fb59-59f3-4cf9-9e19-195c4b7ded39 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:46.772001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ba31fb59-59f3-4cf9-9e19-195c4b7ded39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:46.772001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1291/2600] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:46.781097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31fb59-59f3-4cf9-9e19-195c4b7ded39 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:46.796752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31fb59-59f3-4cf9-9e19-195c4b7ded39 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:46.804835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e4078-4d00-4754-8b4f-474af8ba0d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:46.806377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e4078-4d00-4754-8b4f-474af8ba0d7a admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:46.806854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e4078-4d00-4754-8b4f-474af8ba0d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:46.807451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e4078-4d00-4754-8b4f-474af8ba0d7a admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:46.808458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e4078-4d00-4754-8b4f-474af8ba0d7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:42:46.809027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e4078-4d00-4754-8b4f-474af8ba0d7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:46.811966 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e4078-4d00-4754-8b4f-474af8ba0d7a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:46.833782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1310/2602] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:46 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:46.834072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1292/2602] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:42:46.834867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae84e6-be00-4535-a751-c703ceb15c7b None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:46.838046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e4078-4d00-4754-8b4f-474af8ba0d7a admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:46.839971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-413e4078-4d00-4754-8b4f-474af8ba0d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:46.842542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:46.851179 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae84e6-be00-4535-a751-c703ceb15c7b None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:46.857453 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b374e-32dd-40cd-ba52-e2a0efcf7164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:46.858208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b374e-32dd-40cd-ba52-e2a0efcf7164 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:46.858727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b374e-32dd-40cd-ba52-e2a0efcf7164 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:46.859406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b374e-32dd-40cd-ba52-e2a0efcf7164 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:46.860357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b374e-32dd-40cd-ba52-e2a0efcf7164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:46.862954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b374e-32dd-40cd-ba52-e2a0efcf7164 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:46.867418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e4078-4d00-4754-8b4f-474af8ba0d7a admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:46.872760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948d581-280b-4bb2-9fca-38a1f682b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:46.873367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948d581-280b-4bb2-9fca-38a1f682b5ca admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:46.873674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948d581-280b-4bb2-9fca-38a1f682b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:46.873967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948d581-280b-4bb2-9fca-38a1f682b5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:46.874702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948d581-280b-4bb2-9fca-38a1f682b5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:46.876563 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948d581-280b-4bb2-9fca-38a1f682b5ca admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:47.140947 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1311/2603] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:42:46 2022] POST /identity/v3/projects => generated 373 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:47.142781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b374e-32dd-40cd-ba52-e2a0efcf7164 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:47.193978 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1293/2604] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:42:46 2022] POST /identity/v3/projects => generated 405 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:42:47.195859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948d581-280b-4bb2-9fca-38a1f682b5ca admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:47.217472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b374e-32dd-40cd-ba52-e2a0efcf7164 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:47.301560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc1e26-5baf-46e1-9038-bf9a5e854ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:47.306257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc1e26-5baf-46e1-9038-bf9a5e854ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:47.306257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc1e26-5baf-46e1-9038-bf9a5e854ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:47.306257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc1e26-5baf-46e1-9038-bf9a5e854ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:47.306257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc1e26-5baf-46e1-9038-bf9a5e854ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:47.306912 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc1e26-5baf-46e1-9038-bf9a5e854ee3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:47.307960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948d581-280b-4bb2-9fca-38a1f682b5ca admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:47.313111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617a3b1-204c-494f-ba1c-6589acb3f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:47.313920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a3b1-204c-494f-ba1c-6589acb3f997 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:47.314297 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a3b1-204c-494f-ba1c-6589acb3f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:47.314652 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a3b1-204c-494f-ba1c-6589acb3f997 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:47.315290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617a3b1-204c-494f-ba1c-6589acb3f997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:47.317428 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617a3b1-204c-494f-ba1c-6589acb3f997 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:47.544360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1312/2605] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:42:47 2022] POST /identity/v3/users => generated 287 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:47.548737 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc1e26-5baf-46e1-9038-bf9a5e854ee3 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:47.575178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc1e26-5baf-46e1-9038-bf9a5e854ee3 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:47.575178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d9b3f-1e9e-421f-8455-433690f89323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:47.575178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d9b3f-1e9e-421f-8455-433690f89323 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:47.575178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d9b3f-1e9e-421f-8455-433690f89323 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:47.575800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d9b3f-1e9e-421f-8455-433690f89323 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:47.575800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d9b3f-1e9e-421f-8455-433690f89323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:47.575800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d9b3f-1e9e-421f-8455-433690f89323 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:47.591843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1313/2606] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:42:47.592970 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d9b3f-1e9e-421f-8455-433690f89323 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:47.618104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1294/2607] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:42:47 2022] POST /identity/v3/users => generated 309 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:47.632818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d9b3f-1e9e-421f-8455-433690f89323 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:47.632818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da09a70-8bfa-4c24-ade6-26a015b81fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:47.632818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da09a70-8bfa-4c24-ade6-26a015b81fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:47.632818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da09a70-8bfa-4c24-ade6-26a015b81fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:47.633400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da09a70-8bfa-4c24-ade6-26a015b81fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:47.633400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da09a70-8bfa-4c24-ade6-26a015b81fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:47.633400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da09a70-8bfa-4c24-ade6-26a015b81fb3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:47.635989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617a3b1-204c-494f-ba1c-6589acb3f997 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:47.652480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1314/2608] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:47.656976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da09a70-8bfa-4c24-ade6-26a015b81fb3 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:47.659321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617a3b1-204c-494f-ba1c-6589acb3f997 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:47.667585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860ac33-d511-41f8-ae85-0389680d0e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:47.668049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860ac33-d511-41f8-ae85-0389680d0e0f admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:47.668461 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860ac33-d511-41f8-ae85-0389680d0e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:47.668863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860ac33-d511-41f8-ae85-0389680d0e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:47.670205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860ac33-d511-41f8-ae85-0389680d0e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:47.673129 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860ac33-d511-41f8-ae85-0389680d0e0f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:47.695451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1295/2609] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:47.698773 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da09a70-8bfa-4c24-ade6-26a015b81fb3 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:47.701508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860ac33-d511-41f8-ae85-0389680d0e0f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:47.705454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbd42f-114a-419d-8246-594007497743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:47.707579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd42f-114a-419d-8246-594007497743 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:47.708094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd42f-114a-419d-8246-594007497743 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:47.708589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbd42f-114a-419d-8246-594007497743 admin admin] PATH_INFO: `/v3/projects/0208de6a943e40ccb53a0d43a21b2de3/users/9e81f30a94544f928702fb15a3d3f2c4/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:47.727179 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860ac33-d511-41f8-ae85-0389680d0e0f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:47.734344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8e48e-c4ed-4151-b6b4-1343efcba099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:47.735211 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8e48e-c4ed-4151-b6b4-1343efcba099 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:47.735551 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8e48e-c4ed-4151-b6b4-1343efcba099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:47.735892 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8e48e-c4ed-4151-b6b4-1343efcba099 admin admin] PATH_INFO: `/v3/projects/0f2493b4fbfb4529a6a7bebdba53a560/users/57238cf0a13045a39a448af1d64a966a/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:47.746163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbd42f-114a-419d-8246-594007497743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0208de6a943e40ccb53a0d43a21b2de3, user_id=9e81f30a94544f928702fb15a3d3f2c4, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:47.748898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbd42f-114a-419d-8246-594007497743 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:47.761096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8e48e-c4ed-4151-b6b4-1343efcba099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2493b4fbfb4529a6a7bebdba53a560, user_id=57238cf0a13045a39a448af1d64a966a, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:47.769868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8e48e-c4ed-4151-b6b4-1343efcba099 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:47.869231 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1315/2610] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:47 2022] PUT /identity/v3/projects/0208de6a943e40ccb53a0d43a21b2de3/users/9e81f30a94544f928702fb15a3d3f2c4/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:42:47.891274 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0415-d536-4b7c-a404-7d2cda8f0656 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:47.891855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0415-d536-4b7c-a404-7d2cda8f0656 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:47.892387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc0415-d536-4b7c-a404-7d2cda8f0656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:47.905521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1296/2611] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:47 2022] PUT /identity/v3/projects/0f2493b4fbfb4529a6a7bebdba53a560/users/57238cf0a13045a39a448af1d64a966a/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:47.909975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8e48e-c4ed-4151-b6b4-1343efcba099 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:47.926881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-9ffc0415-d536-4b7c-a404-7d2cda8f0656 None None] MFA Rules not processed for user `9e81f30a94544f928702fb15a3d3f2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:47.928195 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9ffc0415-d536-4b7c-a404-7d2cda8f0656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:48.000889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8e48e-c4ed-4151-b6b4-1343efcba099 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:48.008397 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972ca26-00aa-468c-bbc6-1a8e93b6c886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:48.009394 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ca26-00aa-468c-bbc6-1a8e93b6c886 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:48.010282 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ca26-00aa-468c-bbc6-1a8e93b6c886 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:48.010786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ca26-00aa-468c-bbc6-1a8e93b6c886 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:48.011726 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972ca26-00aa-468c-bbc6-1a8e93b6c886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:48.013204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1316/2612] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:48.013927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972ca26-00aa-468c-bbc6-1a8e93b6c886 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:48.035296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:48.035296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1297/2613] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:42:48.038396 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0415-d536-4b7c-a404-7d2cda8f0656 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:48.044022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972ca26-00aa-468c-bbc6-1a8e93b6c886 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:48.046504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2972ca26-00aa-468c-bbc6-1a8e93b6c886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:48.059960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc0415-d536-4b7c-a404-7d2cda8f0656 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:48.066653 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1a200-14f0-4592-8f7b-5ce7f38233f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:48.067636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1a200-14f0-4592-8f7b-5ce7f38233f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:48.071283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1a200-14f0-4592-8f7b-5ce7f38233f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:48.071283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1a200-14f0-4592-8f7b-5ce7f38233f1 admin admin] PATH_INFO: `/v3/projects/0f2493b4fbfb4529a6a7bebdba53a560/users/57238cf0a13045a39a448af1d64a966a/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:48.071751 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1a200-14f0-4592-8f7b-5ce7f38233f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2493b4fbfb4529a6a7bebdba53a560, user_id=57238cf0a13045a39a448af1d64a966a, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:48.075435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1a200-14f0-4592-8f7b-5ce7f38233f1 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:48.092224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:48.102140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1317/2614] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:48 2022] PUT /identity/v3/projects/0f2493b4fbfb4529a6a7bebdba53a560/users/57238cf0a13045a39a448af1d64a966a/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:42:48.148061 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972ca26-00aa-468c-bbc6-1a8e93b6c886 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:48.216109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238d3e2-bbe1-445e-bf81-ed069db25f7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:48.216812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238d3e2-bbe1-445e-bf81-ed069db25f7a service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:48.227938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238d3e2-bbe1-445e-bf81-ed069db25f7a service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:48.228514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238d3e2-bbe1-445e-bf81-ed069db25f7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:48.371010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238d3e2-bbe1-445e-bf81-ed069db25f7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:48.373351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238d3e2-bbe1-445e-bf81-ed069db25f7a service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:48.385701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1298/2615] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:42:50.260197 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec10926-7112-44f9-a4c3-2878363bc9d5 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:50.260864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec10926-7112-44f9-a4c3-2878363bc9d5 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:50.261000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec10926-7112-44f9-a4c3-2878363bc9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:50.293065 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-dec10926-7112-44f9-a4c3-2878363bc9d5 None None] MFA Rules not processed for user `57238cf0a13045a39a448af1d64a966a`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:50.294247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-dec10926-7112-44f9-a4c3-2878363bc9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:50.373615 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1318/2616] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:50 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:50.787648 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e61e4b-3af7-4e7b-b400-f97d757f5fdb None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:50.788160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e61e4b-3af7-4e7b-b400-f97d757f5fdb None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:50.788253 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e61e4b-3af7-4e7b-b400-f97d757f5fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:50.809534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-87e61e4b-3af7-4e7b-b400-f97d757f5fdb None None] MFA Rules not processed for user `9e81f30a94544f928702fb15a3d3f2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:50.810764 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-87e61e4b-3af7-4e7b-b400-f97d757f5fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:50.825535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1299/2617] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:52.161954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec10926-7112-44f9-a4c3-2878363bc9d5 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:52.263610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec10926-7112-44f9-a4c3-2878363bc9d5 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:52.271826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:52.272569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:52.272950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:52.273301 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] PATH_INFO: `/v3/users/b0b851a5dd9746f6b1a41ce0d00dad9e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:52.274861 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b851a5dd9746f6b1a41ce0d00dad9e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:52.278348 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:52.506584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:52.522250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b851a5dd9746f6b1a41ce0d00dad9e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:52.538348 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b851a5dd9746f6b1a41ce0d00dad9e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:52.546731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b851a5dd9746f6b1a41ce0d00dad9e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:52.614733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b851a5dd9746f6b1a41ce0d00dad9e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:52.618648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b851a5dd9746f6b1a41ce0d00dad9e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:52.624979 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1319/2618] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:42:52 2022] DELETE /identity/v3/users/b0b851a5dd9746f6b1a41ce0d00dad9e => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:52.942637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e61e4b-3af7-4e7b-b400-f97d757f5fdb None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:52.954585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e61e4b-3af7-4e7b-b400-f97d757f5fdb None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:53.017773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:53.018418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:53.018757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:53.019655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] PATH_INFO: `/v3/projects/d0a58e6af0cc495989533b4022516fc0` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:53.021093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a58e6af0cc495989533b4022516fc0)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:53.023054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:53.025554 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:53.127743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a58e6af0cc495989533b4022516fc0', 'request_id': 'req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:53.134608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a58e6af0cc495989533b4022516fc0', 'request_id': 'req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:53.142456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a58e6af0cc495989533b4022516fc0', 'request_id': 'req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:53.243943 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] The token cache is being invalidate because project d0a58e6af0cc495989533b4022516fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:42:53.244242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:53.244903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:53.246609 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1300/2619] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:42:52 2022] DELETE /identity/v3/projects/d0a58e6af0cc495989533b4022516fc0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:53.250582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:53.252162 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:53.266360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10639ef-cd9c-4296-8e28-7d9136e3e12b admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:53.334690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d371f8c-d620-476b-acb7-5514286f6165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:53.335335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d371f8c-d620-476b-acb7-5514286f6165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:53.335685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d371f8c-d620-476b-acb7-5514286f6165 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:53.336016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d371f8c-d620-476b-acb7-5514286f6165 admin admin] PATH_INFO: `/v3/users/57238cf0a13045a39a448af1d64a966a` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:53.337180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d371f8c-d620-476b-acb7-5514286f6165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57238cf0a13045a39a448af1d64a966a)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:53.339181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d371f8c-d620-476b-acb7-5514286f6165 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:53.563069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-6d371f8c-d620-476b-acb7-5514286f6165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57238cf0a13045a39a448af1d64a966a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:53.578671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-6d371f8c-d620-476b-acb7-5514286f6165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57238cf0a13045a39a448af1d64a966a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:53.585842 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-6d371f8c-d620-476b-acb7-5514286f6165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57238cf0a13045a39a448af1d64a966a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:53.662300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-6d371f8c-d620-476b-acb7-5514286f6165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57238cf0a13045a39a448af1d64a966a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:53.662976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-6d371f8c-d620-476b-acb7-5514286f6165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57238cf0a13045a39a448af1d64a966a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:53.669691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1320/2620] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:42:53 2022] DELETE /identity/v3/users/57238cf0a13045a39a448af1d64a966a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:53.965610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:53.967205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:54.003818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6a5a2-dc7d-4d66-a032-4f46ac20e32f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:54.092235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:54.093094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:54.093315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:54.093715 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] PATH_INFO: `/v3/projects/0f2493b4fbfb4529a6a7bebdba53a560` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:54.094884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2493b4fbfb4529a6a7bebdba53a560)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:54.097589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:54.239926 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2493b4fbfb4529a6a7bebdba53a560', 'request_id': 'req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:54.245451 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2493b4fbfb4529a6a7bebdba53a560', 'request_id': 'req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:54.251774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2493b4fbfb4529a6a7bebdba53a560', 'request_id': 'req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:54.330534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] The token cache is being invalidate because project 0f2493b4fbfb4529a6a7bebdba53a560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:42:54.330923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:54.332108 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e528fc3c-5636-45d5-9c7c-7bf3d2d920e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:42:54.334031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1301/2621] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:42:53 2022] DELETE /identity/v3/projects/0f2493b4fbfb4529a6a7bebdba53a560 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:54.340371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc493fe-8326-49fb-b758-45d38e404f08 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:54.340871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc493fe-8326-49fb-b758-45d38e404f08 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:54.340871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc493fe-8326-49fb-b758-45d38e404f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:54.363580 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-9cc493fe-8326-49fb-b758-45d38e404f08 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:54.364830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9cc493fe-8326-49fb-b758-45d38e404f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:54.395295 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:54.440286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1321/2622] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:54.449637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0a378-2d83-49d8-a129-2a76d8e71e83 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:54.450372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0a378-2d83-49d8-a129-2a76d8e71e83 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:54.450656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0a378-2d83-49d8-a129-2a76d8e71e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:54.474427 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-65a0a378-2d83-49d8-a129-2a76d8e71e83 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:54.496390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-65a0a378-2d83-49d8-a129-2a76d8e71e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:54.496390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1302/2623] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:54.497554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc493fe-8326-49fb-b758-45d38e404f08 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:54.513213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc493fe-8326-49fb-b758-45d38e404f08 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:54.519657 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97bbbc-66a9-4b0b-bfec-4a2a579f0f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:54.520768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97bbbc-66a9-4b0b-bfec-4a2a579f0f7a admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:54.521056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97bbbc-66a9-4b0b-bfec-4a2a579f0f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:54.521333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97bbbc-66a9-4b0b-bfec-4a2a579f0f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:54.522090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97bbbc-66a9-4b0b-bfec-4a2a579f0f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:42:54.522394 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97bbbc-66a9-4b0b-bfec-4a2a579f0f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:54.524027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97bbbc-66a9-4b0b-bfec-4a2a579f0f7a admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:54.537164 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1322/2624] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:42:54.541760 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0a378-2d83-49d8-a129-2a76d8e71e83 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:54.552399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0a378-2d83-49d8-a129-2a76d8e71e83 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:54.557941 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0288bf8-0116-4571-a2da-4d06e28ce08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:54.558567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0288bf8-0116-4571-a2da-4d06e28ce08b admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:54.559055 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0288bf8-0116-4571-a2da-4d06e28ce08b admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:54.559426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0288bf8-0116-4571-a2da-4d06e28ce08b admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:54.560076 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0288bf8-0116-4571-a2da-4d06e28ce08b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:54.562128 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0288bf8-0116-4571-a2da-4d06e28ce08b admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:54.578859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:54.677379 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1303/2625] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:42:54 2022] POST /identity/v3/projects => generated 355 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:54.681633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97bbbc-66a9-4b0b-bfec-4a2a579f0f7a admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:54.693491 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97bbbc-66a9-4b0b-bfec-4a2a579f0f7a admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:54.754782 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33130d8-034f-43ce-857a-870480d5c464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:54.755446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33130d8-034f-43ce-857a-870480d5c464 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:54.755732 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33130d8-034f-43ce-857a-870480d5c464 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:54.756103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33130d8-034f-43ce-857a-870480d5c464 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:54.756745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33130d8-034f-43ce-857a-870480d5c464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:54.758933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33130d8-034f-43ce-857a-870480d5c464 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:54.893859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1323/2626] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:42:54 2022] POST /identity/v3/users => generated 278 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:54.895182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0288bf8-0116-4571-a2da-4d06e28ce08b admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:54.912773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0288bf8-0116-4571-a2da-4d06e28ce08b admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:54.919229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39af0a-bb4c-48ff-afce-5bade67117fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:54.919844 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39af0a-bb4c-48ff-afce-5bade67117fe admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:54.920125 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39af0a-bb4c-48ff-afce-5bade67117fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:54.920526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39af0a-bb4c-48ff-afce-5bade67117fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:54.921939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39af0a-bb4c-48ff-afce-5bade67117fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:54.924474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d39af0a-bb4c-48ff-afce-5bade67117fe admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:54.946674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1304/2627] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:54.948775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33130d8-034f-43ce-857a-870480d5c464 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:54.980935 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33130d8-034f-43ce-857a-870480d5c464 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:54.990178 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc825d-32a6-487b-ab2b-ad62edd52bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:54.991139 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc825d-32a6-487b-ab2b-ad62edd52bce admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:55.002011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc825d-32a6-487b-ab2b-ad62edd52bce admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:55.002645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc825d-32a6-487b-ab2b-ad62edd52bce admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:55.006596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc825d-32a6-487b-ab2b-ad62edd52bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:55.008917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc825d-32a6-487b-ab2b-ad62edd52bce admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:55.045646 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1324/2628] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:55.047051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39af0a-bb4c-48ff-afce-5bade67117fe admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:55.074274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39af0a-bb4c-48ff-afce-5bade67117fe admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:55.086868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267a9e-bf44-4034-a406-aa0d82977fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:55.086868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267a9e-bf44-4034-a406-aa0d82977fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:55.086868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267a9e-bf44-4034-a406-aa0d82977fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:55.086868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b267a9e-bf44-4034-a406-aa0d82977fd3 admin admin] PATH_INFO: `/v3/projects/0662553b5b3c43a5af1d4fdac3a0472e/users/130287579f7b4cf6a64952afc729dc87/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:55.107073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b267a9e-bf44-4034-a406-aa0d82977fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0662553b5b3c43a5af1d4fdac3a0472e, user_id=130287579f7b4cf6a64952afc729dc87, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:55.109882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b267a9e-bf44-4034-a406-aa0d82977fd3 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:55.217418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1305/2629] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:55 2022] PUT /identity/v3/projects/0662553b5b3c43a5af1d4fdac3a0472e/users/130287579f7b4cf6a64952afc729dc87/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:55.231555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2434-1dd6-4a54-9e8e-225dc6fb4d7d None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:55.231555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2434-1dd6-4a54-9e8e-225dc6fb4d7d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:55.231982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2434-1dd6-4a54-9e8e-225dc6fb4d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:55.267212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-10ac2434-1dd6-4a54-9e8e-225dc6fb4d7d None None] MFA Rules not processed for user `130287579f7b4cf6a64952afc729dc87`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:55.268629 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-10ac2434-1dd6-4a54-9e8e-225dc6fb4d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:55.348862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1325/2630] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:55.350137 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267a9e-bf44-4034-a406-aa0d82977fd3 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:55.439654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b267a9e-bf44-4034-a406-aa0d82977fd3 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:55.448765 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0249b3-7866-4b2d-ac04-e5a9ac09750d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:55.449763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0249b3-7866-4b2d-ac04-e5a9ac09750d admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:55.450187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0249b3-7866-4b2d-ac04-e5a9ac09750d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:55.450597 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0249b3-7866-4b2d-ac04-e5a9ac09750d admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:55.451601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0249b3-7866-4b2d-ac04-e5a9ac09750d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:55.454694 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0249b3-7866-4b2d-ac04-e5a9ac09750d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:55.563119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1306/2631] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:42:55 2022] POST /identity/v3/projects => generated 357 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:42:55.567875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac2434-1dd6-4a54-9e8e-225dc6fb4d7d None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:55.582456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac2434-1dd6-4a54-9e8e-225dc6fb4d7d None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:55.619261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:55.670199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd8651-e8e7-4e3b-b816-fb2461e17e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:55.670846 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd8651-e8e7-4e3b-b816-fb2461e17e81 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:55.671131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd8651-e8e7-4e3b-b816-fb2461e17e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:55.671411 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd8651-e8e7-4e3b-b816-fb2461e17e81 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:55.672169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd8651-e8e7-4e3b-b816-fb2461e17e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:55.674235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd8651-e8e7-4e3b-b816-fb2461e17e81 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:55.802949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1326/2632] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:42:55 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:42:55.806088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0249b3-7866-4b2d-ac04-e5a9ac09750d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:55.821206 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0249b3-7866-4b2d-ac04-e5a9ac09750d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:55.826559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11337d3-215d-44c7-bba6-0a893cc04e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:55.827268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11337d3-215d-44c7-bba6-0a893cc04e08 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:55.827662 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11337d3-215d-44c7-bba6-0a893cc04e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:55.827938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11337d3-215d-44c7-bba6-0a893cc04e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:55.828754 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11337d3-215d-44c7-bba6-0a893cc04e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:55.830608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11337d3-215d-44c7-bba6-0a893cc04e08 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:55.847575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1307/2633] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:55.853262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd8651-e8e7-4e3b-b816-fb2461e17e81 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:55.865306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd8651-e8e7-4e3b-b816-fb2461e17e81 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:55.870664 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaf048-2ca7-403f-a1ab-8a953549b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:55.871486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaf048-2ca7-403f-a1ab-8a953549b1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:55.871844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaf048-2ca7-403f-a1ab-8a953549b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:55.872209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaf048-2ca7-403f-a1ab-8a953549b1a1 admin admin] PATH_INFO: `/v3/projects/f05bff5239504798b7e0b0581f90841d/users/e1f87eea36ca4eba9f28bd803752059c/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:55.896378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deaf048-2ca7-403f-a1ab-8a953549b1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05bff5239504798b7e0b0581f90841d, user_id=e1f87eea36ca4eba9f28bd803752059c, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:55.899233 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deaf048-2ca7-403f-a1ab-8a953549b1a1 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:55.988855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1327/2634] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:55 2022] PUT /identity/v3/projects/f05bff5239504798b7e0b0581f90841d/users/e1f87eea36ca4eba9f28bd803752059c/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:55.993266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11337d3-215d-44c7-bba6-0a893cc04e08 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:56.005003 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11337d3-215d-44c7-bba6-0a893cc04e08 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:56.064996 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36354f3d-7046-44b8-b933-5bb05bdda5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:56.066421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36354f3d-7046-44b8-b933-5bb05bdda5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:56.066754 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36354f3d-7046-44b8-b933-5bb05bdda5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:56.067050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36354f3d-7046-44b8-b933-5bb05bdda5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:56.067647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36354f3d-7046-44b8-b933-5bb05bdda5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:56.069299 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36354f3d-7046-44b8-b933-5bb05bdda5b7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:56.080213 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1308/2635] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:42:56.087206 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaf048-2ca7-403f-a1ab-8a953549b1a1 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:56.096306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaf048-2ca7-403f-a1ab-8a953549b1a1 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:56.101830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca60fb-d73f-4ac8-95ab-4d637721c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:56.102492 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca60fb-d73f-4ac8-95ab-4d637721c7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:56.102770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca60fb-d73f-4ac8-95ab-4d637721c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:56.103039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca60fb-d73f-4ac8-95ab-4d637721c7c3 admin admin] PATH_INFO: `/v3/projects/f05bff5239504798b7e0b0581f90841d/users/e1f87eea36ca4eba9f28bd803752059c/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:56.104939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca60fb-d73f-4ac8-95ab-4d637721c7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05bff5239504798b7e0b0581f90841d, user_id=e1f87eea36ca4eba9f28bd803752059c, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:56.107662 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca60fb-d73f-4ac8-95ab-4d637721c7c3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:56.119025 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1328/2636] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:42:56 2022] PUT /identity/v3/projects/f05bff5239504798b7e0b0581f90841d/users/e1f87eea36ca4eba9f28bd803752059c/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:42:56.129254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba0864-f4f2-46af-a050-14b0f1168907 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:56.129546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba0864-f4f2-46af-a050-14b0f1168907 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:56.129928 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba0864-f4f2-46af-a050-14b0f1168907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:56.157798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-7aba0864-f4f2-46af-a050-14b0f1168907 None None] MFA Rules not processed for user `e1f87eea36ca4eba9f28bd803752059c`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:56.166885 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7aba0864-f4f2-46af-a050-14b0f1168907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:56.178804 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:42:56.236920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1309/2637] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:42:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:56.255082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca60fb-d73f-4ac8-95ab-4d637721c7c3 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:56.257299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9aca60fb-d73f-4ac8-95ab-4d637721c7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:56.280867 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5918a-1965-42f4-8019-780ff0502290 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:56.281268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5918a-1965-42f4-8019-780ff0502290 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:56.282071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5918a-1965-42f4-8019-780ff0502290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:56.338178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-90c5918a-1965-42f4-8019-780ff0502290 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:56.338178 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-90c5918a-1965-42f4-8019-780ff0502290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:56.341189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca60fb-d73f-4ac8-95ab-4d637721c7c3 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:56.345052 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dabd86-1fa1-4b6e-a01a-3ba76f2ac4c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:56.345723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dabd86-1fa1-4b6e-a01a-3ba76f2ac4c6 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:56.346034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dabd86-1fa1-4b6e-a01a-3ba76f2ac4c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:56.346309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dabd86-1fa1-4b6e-a01a-3ba76f2ac4c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:56.356930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dabd86-1fa1-4b6e-a01a-3ba76f2ac4c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:56.358574 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dabd86-1fa1-4b6e-a01a-3ba76f2ac4c6 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:56.370228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1329/2638] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:56.396619 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1310/2639] 10.222.0.74 () {58 vars in 967 bytes} [Wed Aug 31 00:42:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:42:56.410436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dabd86-1fa1-4b6e-a01a-3ba76f2ac4c6 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:56.412092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-62dabd86-1fa1-4b6e-a01a-3ba76f2ac4c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:56.513468 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dabd86-1fa1-4b6e-a01a-3ba76f2ac4c6 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:56.519242 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25a31d-9938-4161-8cf5-b30b3c4e289a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:56.520297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25a31d-9938-4161-8cf5-b30b3c4e289a service swift] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:56.520582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25a31d-9938-4161-8cf5-b30b3c4e289a service swift] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:56.520926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25a31d-9938-4161-8cf5-b30b3c4e289a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:56.531049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25a31d-9938-4161-8cf5-b30b3c4e289a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:56.533124 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25a31d-9938-4161-8cf5-b30b3c4e289a service swift] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:56.545978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1330/2640] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:42:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:42:56.637231 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5918a-1965-42f4-8019-780ff0502290 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:56.647674 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5918a-1965-42f4-8019-780ff0502290 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:56.653620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18af39-d610-4f86-9cdf-3adebe6dee7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:56.653620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18af39-d610-4f86-9cdf-3adebe6dee7e service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:56.653620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18af39-d610-4f86-9cdf-3adebe6dee7e service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:56.653620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18af39-d610-4f86-9cdf-3adebe6dee7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:56.716948 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18af39-d610-4f86-9cdf-3adebe6dee7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:56.718446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18af39-d610-4f86-9cdf-3adebe6dee7e service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:56.728927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1311/2641] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:42:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:42:59.040175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5f1b7-a4a8-4855-971b-b178f72e6ecb None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:59.043094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5f1b7-a4a8-4855-971b-b178f72e6ecb None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:59.043094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5f1b7-a4a8-4855-971b-b178f72e6ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:59.061764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-e0b5f1b7-a4a8-4855-971b-b178f72e6ecb None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:42:59.062993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e0b5f1b7-a4a8-4855-971b-b178f72e6ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:42:59.071951 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1331/2642] 10.222.0.74 () {58 vars in 967 bytes} [Wed Aug 31 00:42:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:42:59.095312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18af39-d610-4f86-9cdf-3adebe6dee7e service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:42:59.104946 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18af39-d610-4f86-9cdf-3adebe6dee7e service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:42:59.110278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2f29-7453-4e42-85dd-b32c7f2f8f16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:42:59.110920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2f29-7453-4e42-85dd-b32c7f2f8f16 service swift] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:42:59.111316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2f29-7453-4e42-85dd-b32c7f2f8f16 service swift] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:42:59.111683 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2f29-7453-4e42-85dd-b32c7f2f8f16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:42:59.120532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2f29-7453-4e42-85dd-b32c7f2f8f16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:42:59.122355 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2f29-7453-4e42-85dd-b32c7f2f8f16 service swift] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:42:59.132152 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1312/2643] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:42:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:43:09.056448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:09.128138 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=80 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:10.297547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5f1b7-a4a8-4855-971b-b178f72e6ecb None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:10.300322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-e0b5f1b7-a4a8-4855-971b-b178f72e6ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:10.378077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5f1b7-a4a8-4855-971b-b178f72e6ecb None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:10.385943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:10.386989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:10.387548 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:10.388098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] PATH_INFO: `/v3/users/5d279960a08c466eb428f415ace2b3b8` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:10.390173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d279960a08c466eb428f415ace2b3b8)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:10.392502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:10.594404 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d279960a08c466eb428f415ace2b3b8'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:10.617943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d279960a08c466eb428f415ace2b3b8'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:10.625717 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d279960a08c466eb428f415ace2b3b8'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:10.701868 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d279960a08c466eb428f415ace2b3b8'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:10.702581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d279960a08c466eb428f415ace2b3b8'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:10.710738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1332/2644] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:43:10 2022] DELETE /identity/v3/users/5d279960a08c466eb428f415ace2b3b8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:11.021701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2f29-7453-4e42-85dd-b32c7f2f8f16 service swift] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:11.039310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2f29-7453-4e42-85dd-b32c7f2f8f16 service swift] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:11.185036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:11.185998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:11.186449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:11.186615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] PATH_INFO: `/v3/projects/8179ee7de4c64c8c8a76b9d5d4a0109b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:11.188027 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8179ee7de4c64c8c8a76b9d5d4a0109b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:11.192935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:11.369359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8179ee7de4c64c8c8a76b9d5d4a0109b', 'request_id': 'req-498fce0c-3516-4145-affe-20e865d8b4c9'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:11.377374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8179ee7de4c64c8c8a76b9d5d4a0109b', 'request_id': 'req-498fce0c-3516-4145-affe-20e865d8b4c9'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:11.386541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8179ee7de4c64c8c8a76b9d5d4a0109b', 'request_id': 'req-498fce0c-3516-4145-affe-20e865d8b4c9'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:11.457971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] The token cache is being invalidate because project 8179ee7de4c64c8c8a76b9d5d4a0109b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:43:11.458430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:11.459114 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:11.460872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1313/2645] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:43:11 2022] DELETE /identity/v3/projects/8179ee7de4c64c8c8a76b9d5d4a0109b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:11.464862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:11.466333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:11.483146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f45cc-8363-4c7b-9546-503e9d1e3bf9 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:11.552639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ebbfa-0923-4f64-8e9b-411800bdab6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:11.553730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebbfa-0923-4f64-8e9b-411800bdab6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:11.554201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebbfa-0923-4f64-8e9b-411800bdab6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:11.554907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ebbfa-0923-4f64-8e9b-411800bdab6d admin admin] PATH_INFO: `/v3/users/b16a2fb1f0c147318bdb628d46008ca5` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:11.556451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ebbfa-0923-4f64-8e9b-411800bdab6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16a2fb1f0c147318bdb628d46008ca5)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:11.558764 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ebbfa-0923-4f64-8e9b-411800bdab6d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:11.586741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:11.818658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cd3ebbfa-0923-4f64-8e9b-411800bdab6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16a2fb1f0c147318bdb628d46008ca5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:11.831953 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cd3ebbfa-0923-4f64-8e9b-411800bdab6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16a2fb1f0c147318bdb628d46008ca5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:11.839154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cd3ebbfa-0923-4f64-8e9b-411800bdab6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16a2fb1f0c147318bdb628d46008ca5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:11.969650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cd3ebbfa-0923-4f64-8e9b-411800bdab6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16a2fb1f0c147318bdb628d46008ca5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:11.973547 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cd3ebbfa-0923-4f64-8e9b-411800bdab6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16a2fb1f0c147318bdb628d46008ca5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:11.981994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1333/2646] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:43:11 2022] DELETE /identity/v3/users/b16a2fb1f0c147318bdb628d46008ca5 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:43:12.262771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:12.262771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:12.280663 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fce0c-3516-4145-affe-20e865d8b4c9 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:12.354056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:12.354707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:12.354984 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:12.355260 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] PATH_INFO: `/v3/projects/890ebd98e5d244b2ba83e3f2a24dcc0e` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:12.356390 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890ebd98e5d244b2ba83e3f2a24dcc0e)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:12.358349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:12.454856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:12.467217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890ebd98e5d244b2ba83e3f2a24dcc0e', 'request_id': 'req-e36441e2-8fc6-4673-890f-621c78f337a8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:12.473775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890ebd98e5d244b2ba83e3f2a24dcc0e', 'request_id': 'req-e36441e2-8fc6-4673-890f-621c78f337a8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:12.480374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890ebd98e5d244b2ba83e3f2a24dcc0e', 'request_id': 'req-e36441e2-8fc6-4673-890f-621c78f337a8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:12.545012 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] The token cache is being invalidate because project 890ebd98e5d244b2ba83e3f2a24dcc0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:43:12.545215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:12.545850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:12.547352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1314/2647] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:43:12 2022] DELETE /identity/v3/projects/890ebd98e5d244b2ba83e3f2a24dcc0e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:14.261708 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e122b-726c-4708-8c67-e3f610a0754f None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:14.262184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e122b-726c-4708-8c67-e3f610a0754f None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:14.262578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e122b-726c-4708-8c67-e3f610a0754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:14.282555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0e7e122b-726c-4708-8c67-e3f610a0754f None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:14.284333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0e7e122b-726c-4708-8c67-e3f610a0754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:14.341527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1334/2648] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:43:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:14.354388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:14.355796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:14.426358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36441e2-8fc6-4673-890f-621c78f337a8 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:14.431151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc09612-9816-4847-96df-ff3538e92212 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:14.431744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc09612-9816-4847-96df-ff3538e92212 service swift] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:14.432020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc09612-9816-4847-96df-ff3538e92212 service swift] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:14.432289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc09612-9816-4847-96df-ff3538e92212 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:14.440907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc09612-9816-4847-96df-ff3538e92212 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:14.442555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc09612-9816-4847-96df-ff3538e92212 service swift] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:14.451035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1315/2649] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:43:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:43:15.410590 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba514a-1ac3-4db1-9401-96695ecbade6 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:15.411094 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba514a-1ac3-4db1-9401-96695ecbade6 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:15.411204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba514a-1ac3-4db1-9401-96695ecbade6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:15.431212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-c5ba514a-1ac3-4db1-9401-96695ecbade6 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:15.432545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c5ba514a-1ac3-4db1-9401-96695ecbade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:15.440431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1335/2650] 10.222.0.74 () {58 vars in 967 bytes} [Wed Aug 31 00:43:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:15.462540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc09612-9816-4847-96df-ff3538e92212 service swift] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:15.474358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc09612-9816-4847-96df-ff3538e92212 service swift] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:15.479747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9ace-cb29-4583-b5ac-88c0c0514097 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:15.480415 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9ace-cb29-4583-b5ac-88c0c0514097 service swift] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:15.480806 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9ace-cb29-4583-b5ac-88c0c0514097 service swift] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:15.481163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9ace-cb29-4583-b5ac-88c0c0514097 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:15.491013 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe9ace-cb29-4583-b5ac-88c0c0514097 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:15.495843 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe9ace-cb29-4583-b5ac-88c0c0514097 service swift] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:15.502682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1316/2651] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:43:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 00:43:16.091215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a261290-23f5-41f7-a7de-56b6fb058ae5 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:16.091680 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a261290-23f5-41f7-a7de-56b6fb058ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:16.091949 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a261290-23f5-41f7-a7de-56b6fb058ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:16.112997 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-3a261290-23f5-41f7-a7de-56b6fb058ae5 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:16.114088 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-3a261290-23f5-41f7-a7de-56b6fb058ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:16.123586 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1336/2652] 10.222.0.74 () {58 vars in 1009 bytes} [Wed Aug 31 00:43:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:43:16.137811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9ace-cb29-4583-b5ac-88c0c0514097 service swift] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:16.151097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9ace-cb29-4583-b5ac-88c0c0514097 service swift] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:16.156776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5798c-fd9c-405b-913b-3f43171b6f2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:16.157404 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5798c-fd9c-405b-913b-3f43171b6f2d service swift] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:16.157708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5798c-fd9c-405b-913b-3f43171b6f2d service swift] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:16.157981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5798c-fd9c-405b-913b-3f43171b6f2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:16.167303 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5798c-fd9c-405b-913b-3f43171b6f2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:16.168879 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5798c-fd9c-405b-913b-3f43171b6f2d service swift] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:16.178018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1317/2653] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:43:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:43:16.807090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4594c-f5ab-4a62-a92b-4c1375d67872 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:16.810520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4594c-f5ab-4a62-a92b-4c1375d67872 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:16.810520 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4594c-f5ab-4a62-a92b-4c1375d67872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:16.829309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-17b4594c-f5ab-4a62-a92b-4c1375d67872 None None] MFA Rules not processed for user `b15b4c00f7214835b42e2775c4023032`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:16.830599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-17b4594c-f5ab-4a62-a92b-4c1375d67872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:16.838950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1337/2654] 10.222.0.74 () {58 vars in 967 bytes} [Wed Aug 31 00:43:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:16.855271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5798c-fd9c-405b-913b-3f43171b6f2d service swift] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:16.856775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4594c-f5ab-4a62-a92b-4c1375d67872 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:16.857000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b1f5798c-fd9c-405b-913b-3f43171b6f2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:16.873454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4594c-f5ab-4a62-a92b-4c1375d67872 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:16.881825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba684441-2085-4c9d-9a42-b1eb3fe9150a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '045ff88aba374cc889389ba07e884462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:16.881825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba684441-2085-4c9d-9a42-b1eb3fe9150a service swift] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:16.881825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba684441-2085-4c9d-9a42-b1eb3fe9150a service swift] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:16.881825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba684441-2085-4c9d-9a42-b1eb3fe9150a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:16.891561 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba684441-2085-4c9d-9a42-b1eb3fe9150a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:16.893209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba684441-2085-4c9d-9a42-b1eb3fe9150a service swift] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:16.905353 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1338/2655] 10.222.0.74 () {60 vars in 1384 bytes} [Wed Aug 31 00:43:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 00:43:16.938100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5798c-fd9c-405b-913b-3f43171b6f2d service swift] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:16.943799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:16.944433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:16.944714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:16.944990 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] PATH_INFO: `/v3/users/130287579f7b4cf6a64952afc729dc87` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:16.946655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=130287579f7b4cf6a64952afc729dc87)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:16.948602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:17.034782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:17.133506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130287579f7b4cf6a64952afc729dc87'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:17.228114 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130287579f7b4cf6a64952afc729dc87'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:17.242186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130287579f7b4cf6a64952afc729dc87'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:17.249192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130287579f7b4cf6a64952afc729dc87'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:17.249994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130287579f7b4cf6a64952afc729dc87'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:17.255899 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1318/2656] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:43:16 2022] DELETE /identity/v3/users/130287579f7b4cf6a64952afc729dc87 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:17.260507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55b982-52bd-4640-8154-5921f88764b1 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:17.260819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55b982-52bd-4640-8154-5921f88764b1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:17.261093 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55b982-52bd-4640-8154-5921f88764b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:17.280551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8a55b982-52bd-4640-8154-5921f88764b1 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:17.281792 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8a55b982-52bd-4640-8154-5921f88764b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:17.348758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1339/2657] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:17.362383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:17.364007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:17.435078 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02050d3-1cca-46a3-9c57-f6724b1f0430 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:17.443570 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7dc1b-0351-4c41-a939-70b73b6fb3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:17.444343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7dc1b-0351-4c41-a939-70b73b6fb3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:17.444723 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7dc1b-0351-4c41-a939-70b73b6fb3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:17.445097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7dc1b-0351-4c41-a939-70b73b6fb3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:17.458672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7dc1b-0351-4c41-a939-70b73b6fb3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:17.460054 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7dc1b-0351-4c41-a939-70b73b6fb3d5 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:17.475014 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1319/2658] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:43:18.049993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55b982-52bd-4640-8154-5921f88764b1 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:18.049993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8a55b982-52bd-4640-8154-5921f88764b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:18.074418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55b982-52bd-4640-8154-5921f88764b1 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:18.080905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:18.081914 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:18.082237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:18.082601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] PATH_INFO: `/v3/projects/0662553b5b3c43a5af1d4fdac3a0472e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:18.084106 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0662553b5b3c43a5af1d4fdac3a0472e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:18.101205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:18.101205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:18.217538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0662553b5b3c43a5af1d4fdac3a0472e', 'request_id': 'req-2f3a30a3-18dc-4127-afc6-53a8dc664b31'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:18.278518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0662553b5b3c43a5af1d4fdac3a0472e', 'request_id': 'req-2f3a30a3-18dc-4127-afc6-53a8dc664b31'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:18.294343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0662553b5b3c43a5af1d4fdac3a0472e', 'request_id': 'req-2f3a30a3-18dc-4127-afc6-53a8dc664b31'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:18.309833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] The token cache is being invalidate because project 0662553b5b3c43a5af1d4fdac3a0472e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:43:18.309833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:18.309833 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:18.310804 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1340/2659] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:43:18 2022] DELETE /identity/v3/projects/0662553b5b3c43a5af1d4fdac3a0472e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:18.314900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7dc1b-0351-4c41-a939-70b73b6fb3d5 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:18.325703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7dc1b-0351-4c41-a939-70b73b6fb3d5 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:18.394605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca7b14-e9a1-43e9-958a-d3365994efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:18.395329 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca7b14-e9a1-43e9-958a-d3365994efa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:18.395750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca7b14-e9a1-43e9-958a-d3365994efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:18.396035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca7b14-e9a1-43e9-958a-d3365994efa7 admin admin] PATH_INFO: `/v3/users/e1f87eea36ca4eba9f28bd803752059c` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:18.397280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca7b14-e9a1-43e9-958a-d3365994efa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f87eea36ca4eba9f28bd803752059c)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:18.399413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca7b14-e9a1-43e9-958a-d3365994efa7 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:18.625416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e4ca7b14-e9a1-43e9-958a-d3365994efa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f87eea36ca4eba9f28bd803752059c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:18.627196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:18.712049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e4ca7b14-e9a1-43e9-958a-d3365994efa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f87eea36ca4eba9f28bd803752059c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:18.730742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e4ca7b14-e9a1-43e9-958a-d3365994efa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f87eea36ca4eba9f28bd803752059c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:18.739227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e4ca7b14-e9a1-43e9-958a-d3365994efa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f87eea36ca4eba9f28bd803752059c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:18.739983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-e4ca7b14-e9a1-43e9-958a-d3365994efa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f87eea36ca4eba9f28bd803752059c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:18.759589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1320/2660] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:43:18 2022] DELETE /identity/v3/users/e1f87eea36ca4eba9f28bd803752059c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:43:19.206571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:19.208467 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:19.223107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a30a3-18dc-4127-afc6-53a8dc664b31 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:19.287515 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:19.288553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:19.288734 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:19.289017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] PATH_INFO: `/v3/projects/f05bff5239504798b7e0b0581f90841d` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:19.290184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05bff5239504798b7e0b0581f90841d)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:19.292131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:19.431307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05bff5239504798b7e0b0581f90841d', 'request_id': 'req-de2be2b6-2029-4722-9168-a2b7f1acb1ac'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:19.505857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05bff5239504798b7e0b0581f90841d', 'request_id': 'req-de2be2b6-2029-4722-9168-a2b7f1acb1ac'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:19.512069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05bff5239504798b7e0b0581f90841d', 'request_id': 'req-de2be2b6-2029-4722-9168-a2b7f1acb1ac'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:19.525176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] The token cache is being invalidate because project f05bff5239504798b7e0b0581f90841d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:43:19.527965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:19.527965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-de2be2b6-2029-4722-9168-a2b7f1acb1ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:19.527965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1341/2661] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:43:19 2022] DELETE /identity/v3/projects/f05bff5239504798b7e0b0581f90841d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:19.532534 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d171c-213c-439a-9de2-ab6100fe5c0b None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:19.533015 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d171c-213c-439a-9de2-ab6100fe5c0b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:19.533132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d171c-213c-439a-9de2-ab6100fe5c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:19.561977 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-e83d171c-213c-439a-9de2-ab6100fe5c0b None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:19.563181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e83d171c-213c-439a-9de2-ab6100fe5c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:19.637767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1321/2662] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:19.646365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5ba8-3742-403e-9299-789a67e12831 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:19.646647 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5ba8-3742-403e-9299-789a67e12831 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:19.646983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5ba8-3742-403e-9299-789a67e12831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:19.829480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-c42f5ba8-3742-403e-9299-789a67e12831 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:19.829480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c42f5ba8-3742-403e-9299-789a67e12831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:19.829480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1342/2663] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:19.829480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f5ba8-3742-403e-9299-789a67e12831 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:19.831439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d171c-213c-439a-9de2-ab6100fe5c0b None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:19.831439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e83d171c-213c-439a-9de2-ab6100fe5c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:19.839307 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f5ba8-3742-403e-9299-789a67e12831 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:19.842237 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d171c-213c-439a-9de2-ab6100fe5c0b None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:19.844760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1fdb4-0b1b-4155-ab90-9880477d7a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:19.845483 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1fdb4-0b1b-4155-ab90-9880477d7a0c admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:19.850275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1fdb4-0b1b-4155-ab90-9880477d7a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:19.850275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1fdb4-0b1b-4155-ab90-9880477d7a0c admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:19.850275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1fdb4-0b1b-4155-ab90-9880477d7a0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:43:19.850275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1fdb4-0b1b-4155-ab90-9880477d7a0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:19.851004 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1fdb4-0b1b-4155-ab90-9880477d7a0c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:19.854162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0e47d-d149-4e44-b337-ac10380098cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:19.854937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0e47d-d149-4e44-b337-ac10380098cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:19.855310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0e47d-d149-4e44-b337-ac10380098cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:19.855689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0e47d-d149-4e44-b337-ac10380098cc admin admin] PATH_INFO: `/v3/users/9e81f30a94544f928702fb15a3d3f2c4` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:19.856980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0e47d-d149-4e44-b337-ac10380098cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e81f30a94544f928702fb15a3d3f2c4)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:19.859056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0e47d-d149-4e44-b337-ac10380098cc admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:19.864481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1343/2664] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:43:19.869099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1fdb4-0b1b-4155-ab90-9880477d7a0c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:19.878704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:19.892142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1fdb4-0b1b-4155-ab90-9880477d7a0c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:19.899381 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b0237-9169-4bd5-b624-953642e34275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:19.900232 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b0237-9169-4bd5-b624-953642e34275 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:19.900637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b0237-9169-4bd5-b624-953642e34275 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:19.900985 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b0237-9169-4bd5-b624-953642e34275 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:19.901765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b0237-9169-4bd5-b624-953642e34275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:19.903873 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b0237-9169-4bd5-b624-953642e34275 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:20.108075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1344/2665] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:43:19 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:43:20.112635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b0237-9169-4bd5-b624-953642e34275 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:20.191643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b0237-9169-4bd5-b624-953642e34275 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:20.196766 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985ba7a-f1f1-46b7-a2a0-8ddd2bf6eeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:20.197333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985ba7a-f1f1-46b7-a2a0-8ddd2bf6eeab admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:20.197849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985ba7a-f1f1-46b7-a2a0-8ddd2bf6eeab admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:20.198293 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985ba7a-f1f1-46b7-a2a0-8ddd2bf6eeab admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:20.199387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985ba7a-f1f1-46b7-a2a0-8ddd2bf6eeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:20.201310 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985ba7a-f1f1-46b7-a2a0-8ddd2bf6eeab admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:20.240665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5dc0e47d-d149-4e44-b337-ac10380098cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e81f30a94544f928702fb15a3d3f2c4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:20.313145 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1345/2666] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:43:20 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:43:20.318101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985ba7a-f1f1-46b7-a2a0-8ddd2bf6eeab admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:20.328213 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985ba7a-f1f1-46b7-a2a0-8ddd2bf6eeab admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:20.332777 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596b8e6-74f7-4edb-8786-f66d4dcb5514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:20.333364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596b8e6-74f7-4edb-8786-f66d4dcb5514 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:20.333679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596b8e6-74f7-4edb-8786-f66d4dcb5514 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:20.333957 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596b8e6-74f7-4edb-8786-f66d4dcb5514 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:20.334590 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596b8e6-74f7-4edb-8786-f66d4dcb5514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:20.335502 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5dc0e47d-d149-4e44-b337-ac10380098cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e81f30a94544f928702fb15a3d3f2c4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:20.336317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596b8e6-74f7-4edb-8786-f66d4dcb5514 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:20.347631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1346/2667] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:43:20.349442 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5dc0e47d-d149-4e44-b337-ac10380098cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e81f30a94544f928702fb15a3d3f2c4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:20.351668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596b8e6-74f7-4edb-8786-f66d4dcb5514 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:20.356990 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5dc0e47d-d149-4e44-b337-ac10380098cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e81f30a94544f928702fb15a3d3f2c4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:20.357734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-5dc0e47d-d149-4e44-b337-ac10380098cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e81f30a94544f928702fb15a3d3f2c4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:20.365937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596b8e6-74f7-4edb-8786-f66d4dcb5514 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:20.366153 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1322/2668] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:43:19 2022] DELETE /identity/v3/users/9e81f30a94544f928702fb15a3d3f2c4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:20.369220 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2ef8a-31c4-4584-88ea-b4f58eb87916 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:20.369508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2ef8a-31c4-4584-88ea-b4f58eb87916 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:20.369814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2ef8a-31c4-4584-88ea-b4f58eb87916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:20.389861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-b6f2ef8a-31c4-4584-88ea-b4f58eb87916 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:20.391111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b6f2ef8a-31c4-4584-88ea-b4f58eb87916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:20.428889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:20.430154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d22ea-3f26-4da5-a2c1-e3b7688943b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:20.431117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d22ea-3f26-4da5-a2c1-e3b7688943b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:20.431631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d22ea-3f26-4da5-a2c1-e3b7688943b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:20.431952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d22ea-3f26-4da5-a2c1-e3b7688943b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:20.432719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d22ea-3f26-4da5-a2c1-e3b7688943b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:20.434645 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d22ea-3f26-4da5-a2c1-e3b7688943b7 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:20.449617 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1347/2669] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:43:20.454609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d22ea-3f26-4da5-a2c1-e3b7688943b7 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:20.456450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-873d22ea-3f26-4da5-a2c1-e3b7688943b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:20.461614 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1323/2670] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:43:20.470513 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d22ea-3f26-4da5-a2c1-e3b7688943b7 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:20.471677 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2ef8a-31c4-4584-88ea-b4f58eb87916 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:20.473389 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b6f2ef8a-31c4-4584-88ea-b4f58eb87916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:20.477526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253cc7-a260-48af-9277-3be8976326c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:20.482244 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253cc7-a260-48af-9277-3be8976326c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:20.482244 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253cc7-a260-48af-9277-3be8976326c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:20.482244 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253cc7-a260-48af-9277-3be8976326c7 admin admin] PATH_INFO: `/v3/projects/c65bfdbe76e84c28835f698d157df606/users/2bf6d7bc44724023a03ec03ae0f1474a/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:20.495327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253cc7-a260-48af-9277-3be8976326c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65bfdbe76e84c28835f698d157df606, user_id=2bf6d7bc44724023a03ec03ae0f1474a, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:20.498156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253cc7-a260-48af-9277-3be8976326c7 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:20.532062 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2ef8a-31c4-4584-88ea-b4f58eb87916 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:20.536073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2779f9-9f36-489f-aab9-eead287c8763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:20.539594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2779f9-9f36-489f-aab9-eead287c8763 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:20.539594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2779f9-9f36-489f-aab9-eead287c8763 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:20.539594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2779f9-9f36-489f-aab9-eead287c8763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:20.547157 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2779f9-9f36-489f-aab9-eead287c8763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:20.548590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2779f9-9f36-489f-aab9-eead287c8763 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:20.559060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1324/2671] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:43:20.592879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1348/2672] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:43:20 2022] PUT /identity/v3/projects/c65bfdbe76e84c28835f698d157df606/users/2bf6d7bc44724023a03ec03ae0f1474a/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:43:20.605537 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdabdb-ef4b-4c33-b3d3-07f9888de93d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:20.605861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdabdb-ef4b-4c33-b3d3-07f9888de93d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:20.606147 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdabdb-ef4b-4c33-b3d3-07f9888de93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:20.636503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-0acdabdb-ef4b-4c33-b3d3-07f9888de93d None None] MFA Rules not processed for user `2bf6d7bc44724023a03ec03ae0f1474a`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:20.637693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0acdabdb-ef4b-4c33-b3d3-07f9888de93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:20.706912 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1325/2673] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:20.711482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253cc7-a260-48af-9277-3be8976326c7 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:20.747879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:20.774759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253cc7-a260-48af-9277-3be8976326c7 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:20.779463 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee10f25-ebff-4845-880e-10ac4cd8ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:20.780068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee10f25-ebff-4845-880e-10ac4cd8ae63 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:20.780349 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee10f25-ebff-4845-880e-10ac4cd8ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:20.780623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee10f25-ebff-4845-880e-10ac4cd8ae63 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:20.781256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee10f25-ebff-4845-880e-10ac4cd8ae63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:20.783727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee10f25-ebff-4845-880e-10ac4cd8ae63 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:20.856144 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdabdb-ef4b-4c33-b3d3-07f9888de93d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:20.857918 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0acdabdb-ef4b-4c33-b3d3-07f9888de93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:20.874018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdabdb-ef4b-4c33-b3d3-07f9888de93d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:20.883358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:20.884095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:20.884262 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:20.884532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] PATH_INFO: `/v3/projects/0208de6a943e40ccb53a0d43a21b2de3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:20.885693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0208de6a943e40ccb53a0d43a21b2de3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:20.887644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:20.932589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1349/2674] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:43:20 2022] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:43:20.942731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee10f25-ebff-4845-880e-10ac4cd8ae63 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.005938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee10f25-ebff-4845-880e-10ac4cd8ae63 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.020118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0208de6a943e40ccb53a0d43a21b2de3', 'request_id': 'req-accfa0af-1d35-42d0-8fbd-856214174fd4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:21.027789 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0208de6a943e40ccb53a0d43a21b2de3', 'request_id': 'req-accfa0af-1d35-42d0-8fbd-856214174fd4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:21.037326 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0208de6a943e40ccb53a0d43a21b2de3', 'request_id': 'req-accfa0af-1d35-42d0-8fbd-856214174fd4'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:21.042372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:21.071478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529931c8-46cb-439e-8f12-99ce8c04efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.072399 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529931c8-46cb-439e-8f12-99ce8c04efaf admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.072684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529931c8-46cb-439e-8f12-99ce8c04efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.072962 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529931c8-46cb-439e-8f12-99ce8c04efaf admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.073623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529931c8-46cb-439e-8f12-99ce8c04efaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.075560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529931c8-46cb-439e-8f12-99ce8c04efaf admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.124506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] The token cache is being invalidate because project 0208de6a943e40ccb53a0d43a21b2de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:43:21.128332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:21.128332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-accfa0af-1d35-42d0-8fbd-856214174fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:21.128332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1326/2675] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:43:20 2022] DELETE /identity/v3/projects/0208de6a943e40ccb53a0d43a21b2de3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:43:21.132856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4b3d-73bd-43a5-81cb-0164c8853432 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.133399 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4b3d-73bd-43a5-81cb-0164c8853432 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.133697 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4b3d-73bd-43a5-81cb-0164c8853432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.155263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1350/2676] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:43:20 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:43:21.157518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-66ab4b3d-73bd-43a5-81cb-0164c8853432 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:21.157518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-66ab4b3d-73bd-43a5-81cb-0164c8853432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:21.158916 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529931c8-46cb-439e-8f12-99ce8c04efaf admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.160680 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-529931c8-46cb-439e-8f12-99ce8c04efaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:21.166720 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1327/2677] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:43:21.174993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1321b-9da2-4eb0-8311-9f441105933e None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.175313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1321b-9da2-4eb0-8311-9f441105933e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.175594 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1321b-9da2-4eb0-8311-9f441105933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.176371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529931c8-46cb-439e-8f12-99ce8c04efaf admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.185877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c172ecf-791b-4829-942c-197db630a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.185877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c172ecf-791b-4829-942c-197db630a50c admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.185877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c172ecf-791b-4829-942c-197db630a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.185877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c172ecf-791b-4829-942c-197db630a50c admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.186272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c172ecf-791b-4829-942c-197db630a50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.186272 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c172ecf-791b-4829-942c-197db630a50c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.200528 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-11e1321b-9da2-4eb0-8311-9f441105933e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:21.201731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1351/2678] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:43:21.201860 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-11e1321b-9da2-4eb0-8311-9f441105933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:21.204865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c172ecf-791b-4829-942c-197db630a50c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.211645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1328/2679] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:21.220388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c172ecf-791b-4829-942c-197db630a50c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.220388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4b26-a195-44d8-a156-5225a5ccf02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.221427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4b26-a195-44d8-a156-5225a5ccf02f admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.221924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4b26-a195-44d8-a156-5225a5ccf02f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.222205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee4b26-a195-44d8-a156-5225a5ccf02f admin admin] PATH_INFO: `/v3/projects/4368af1603d145539465b2716cf40e49/users/b9b46a930e36486c938526e16d332b2e/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.223673 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1321b-9da2-4eb0-8311-9f441105933e None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.233009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1321b-9da2-4eb0-8311-9f441105933e None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.238892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee4b26-a195-44d8-a156-5225a5ccf02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4368af1603d145539465b2716cf40e49, user_id=b9b46a930e36486c938526e16d332b2e, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.239051 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c2821-1004-415b-8eef-3bc4109150df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.242045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2821-1004-415b-8eef-3bc4109150df admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.242045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2821-1004-415b-8eef-3bc4109150df admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.242045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2821-1004-415b-8eef-3bc4109150df admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.242045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c2821-1004-415b-8eef-3bc4109150df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:43:21.242045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c2821-1004-415b-8eef-3bc4109150df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.242522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee4b26-a195-44d8-a156-5225a5ccf02f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.242808 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c2821-1004-415b-8eef-3bc4109150df admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.254983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1329/2680] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:43:21.259365 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c2821-1004-415b-8eef-3bc4109150df admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.269872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c2821-1004-415b-8eef-3bc4109150df admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.274382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33553e-707a-41b5-9092-cde41c40ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.274962 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33553e-707a-41b5-9092-cde41c40ec29 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.275242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33553e-707a-41b5-9092-cde41c40ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.275512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33553e-707a-41b5-9092-cde41c40ec29 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.276124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33553e-707a-41b5-9092-cde41c40ec29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.278048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33553e-707a-41b5-9092-cde41c40ec29 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.331081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1352/2681] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:43:21 2022] PUT /identity/v3/projects/4368af1603d145539465b2716cf40e49/users/b9b46a930e36486c938526e16d332b2e/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:21.335315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4b26-a195-44d8-a156-5225a5ccf02f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.356127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:21.396309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee4b26-a195-44d8-a156-5225a5ccf02f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.402002 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1330/2682] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:43:21 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:43:21.402235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92303238-bd6d-4eb7-9b3a-608949d2b49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.402869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92303238-bd6d-4eb7-9b3a-608949d2b49c admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.403138 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92303238-bd6d-4eb7-9b3a-608949d2b49c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.403416 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92303238-bd6d-4eb7-9b3a-608949d2b49c admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.404063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92303238-bd6d-4eb7-9b3a-608949d2b49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.405545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33553e-707a-41b5-9092-cde41c40ec29 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.405707 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92303238-bd6d-4eb7-9b3a-608949d2b49c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.419826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1353/2683] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:43:21.425109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92303238-bd6d-4eb7-9b3a-608949d2b49c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.432357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92303238-bd6d-4eb7-9b3a-608949d2b49c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.471100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33553e-707a-41b5-9092-cde41c40ec29 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.476007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea208e1-e154-42e2-8261-6baf70d28032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.476655 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea208e1-e154-42e2-8261-6baf70d28032 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.476934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea208e1-e154-42e2-8261-6baf70d28032 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.477434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea208e1-e154-42e2-8261-6baf70d28032 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.478109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea208e1-e154-42e2-8261-6baf70d28032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.480034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea208e1-e154-42e2-8261-6baf70d28032 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.490931 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ad4d2-5d9b-4b2c-9850-d321e997947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.491594 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ad4d2-5d9b-4b2c-9850-d321e997947f admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.491874 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ad4d2-5d9b-4b2c-9850-d321e997947f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.492150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ad4d2-5d9b-4b2c-9850-d321e997947f admin admin] PATH_INFO: `/v3/projects/4368af1603d145539465b2716cf40e49/users/b9b46a930e36486c938526e16d332b2e/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.494208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ad4d2-5d9b-4b2c-9850-d321e997947f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4368af1603d145539465b2716cf40e49, user_id=b9b46a930e36486c938526e16d332b2e, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.496879 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ad4d2-5d9b-4b2c-9850-d321e997947f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.508119 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1354/2684] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:43:21 2022] PUT /identity/v3/projects/4368af1603d145539465b2716cf40e49/users/b9b46a930e36486c938526e16d332b2e/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:21.519230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c9a8-c9f8-4e08-b043-8e26209ac500 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.519545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c9a8-c9f8-4e08-b043-8e26209ac500 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.519829 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461c9a8-c9f8-4e08-b043-8e26209ac500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.547838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-6461c9a8-c9f8-4e08-b043-8e26209ac500 None None] MFA Rules not processed for user `b9b46a930e36486c938526e16d332b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:21.549226 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6461c9a8-c9f8-4e08-b043-8e26209ac500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:21.593608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1331/2685] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:43:21 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:43:21.596792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea208e1-e154-42e2-8261-6baf70d28032 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.607473 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea208e1-e154-42e2-8261-6baf70d28032 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.629255 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1355/2686] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:43:21.641462 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461c9a8-c9f8-4e08-b043-8e26209ac500 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.643578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6461c9a8-c9f8-4e08-b043-8e26209ac500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:21.674859 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b71b3-13ca-44b6-ac13-2ac99a2f9202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.675391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b71b3-13ca-44b6-ac13-2ac99a2f9202 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.675676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b71b3-13ca-44b6-ac13-2ac99a2f9202 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.675953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b71b3-13ca-44b6-ac13-2ac99a2f9202 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.676602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b71b3-13ca-44b6-ac13-2ac99a2f9202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.678283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b71b3-13ca-44b6-ac13-2ac99a2f9202 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.683699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:21.688504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1332/2687] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:43:21.693142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b71b3-13ca-44b6-ac13-2ac99a2f9202 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.702822 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461c9a8-c9f8-4e08-b043-8e26209ac500 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.704526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b71b3-13ca-44b6-ac13-2ac99a2f9202 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.707211 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d949487-2a25-4703-9946-05f4c7422cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.707818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949487-2a25-4703-9946-05f4c7422cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.708092 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949487-2a25-4703-9946-05f4c7422cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.708361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949487-2a25-4703-9946-05f4c7422cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.709521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bc6f3-ff79-4077-8dc7-4d3c68f9abb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.710152 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc6f3-ff79-4077-8dc7-4d3c68f9abb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.710434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc6f3-ff79-4077-8dc7-4d3c68f9abb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.710730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bc6f3-ff79-4077-8dc7-4d3c68f9abb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.711467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bc6f3-ff79-4077-8dc7-4d3c68f9abb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.713064 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bc6f3-ff79-4077-8dc7-4d3c68f9abb0 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.718328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d949487-2a25-4703-9946-05f4c7422cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.720208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d949487-2a25-4703-9946-05f4c7422cb0 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.725436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1333/2688] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:43:21.729510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bc6f3-ff79-4077-8dc7-4d3c68f9abb0 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:21.731708 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1356/2689] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:43:21.739466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bc6f3-ff79-4077-8dc7-4d3c68f9abb0 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:21.744535 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a19f-24f0-4790-bf4d-81a5522be128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:21.745049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a19f-24f0-4790-bf4d-81a5522be128 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.745225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a19f-24f0-4790-bf4d-81a5522be128 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.745433 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a19f-24f0-4790-bf4d-81a5522be128 admin admin] PATH_INFO: `/v3/projects/907c580f388f4a7aaa2c88f04579c0c3/users/c62d364da2624b97b8dbaa912078282b/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.764070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63a19f-24f0-4790-bf4d-81a5522be128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907c580f388f4a7aaa2c88f04579c0c3, user_id=c62d364da2624b97b8dbaa912078282b, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:21.766792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63a19f-24f0-4790-bf4d-81a5522be128 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:21.770785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:21.907822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1334/2690] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:43:21 2022] PUT /identity/v3/projects/907c580f388f4a7aaa2c88f04579c0c3/users/c62d364da2624b97b8dbaa912078282b/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:43:21.927257 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab00e32-667a-4b13-9e62-752061930b4c None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:21.927491 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab00e32-667a-4b13-9e62-752061930b4c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:21.927719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab00e32-667a-4b13-9e62-752061930b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:21.965851 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-dab00e32-667a-4b13-9e62-752061930b4c None None] MFA Rules not processed for user `c62d364da2624b97b8dbaa912078282b`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:21.967072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-dab00e32-667a-4b13-9e62-752061930b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:21.985170 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a19f-24f0-4790-bf4d-81a5522be128 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:22.038017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1357/2691] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:43:22.047400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a19f-24f0-4790-bf4d-81a5522be128 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:22.048674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab00e32-667a-4b13-9e62-752061930b4c None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:22.050790 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-dab00e32-667a-4b13-9e62-752061930b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:22.052037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e21ba-2210-49df-9ed5-1ad3db396486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:22.052647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e21ba-2210-49df-9ed5-1ad3db396486 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:22.052929 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e21ba-2210-49df-9ed5-1ad3db396486 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:22.053207 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e21ba-2210-49df-9ed5-1ad3db396486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:22.054993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e44e21ba-2210-49df-9ed5-1ad3db396486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:22.062812 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab00e32-667a-4b13-9e62-752061930b4c None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:22.067444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb7c75-f467-4b26-a9d0-5be96f1b56f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:22.068042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb7c75-f467-4b26-a9d0-5be96f1b56f7 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:22.068324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb7c75-f467-4b26-a9d0-5be96f1b56f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:22.068601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb7c75-f467-4b26-a9d0-5be96f1b56f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:22.077418 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb7c75-f467-4b26-a9d0-5be96f1b56f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:22.078954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb7c75-f467-4b26-a9d0-5be96f1b56f7 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:22.087930 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1358/2692] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:43:22.117737 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e21ba-2210-49df-9ed5-1ad3db396486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:22.119184 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e21ba-2210-49df-9ed5-1ad3db396486 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:22.129243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1335/2693] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:43:28.917796 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb7c75-f467-4b26-a9d0-5be96f1b56f7 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:28.990950 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb7c75-f467-4b26-a9d0-5be96f1b56f7 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:28.995995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:28.996632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:28.996912 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:28.997183 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] PATH_INFO: `/v3/users/2bf6d7bc44724023a03ec03ae0f1474a` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:28.998338 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf6d7bc44724023a03ec03ae0f1474a)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:29.000288 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:29.224193 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf6d7bc44724023a03ec03ae0f1474a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:29.231335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:29.238576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf6d7bc44724023a03ec03ae0f1474a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:29.244516 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf6d7bc44724023a03ec03ae0f1474a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:29.312280 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf6d7bc44724023a03ec03ae0f1474a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:29.312904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf6d7bc44724023a03ec03ae0f1474a'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:29.319482 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1359/2694] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:43:28 2022] DELETE /identity/v3/users/2bf6d7bc44724023a03ec03ae0f1474a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:29.324434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9b5a7-e761-486c-a04c-3d7ac3479c71 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:29.324908 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9b5a7-e761-486c-a04c-3d7ac3479c71 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:29.325004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9b5a7-e761-486c-a04c-3d7ac3479c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:29.344600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-35f9b5a7-e761-486c-a04c-3d7ac3479c71 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:29.346676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-35f9b5a7-e761-486c-a04c-3d7ac3479c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:29.406056 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1336/2695] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:29.417360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:29.418819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:29.481932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60670-4f27-4be2-be70-4064fc88fea4 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:29.485389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92f79e-d339-49a8-b410-d8e84900d924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:29.486071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92f79e-d339-49a8-b410-d8e84900d924 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:29.486435 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92f79e-d339-49a8-b410-d8e84900d924 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:29.486864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92f79e-d339-49a8-b410-d8e84900d924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:29.495967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92f79e-d339-49a8-b410-d8e84900d924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:29.497397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92f79e-d339-49a8-b410-d8e84900d924 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:29.508614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1360/2696] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:43:29.926184 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9b5a7-e761-486c-a04c-3d7ac3479c71 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:29.928318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-35f9b5a7-e761-486c-a04c-3d7ac3479c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:29.942267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9b5a7-e761-486c-a04c-3d7ac3479c71 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:29.947647 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:29.948285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:29.948568 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:29.949417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] PATH_INFO: `/v3/projects/c65bfdbe76e84c28835f698d157df606` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:29.950783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65bfdbe76e84c28835f698d157df606)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:29.953166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:30.081047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:30.081796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65bfdbe76e84c28835f698d157df606', 'request_id': 'req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:30.087273 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65bfdbe76e84c28835f698d157df606', 'request_id': 'req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:30.093717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65bfdbe76e84c28835f698d157df606', 'request_id': 'req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:30.181604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] The token cache is being invalidate because project c65bfdbe76e84c28835f698d157df606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:43:30.181913 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:30.182558 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:30.184031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1337/2697] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:43:29 2022] DELETE /identity/v3/projects/c65bfdbe76e84c28835f698d157df606 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:30.188254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92f79e-d339-49a8-b410-d8e84900d924 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:30.199365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92f79e-d339-49a8-b410-d8e84900d924 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:30.261724 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcbc0f-208c-4d39-b07d-f44e76a4864b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:30.262360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcbc0f-208c-4d39-b07d-f44e76a4864b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:30.262639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcbc0f-208c-4d39-b07d-f44e76a4864b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:30.262907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcbc0f-208c-4d39-b07d-f44e76a4864b admin admin] PATH_INFO: `/v3/users/b9b46a930e36486c938526e16d332b2e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:30.264061 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcbc0f-208c-4d39-b07d-f44e76a4864b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b46a930e36486c938526e16d332b2e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:30.266169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcbc0f-208c-4d39-b07d-f44e76a4864b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:30.508576 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-defcbc0f-208c-4d39-b07d-f44e76a4864b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b46a930e36486c938526e16d332b2e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:30.523634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-defcbc0f-208c-4d39-b07d-f44e76a4864b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b46a930e36486c938526e16d332b2e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:30.530624 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-defcbc0f-208c-4d39-b07d-f44e76a4864b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b46a930e36486c938526e16d332b2e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:30.534973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:30.603943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-defcbc0f-208c-4d39-b07d-f44e76a4864b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b46a930e36486c938526e16d332b2e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:30.604671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-defcbc0f-208c-4d39-b07d-f44e76a4864b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b46a930e36486c938526e16d332b2e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:30.612047 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1361/2698] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:43:30 2022] DELETE /identity/v3/users/b9b46a930e36486c938526e16d332b2e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:31.002360 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:31.003841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:31.018416 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ba0d6-bb24-4b32-984b-29051ecc95b8 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:31.076444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:31.077104 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:31.077387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:31.077707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] PATH_INFO: `/v3/projects/4368af1603d145539465b2716cf40e49` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:31.078930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4368af1603d145539465b2716cf40e49)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:31.081767 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:31.199527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4368af1603d145539465b2716cf40e49', 'request_id': 'req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:31.205500 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4368af1603d145539465b2716cf40e49', 'request_id': 'req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:31.211625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4368af1603d145539465b2716cf40e49', 'request_id': 'req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:31.283888 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] The token cache is being invalidate because project 4368af1603d145539465b2716cf40e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:43:31.284180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:31.284826 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4f3dc4e9-2f5c-49ef-8208-58950fba2d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:31.286396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1338/2699] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:43:31 2022] DELETE /identity/v3/projects/4368af1603d145539465b2716cf40e49 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:31.291459 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09187d37-9d47-47aa-bdef-be880524a652 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:31.291946 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09187d37-9d47-47aa-bdef-be880524a652 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:31.292044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09187d37-9d47-47aa-bdef-be880524a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:31.312436 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-09187d37-9d47-47aa-bdef-be880524a652 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:31.313705 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-09187d37-9d47-47aa-bdef-be880524a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:31.373526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1362/2700] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:31.383115 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397e7c-f87d-4d0c-ad75-35701821bfe3 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:31.383430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397e7c-f87d-4d0c-ad75-35701821bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:31.383708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb397e7c-f87d-4d0c-ad75-35701821bfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:31.404430 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-bb397e7c-f87d-4d0c-ad75-35701821bfe3 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:31.405717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bb397e7c-f87d-4d0c-ad75-35701821bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:31.414351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1339/2701] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:31.418531 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09187d37-9d47-47aa-bdef-be880524a652 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:31.430133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09187d37-9d47-47aa-bdef-be880524a652 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:31.436208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd96a3-4e54-40bd-8a86-3cfa11bf8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:31.436823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd96a3-4e54-40bd-8a86-3cfa11bf8b84 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:31.437100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd96a3-4e54-40bd-8a86-3cfa11bf8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:31.437374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd96a3-4e54-40bd-8a86-3cfa11bf8b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:31.438078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd96a3-4e54-40bd-8a86-3cfa11bf8b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:43:31.438375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd96a3-4e54-40bd-8a86-3cfa11bf8b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:31.440969 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd96a3-4e54-40bd-8a86-3cfa11bf8b84 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:31.457684 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1363/2702] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:43:31.458710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397e7c-f87d-4d0c-ad75-35701821bfe3 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:31.468184 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb397e7c-f87d-4d0c-ad75-35701821bfe3 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:31.473374 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e2c75-1c87-46cd-b8c7-3d1c11e259dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:31.474005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2c75-1c87-46cd-b8c7-3d1c11e259dd admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:31.474289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2c75-1c87-46cd-b8c7-3d1c11e259dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:31.474593 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e2c75-1c87-46cd-b8c7-3d1c11e259dd admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:31.475259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e2c75-1c87-46cd-b8c7-3d1c11e259dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:31.477182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e2c75-1c87-46cd-b8c7-3d1c11e259dd admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:31.600302 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1340/2703] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:43:31 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:43:31.609850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd96a3-4e54-40bd-8a86-3cfa11bf8b84 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:31.621019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd96a3-4e54-40bd-8a86-3cfa11bf8b84 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:31.679656 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba450f-6baf-4dac-93c1-1fad87636c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:31.680258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba450f-6baf-4dac-93c1-1fad87636c34 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:31.680535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba450f-6baf-4dac-93c1-1fad87636c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:31.680803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba450f-6baf-4dac-93c1-1fad87636c34 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:31.681426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba450f-6baf-4dac-93c1-1fad87636c34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:31.683406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba450f-6baf-4dac-93c1-1fad87636c34 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:31.766488 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1364/2704] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:43:31 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:43:31.769167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e2c75-1c87-46cd-b8c7-3d1c11e259dd admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:31.779995 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e2c75-1c87-46cd-b8c7-3d1c11e259dd admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:31.784769 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af4f35-cd7d-4313-a315-05bc391462cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:31.785443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af4f35-cd7d-4313-a315-05bc391462cd admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:31.785779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af4f35-cd7d-4313-a315-05bc391462cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:31.786058 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af4f35-cd7d-4313-a315-05bc391462cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:31.786730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af4f35-cd7d-4313-a315-05bc391462cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:31.788325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af4f35-cd7d-4313-a315-05bc391462cd admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:31.799501 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1341/2705] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:43:31.803765 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba450f-6baf-4dac-93c1-1fad87636c34 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:31.813862 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba450f-6baf-4dac-93c1-1fad87636c34 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:31.819006 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29eb98-acec-4dda-9590-41307b1065db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:31.819580 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29eb98-acec-4dda-9590-41307b1065db admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:31.819857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29eb98-acec-4dda-9590-41307b1065db admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:31.820129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29eb98-acec-4dda-9590-41307b1065db admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:31.821014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29eb98-acec-4dda-9590-41307b1065db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:31.822633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29eb98-acec-4dda-9590-41307b1065db admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:31.833651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1365/2706] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:43:31.837967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af4f35-cd7d-4313-a315-05bc391462cd admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:31.850031 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af4f35-cd7d-4313-a315-05bc391462cd admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:31.857621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ec29b-1192-4de0-a0c8-e689bdabb4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:31.858318 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ec29b-1192-4de0-a0c8-e689bdabb4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:31.858625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ec29b-1192-4de0-a0c8-e689bdabb4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:31.858902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ec29b-1192-4de0-a0c8-e689bdabb4b4 admin admin] PATH_INFO: `/v3/projects/4d6794f496e84d02b536b4fd8df22f02/users/590623c73f564c76a28bc996b245949c/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:31.876350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ec29b-1192-4de0-a0c8-e689bdabb4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6794f496e84d02b536b4fd8df22f02, user_id=590623c73f564c76a28bc996b245949c, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:31.879830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ec29b-1192-4de0-a0c8-e689bdabb4b4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:32.005936 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:32.012149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1342/2707] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:43:31 2022] PUT /identity/v3/projects/4d6794f496e84d02b536b4fd8df22f02/users/590623c73f564c76a28bc996b245949c/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:32.018076 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdf818-52c1-47b6-b33c-36a2d29190a0 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:32.018341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdf818-52c1-47b6-b33c-36a2d29190a0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:32.018614 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdf818-52c1-47b6-b33c-36a2d29190a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:32.045788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-b8fdf818-52c1-47b6-b33c-36a2d29190a0 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:32.045788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b8fdf818-52c1-47b6-b33c-36a2d29190a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:32.105720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1366/2708] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:32.116459 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ec29b-1192-4de0-a0c8-e689bdabb4b4 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:32.118315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5d4ec29b-1192-4de0-a0c8-e689bdabb4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:32.177453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ec29b-1192-4de0-a0c8-e689bdabb4b4 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:32.181235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39174e0-16d9-47a0-a1be-5188160370e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:32.181874 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39174e0-16d9-47a0-a1be-5188160370e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:32.182152 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39174e0-16d9-47a0-a1be-5188160370e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:32.182423 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39174e0-16d9-47a0-a1be-5188160370e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:32.191668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39174e0-16d9-47a0-a1be-5188160370e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:32.193168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39174e0-16d9-47a0-a1be-5188160370e1 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:32.203131 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1343/2709] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:43:33.484974 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76510fc-2526-4f6d-b82e-e5f4939cd3f5 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:33.485508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76510fc-2526-4f6d-b82e-e5f4939cd3f5 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:33.485508 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76510fc-2526-4f6d-b82e-e5f4939cd3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:33.494761 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:33.523350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f76510fc-2526-4f6d-b82e-e5f4939cd3f5 None None] MFA Rules not processed for user `590623c73f564c76a28bc996b245949c`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:33.524641 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f76510fc-2526-4f6d-b82e-e5f4939cd3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:33.617124 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1367/2710] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:33.621721 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39174e0-16d9-47a0-a1be-5188160370e1 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:33.632457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39174e0-16d9-47a0-a1be-5188160370e1 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:33.637186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662f546-7405-472a-af76-9a174f711f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:33.638177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f546-7405-472a-af76-9a174f711f60 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:33.638177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f546-7405-472a-af76-9a174f711f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:33.638645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662f546-7405-472a-af76-9a174f711f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:33.639227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662f546-7405-472a-af76-9a174f711f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:33.641118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662f546-7405-472a-af76-9a174f711f60 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:33.761845 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1344/2711] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:43:33 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:43:33.765993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76510fc-2526-4f6d-b82e-e5f4939cd3f5 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:33.777730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76510fc-2526-4f6d-b82e-e5f4939cd3f5 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:33.838582 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a120d-4f98-4377-b688-ca6995a9e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:33.839192 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a120d-4f98-4377-b688-ca6995a9e29d admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:33.839474 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a120d-4f98-4377-b688-ca6995a9e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:33.839746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a120d-4f98-4377-b688-ca6995a9e29d admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:33.840392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a120d-4f98-4377-b688-ca6995a9e29d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:33.842374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a120d-4f98-4377-b688-ca6995a9e29d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:33.895373 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662f546-7405-472a-af76-9a174f711f60 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:33.897123 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c662f546-7405-472a-af76-9a174f711f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:33.911331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662f546-7405-472a-af76-9a174f711f60 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:33.914799 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1368/2712] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:43:33 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:43:33.916040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:33.919510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:33.919510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:33.919510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] PATH_INFO: `/v3/users/c62d364da2624b97b8dbaa912078282b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:33.919510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62d364da2624b97b8dbaa912078282b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:33.920258 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:33.922167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a120d-4f98-4377-b688-ca6995a9e29d admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:33.933152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a120d-4f98-4377-b688-ca6995a9e29d admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:33.938450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6e632-df86-4950-aa72-017a65ecb22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:33.939247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6e632-df86-4950-aa72-017a65ecb22d admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:33.939651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6e632-df86-4950-aa72-017a65ecb22d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:33.939933 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6e632-df86-4950-aa72-017a65ecb22d admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:33.944347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6e632-df86-4950-aa72-017a65ecb22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:33.944347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6e632-df86-4950-aa72-017a65ecb22d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:33.953299 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1369/2713] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:43:33.958163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6e632-df86-4950-aa72-017a65ecb22d admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:33.967814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6e632-df86-4950-aa72-017a65ecb22d admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:33.973150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1317fe-00b2-4349-a0e2-9ed848690c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:33.973814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1317fe-00b2-4349-a0e2-9ed848690c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:33.974098 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1317fe-00b2-4349-a0e2-9ed848690c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:33.974375 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1317fe-00b2-4349-a0e2-9ed848690c4f admin admin] PATH_INFO: `/v3/projects/9277114c51d44613a6535fcb01d08dc2/users/081645e61aba476ba8e980f4e8fa5eb6/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:33.988981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1317fe-00b2-4349-a0e2-9ed848690c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9277114c51d44613a6535fcb01d08dc2, user_id=081645e61aba476ba8e980f4e8fa5eb6, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:33.991670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1317fe-00b2-4349-a0e2-9ed848690c4f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:34.057077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1370/2714] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:43:33 2022] PUT /identity/v3/projects/9277114c51d44613a6535fcb01d08dc2/users/081645e61aba476ba8e980f4e8fa5eb6/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:43:34.061843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1317fe-00b2-4349-a0e2-9ed848690c4f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:34.112253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:34.126469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1317fe-00b2-4349-a0e2-9ed848690c4f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:34.131486 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd666b2-a3f2-43c5-a6f1-e63a11a4e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:34.131669 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62d364da2624b97b8dbaa912078282b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:34.132103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd666b2-a3f2-43c5-a6f1-e63a11a4e3bc admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:34.132385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd666b2-a3f2-43c5-a6f1-e63a11a4e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:34.132669 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd666b2-a3f2-43c5-a6f1-e63a11a4e3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:34.133304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd666b2-a3f2-43c5-a6f1-e63a11a4e3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:34.134966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd666b2-a3f2-43c5-a6f1-e63a11a4e3bc admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:34.149545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1371/2715] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:43:34.150622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd666b2-a3f2-43c5-a6f1-e63a11a4e3bc admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:34.161537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd666b2-a3f2-43c5-a6f1-e63a11a4e3bc admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:34.166398 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ebe6b-eba8-443f-8adb-3cce1428bfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:34.167150 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebe6b-eba8-443f-8adb-3cce1428bfd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:34.167387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebe6b-eba8-443f-8adb-3cce1428bfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:34.167923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebe6b-eba8-443f-8adb-3cce1428bfd8 admin admin] PATH_INFO: `/v3/projects/9277114c51d44613a6535fcb01d08dc2/users/081645e61aba476ba8e980f4e8fa5eb6/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:34.170511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ebe6b-eba8-443f-8adb-3cce1428bfd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9277114c51d44613a6535fcb01d08dc2, user_id=081645e61aba476ba8e980f4e8fa5eb6, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:34.173900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ebe6b-eba8-443f-8adb-3cce1428bfd8 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:34.186086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1372/2716] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:43:34 2022] PUT /identity/v3/projects/9277114c51d44613a6535fcb01d08dc2/users/081645e61aba476ba8e980f4e8fa5eb6/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:43:34.198516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62d364da2624b97b8dbaa912078282b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:34.213432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62d364da2624b97b8dbaa912078282b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:34.220700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62d364da2624b97b8dbaa912078282b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:34.221458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62d364da2624b97b8dbaa912078282b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:34.227778 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1345/2717] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:43:33 2022] DELETE /identity/v3/users/c62d364da2624b97b8dbaa912078282b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:43:34.232230 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec371ab-4a32-4669-afc0-3ac900881b2f None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:34.232528 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec371ab-4a32-4669-afc0-3ac900881b2f None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:34.232813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec371ab-4a32-4669-afc0-3ac900881b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:34.254039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-cec371ab-4a32-4669-afc0-3ac900881b2f None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:34.255249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cec371ab-4a32-4669-afc0-3ac900881b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:34.317716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1373/2718] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:34.338625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:34.338625 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:34.399808 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565c57b-905e-44ce-b316-000266c6605d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:34.404085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0849f0-0e5c-4687-9ff9-1ed76b3cdd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:34.404708 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0849f0-0e5c-4687-9ff9-1ed76b3cdd23 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:34.404991 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0849f0-0e5c-4687-9ff9-1ed76b3cdd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:34.405263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0849f0-0e5c-4687-9ff9-1ed76b3cdd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:34.414992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:34.419513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0849f0-0e5c-4687-9ff9-1ed76b3cdd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:34.419776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0849f0-0e5c-4687-9ff9-1ed76b3cdd23 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:34.431511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1346/2719] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:43:34.967634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec371ab-4a32-4669-afc0-3ac900881b2f None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:34.977045 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cec371ab-4a32-4669-afc0-3ac900881b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:34.992982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec371ab-4a32-4669-afc0-3ac900881b2f None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:34.998433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:34.999087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:34.999368 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:34.999643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] PATH_INFO: `/v3/projects/907c580f388f4a7aaa2c88f04579c0c3` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:35.000800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=907c580f388f4a7aaa2c88f04579c0c3)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:35.005984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:35.117315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907c580f388f4a7aaa2c88f04579c0c3', 'request_id': 'req-b3b19236-11f7-466a-9e6a-6898d8638e4c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:35.205545 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907c580f388f4a7aaa2c88f04579c0c3', 'request_id': 'req-b3b19236-11f7-466a-9e6a-6898d8638e4c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:35.225355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907c580f388f4a7aaa2c88f04579c0c3', 'request_id': 'req-b3b19236-11f7-466a-9e6a-6898d8638e4c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:35.257756 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] The token cache is being invalidate because project 907c580f388f4a7aaa2c88f04579c0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:43:35.258384 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:35.261718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b3b19236-11f7-466a-9e6a-6898d8638e4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:35.266813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1374/2720] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:43:34 2022] DELETE /identity/v3/projects/907c580f388f4a7aaa2c88f04579c0c3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:35.931202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37d71-c828-46ff-bef0-86717b4c0f2c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:35.931628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37d71-c828-46ff-bef0-86717b4c0f2c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:35.931755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea37d71-c828-46ff-bef0-86717b4c0f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:35.968413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-aea37d71-c828-46ff-bef0-86717b4c0f2c None None] MFA Rules not processed for user `081645e61aba476ba8e980f4e8fa5eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:35.970513 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-aea37d71-c828-46ff-bef0-86717b4c0f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:36.069807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1347/2721] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:36.082237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f71fc-11b7-4ad0-a4b8-5bfa5b717aaf None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:36.082775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f71fc-11b7-4ad0-a4b8-5bfa5b717aaf None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:36.082775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f71fc-11b7-4ad0-a4b8-5bfa5b717aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:36.127324 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-fb0f71fc-11b7-4ad0-a4b8-5bfa5b717aaf None None] MFA Rules not processed for user `590623c73f564c76a28bc996b245949c`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:36.129438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-fb0f71fc-11b7-4ad0-a4b8-5bfa5b717aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:36.185497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:36.196759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1375/2722] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:36.209263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea37d71-c828-46ff-bef0-86717b4c0f2c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:36.210822 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-aea37d71-c828-46ff-bef0-86717b4c0f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:36.305283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea37d71-c828-46ff-bef0-86717b4c0f2c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:36.312249 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc9cf3-32cc-4cf8-aef7-ad11d620f562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:36.312878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9cf3-32cc-4cf8-aef7-ad11d620f562 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:36.313298 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9cf3-32cc-4cf8-aef7-ad11d620f562 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:36.313709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9cf3-32cc-4cf8-aef7-ad11d620f562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:36.316171 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ffdc9cf3-32cc-4cf8-aef7-ad11d620f562 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:36.328506 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc9cf3-32cc-4cf8-aef7-ad11d620f562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:36.330274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc9cf3-32cc-4cf8-aef7-ad11d620f562 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:36.346367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1348/2723] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:43:36.589878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f71fc-11b7-4ad0-a4b8-5bfa5b717aaf None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:36.591584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-fb0f71fc-11b7-4ad0-a4b8-5bfa5b717aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:36.655256 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f71fc-11b7-4ad0-a4b8-5bfa5b717aaf None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:36.659077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448ad00-4001-4128-a0db-fc1d3a190dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:36.659719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448ad00-4001-4128-a0db-fc1d3a190dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:36.660001 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448ad00-4001-4128-a0db-fc1d3a190dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:36.660279 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448ad00-4001-4128-a0db-fc1d3a190dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:36.662056 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9448ad00-4001-4128-a0db-fc1d3a190dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:36.671674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448ad00-4001-4128-a0db-fc1d3a190dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:36.673141 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448ad00-4001-4128-a0db-fc1d3a190dd5 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:36.681264 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1376/2724] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:43:41.109299 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc9cf3-32cc-4cf8-aef7-ad11d620f562 service nova] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:41.111457 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-ffdc9cf3-32cc-4cf8-aef7-ad11d620f562 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:41.123592 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc9cf3-32cc-4cf8-aef7-ad11d620f562 service nova] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:41.127466 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc54801-6cc0-48f5-a4e4-bb386e861fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:41.128208 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc54801-6cc0-48f5-a4e4-bb386e861fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:41.128478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc54801-6cc0-48f5-a4e4-bb386e861fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:41.128797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc54801-6cc0-48f5-a4e4-bb386e861fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:41.130733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4fc54801-6cc0-48f5-a4e4-bb386e861fe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:41.228199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc54801-6cc0-48f5-a4e4-bb386e861fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:41.229755 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc54801-6cc0-48f5-a4e4-bb386e861fe2 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:41.236110 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:41.241268 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1349/2725] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:43:45.359053 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448ad00-4001-4128-a0db-fc1d3a190dd5 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:45.361350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9448ad00-4001-4128-a0db-fc1d3a190dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:45.375718 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448ad00-4001-4128-a0db-fc1d3a190dd5 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:45.380993 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2d10e-bc22-4b7f-be8a-629199a0b736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:45.381671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d10e-bc22-4b7f-be8a-629199a0b736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:45.381951 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d10e-bc22-4b7f-be8a-629199a0b736 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:45.382226 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2d10e-bc22-4b7f-be8a-629199a0b736 admin admin] PATH_INFO: `/v3/users/b049ee00b6404a678a010587074aba66` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:45.383361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2d10e-bc22-4b7f-be8a-629199a0b736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b049ee00b6404a678a010587074aba66)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:45.385282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2d10e-bc22-4b7f-be8a-629199a0b736 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:45.559336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b7d2d10e-bc22-4b7f-be8a-629199a0b736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b049ee00b6404a678a010587074aba66'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:45.572348 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b7d2d10e-bc22-4b7f-be8a-629199a0b736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b049ee00b6404a678a010587074aba66'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:45.579099 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b7d2d10e-bc22-4b7f-be8a-629199a0b736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b049ee00b6404a678a010587074aba66'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:45.637888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b7d2d10e-bc22-4b7f-be8a-629199a0b736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b049ee00b6404a678a010587074aba66'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:45.638510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-b7d2d10e-bc22-4b7f-be8a-629199a0b736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b049ee00b6404a678a010587074aba66'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:45.645391 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1377/2726] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:43:45 2022] DELETE /identity/v3/users/b049ee00b6404a678a010587074aba66 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:45.891605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc54801-6cc0-48f5-a4e4-bb386e861fe2 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:45.903536 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc54801-6cc0-48f5-a4e4-bb386e861fe2 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:45.964881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:45.965526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:45.966935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:45.966935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] PATH_INFO: `/v3/projects/2fed9993a3e74c428d9fbdc58e81cb65` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:45.968887 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fed9993a3e74c428d9fbdc58e81cb65)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:45.969077 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:46.095792 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fed9993a3e74c428d9fbdc58e81cb65', 'request_id': 'req-9c66d70b-243b-419e-87c8-ca57ac248fbf'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:46.101493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fed9993a3e74c428d9fbdc58e81cb65', 'request_id': 'req-9c66d70b-243b-419e-87c8-ca57ac248fbf'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:46.108085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fed9993a3e74c428d9fbdc58e81cb65', 'request_id': 'req-9c66d70b-243b-419e-87c8-ca57ac248fbf'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:46.192256 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] The token cache is being invalidate because project 2fed9993a3e74c428d9fbdc58e81cb65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:43:46.198604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:46.198604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-9c66d70b-243b-419e-87c8-ca57ac248fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:43:46.198604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1350/2727] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:43:45 2022] DELETE /identity/v3/projects/2fed9993a3e74c428d9fbdc58e81cb65 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:46.200012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092600f1-2869-4cbd-a1a5-80a92a5196b7 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:46.200300 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092600f1-2869-4cbd-a1a5-80a92a5196b7 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:46.200577 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092600f1-2869-4cbd-a1a5-80a92a5196b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:46.221678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-092600f1-2869-4cbd-a1a5-80a92a5196b7 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:46.222914 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-092600f1-2869-4cbd-a1a5-80a92a5196b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:46.295445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1378/2728] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:46.304048 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f599a-a732-4ebd-a76d-e198961498c6 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:46.304334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f599a-a732-4ebd-a76d-e198961498c6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:46.304612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f599a-a732-4ebd-a76d-e198961498c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:46.326066 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-e95f599a-a732-4ebd-a76d-e198961498c6 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:46.327271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-e95f599a-a732-4ebd-a76d-e198961498c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:46.339402 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1351/2729] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:46.340581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092600f1-2869-4cbd-a1a5-80a92a5196b7 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:46.350371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092600f1-2869-4cbd-a1a5-80a92a5196b7 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:46.355169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf4a84-fe8e-45a3-815a-184f2986890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:46.355783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf4a84-fe8e-45a3-815a-184f2986890c admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:46.356049 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf4a84-fe8e-45a3-815a-184f2986890c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:46.356325 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf4a84-fe8e-45a3-815a-184f2986890c admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:46.357010 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf4a84-fe8e-45a3-815a-184f2986890c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:43:46.357269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf4a84-fe8e-45a3-815a-184f2986890c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:46.358888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf4a84-fe8e-45a3-815a-184f2986890c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:46.370155 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:46.377455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1379/2730] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:43:46.382053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f599a-a732-4ebd-a76d-e198961498c6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:46.392188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f599a-a732-4ebd-a76d-e198961498c6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:46.397349 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451fbc9-604c-451c-baf5-f2dac53f6bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:46.398014 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451fbc9-604c-451c-baf5-f2dac53f6bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:46.398322 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451fbc9-604c-451c-baf5-f2dac53f6bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:46.398599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451fbc9-604c-451c-baf5-f2dac53f6bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:46.399241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451fbc9-604c-451c-baf5-f2dac53f6bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:46.401163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451fbc9-604c-451c-baf5-f2dac53f6bf1 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:46.479352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1352/2731] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:43:46 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:43:46.484103 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf4a84-fe8e-45a3-815a-184f2986890c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:46.496131 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf4a84-fe8e-45a3-815a-184f2986890c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:46.553638 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e1608-a768-4d66-b4bd-98d93ed3ad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:46.554241 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1608-a768-4d66-b4bd-98d93ed3ad0c admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:46.554518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1608-a768-4d66-b4bd-98d93ed3ad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:46.554791 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1608-a768-4d66-b4bd-98d93ed3ad0c admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:46.555446 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e1608-a768-4d66-b4bd-98d93ed3ad0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:46.558250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e1608-a768-4d66-b4bd-98d93ed3ad0c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:46.658448 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1380/2732] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:43:46 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:43:46.660181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451fbc9-604c-451c-baf5-f2dac53f6bf1 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:46.670834 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451fbc9-604c-451c-baf5-f2dac53f6bf1 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:46.676330 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ca176-46ca-4cf0-9863-9667267ec7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:46.676935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ca176-46ca-4cf0-9863-9667267ec7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:46.677283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ca176-46ca-4cf0-9863-9667267ec7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:46.677956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ca176-46ca-4cf0-9863-9667267ec7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:46.678590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ca176-46ca-4cf0-9863-9667267ec7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:46.680156 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ca176-46ca-4cf0-9863-9667267ec7f8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:46.691933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1353/2733] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:43:46.700917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e1608-a768-4d66-b4bd-98d93ed3ad0c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:46.711937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e1608-a768-4d66-b4bd-98d93ed3ad0c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:46.717355 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b0f8d-63d8-407a-a1e9-bf097ec4004d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:46.718291 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b0f8d-63d8-407a-a1e9-bf097ec4004d admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:46.718726 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b0f8d-63d8-407a-a1e9-bf097ec4004d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:46.719013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b0f8d-63d8-407a-a1e9-bf097ec4004d admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:46.720204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b0f8d-63d8-407a-a1e9-bf097ec4004d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:46.721881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b0f8d-63d8-407a-a1e9-bf097ec4004d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:46.733898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1381/2734] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:43:46.739160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ca176-46ca-4cf0-9863-9667267ec7f8 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:46.749367 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ca176-46ca-4cf0-9863-9667267ec7f8 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:46.755142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d886be8-6347-48a7-984b-a0045311df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:46.755894 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d886be8-6347-48a7-984b-a0045311df36 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:46.756405 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d886be8-6347-48a7-984b-a0045311df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:46.756758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d886be8-6347-48a7-984b-a0045311df36 admin admin] PATH_INFO: `/v3/projects/70c673fa396141f28dc81bd20e682e70/users/014a42fa07b74ba790995d04c74c5ea5/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:46.772315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d886be8-6347-48a7-984b-a0045311df36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c673fa396141f28dc81bd20e682e70, user_id=014a42fa07b74ba790995d04c74c5ea5, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:46.775017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d886be8-6347-48a7-984b-a0045311df36 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:46.854595 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1354/2735] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:43:46 2022] PUT /identity/v3/projects/70c673fa396141f28dc81bd20e682e70/users/014a42fa07b74ba790995d04c74c5ea5/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:43:46.860067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e27a0-2fbd-44e1-ba04-6e5e4f7c0d8e None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:46.860994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e27a0-2fbd-44e1-ba04-6e5e4f7c0d8e None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:46.861275 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e27a0-2fbd-44e1-ba04-6e5e4f7c0d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:46.880394 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-340e27a0-2fbd-44e1-ba04-6e5e4f7c0d8e None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:46.881670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-340e27a0-2fbd-44e1-ba04-6e5e4f7c0d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:46.946700 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1382/2736] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:46.957092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d886be8-6347-48a7-984b-a0045311df36 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:46.958957 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8d886be8-6347-48a7-984b-a0045311df36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:46.990943 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:47.016734 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d886be8-6347-48a7-984b-a0045311df36 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:47.021681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d102515-eec6-4a07-b59f-4f2271dadf3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:47.022299 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d102515-eec6-4a07-b59f-4f2271dadf3e service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:47.022581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d102515-eec6-4a07-b59f-4f2271dadf3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:47.022857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d102515-eec6-4a07-b59f-4f2271dadf3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:47.032176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d102515-eec6-4a07-b59f-4f2271dadf3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:47.034085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d102515-eec6-4a07-b59f-4f2271dadf3e service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:47.043838 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1355/2737] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:43:52.633227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609740de-4b83-4eba-bd1f-1d3a56edf1ce None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:52.634158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609740de-4b83-4eba-bd1f-1d3a56edf1ce None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:52.634438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609740de-4b83-4eba-bd1f-1d3a56edf1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:52.666619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-609740de-4b83-4eba-bd1f-1d3a56edf1ce None None] MFA Rules not processed for user `014a42fa07b74ba790995d04c74c5ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:52.667874 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-609740de-4b83-4eba-bd1f-1d3a56edf1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:52.748603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1383/2738] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:52.764272 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d102515-eec6-4a07-b59f-4f2271dadf3e service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:52.765837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6d102515-eec6-4a07-b59f-4f2271dadf3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:52.848862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d102515-eec6-4a07-b59f-4f2271dadf3e service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:52.854933 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b46530-35bd-4eec-a8a0-618a9e766ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:52.855565 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46530-35bd-4eec-a8a0-618a9e766ad6 service nova] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:52.855884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46530-35bd-4eec-a8a0-618a9e766ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:52.856119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46530-35bd-4eec-a8a0-618a9e766ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:52.865808 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b46530-35bd-4eec-a8a0-618a9e766ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:52.867432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b46530-35bd-4eec-a8a0-618a9e766ad6 service nova] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:52.885800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1356/2739] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:43:53.739940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609740de-4b83-4eba-bd1f-1d3a56edf1ce None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:53.741400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-609740de-4b83-4eba-bd1f-1d3a56edf1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:53.754072 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:43:53.815788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609740de-4b83-4eba-bd1f-1d3a56edf1ce None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:53.819569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a61720-9062-493a-b8cb-c85f161be47b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:53.820194 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a61720-9062-493a-b8cb-c85f161be47b service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:53.820478 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a61720-9062-493a-b8cb-c85f161be47b service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:53.821008 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a61720-9062-493a-b8cb-c85f161be47b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:53.827396 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-66a61720-9062-493a-b8cb-c85f161be47b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:53.940694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a61720-9062-493a-b8cb-c85f161be47b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:53.942212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a61720-9062-493a-b8cb-c85f161be47b service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:53.955982 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1384/2740] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:43:55.634458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bddc2b-0cd5-4890-81ed-730798b56a85 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:55.635034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bddc2b-0cd5-4890-81ed-730798b56a85 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:55.635034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bddc2b-0cd5-4890-81ed-730798b56a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:55.657795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-80bddc2b-0cd5-4890-81ed-730798b56a85 None None] MFA Rules not processed for user `014a42fa07b74ba790995d04c74c5ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:43:55.659181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-80bddc2b-0cd5-4890-81ed-730798b56a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:55.666750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1357/2741] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:43:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:43:56.039939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a61720-9062-493a-b8cb-c85f161be47b service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:43:56.041457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-66a61720-9062-493a-b8cb-c85f161be47b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:56.054311 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a61720-9062-493a-b8cb-c85f161be47b service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:43:56.058018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31811797-c2d9-4def-b0ee-6a4e3264bb17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:43:56.058632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31811797-c2d9-4def-b0ee-6a4e3264bb17 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:43:56.058910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31811797-c2d9-4def-b0ee-6a4e3264bb17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:43:56.059181 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31811797-c2d9-4def-b0ee-6a4e3264bb17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:43:56.061278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-31811797-c2d9-4def-b0ee-6a4e3264bb17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:43:56.076165 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31811797-c2d9-4def-b0ee-6a4e3264bb17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:43:56.077643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31811797-c2d9-4def-b0ee-6a4e3264bb17 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:43:56.088117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1385/2742] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:43:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:44:05.651313 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=51 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:06.083771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=52 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:18.639118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bddc2b-0cd5-4890-81ed-730798b56a85 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:18.640588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-80bddc2b-0cd5-4890-81ed-730798b56a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:18.725454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bddc2b-0cd5-4890-81ed-730798b56a85 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:18.728343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:18.729132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:18.729703 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:18.730186 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] PATH_INFO: `/v3/users/590623c73f564c76a28bc996b245949c` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:18.731666 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=590623c73f564c76a28bc996b245949c)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:18.733798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:18.971752 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590623c73f564c76a28bc996b245949c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:19.043454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590623c73f564c76a28bc996b245949c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:19.057998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590623c73f564c76a28bc996b245949c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:19.065605 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590623c73f564c76a28bc996b245949c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:19.068383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590623c73f564c76a28bc996b245949c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:19.075004 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1358/2743] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:44:18 2022] DELETE /identity/v3/users/590623c73f564c76a28bc996b245949c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:44:19.416665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31811797-c2d9-4def-b0ee-6a4e3264bb17 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:19.435523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31811797-c2d9-4def-b0ee-6a4e3264bb17 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:19.501777 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:19.502462 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:19.502742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:19.503013 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] PATH_INFO: `/v3/projects/4d6794f496e84d02b536b4fd8df22f02` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:19.504828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6794f496e84d02b536b4fd8df22f02)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:19.506923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:19.656021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6794f496e84d02b536b4fd8df22f02', 'request_id': 'req-d96c672a-96df-43e1-a5af-a5c5225d0603'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:19.723738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6794f496e84d02b536b4fd8df22f02', 'request_id': 'req-d96c672a-96df-43e1-a5af-a5c5225d0603'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:19.729977 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6794f496e84d02b536b4fd8df22f02', 'request_id': 'req-d96c672a-96df-43e1-a5af-a5c5225d0603'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:19.742378 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] The token cache is being invalidate because project 4d6794f496e84d02b536b4fd8df22f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:44:19.742651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:19.743313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:19.744864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1386/2744] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:44:19 2022] DELETE /identity/v3/projects/4d6794f496e84d02b536b4fd8df22f02 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:44:19.748974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:19.750443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:19.764478 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df43f3a-748c-452f-aac3-686b417f1b39 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:19.821504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98234a38-0726-487c-9c9d-fb52733f6334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:19.822162 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98234a38-0726-487c-9c9d-fb52733f6334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:19.822443 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98234a38-0726-487c-9c9d-fb52733f6334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:19.822716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98234a38-0726-487c-9c9d-fb52733f6334 admin admin] PATH_INFO: `/v3/users/081645e61aba476ba8e980f4e8fa5eb6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:19.823841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98234a38-0726-487c-9c9d-fb52733f6334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=081645e61aba476ba8e980f4e8fa5eb6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:19.825819 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98234a38-0726-487c-9c9d-fb52733f6334 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:19.839071 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:20.011488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-98234a38-0726-487c-9c9d-fb52733f6334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081645e61aba476ba8e980f4e8fa5eb6'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:20.100707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-98234a38-0726-487c-9c9d-fb52733f6334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081645e61aba476ba8e980f4e8fa5eb6'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:20.114259 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-98234a38-0726-487c-9c9d-fb52733f6334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081645e61aba476ba8e980f4e8fa5eb6'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:20.121201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-98234a38-0726-487c-9c9d-fb52733f6334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081645e61aba476ba8e980f4e8fa5eb6'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:20.122008 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-98234a38-0726-487c-9c9d-fb52733f6334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081645e61aba476ba8e980f4e8fa5eb6'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:20.128143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1359/2745] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:44:19 2022] DELETE /identity/v3/users/081645e61aba476ba8e980f4e8fa5eb6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:44:20.388358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:20.395343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:20.404438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c672a-96df-43e1-a5af-a5c5225d0603 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:20.468011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:20.468733 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:20.468928 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:20.469202 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] PATH_INFO: `/v3/projects/9277114c51d44613a6535fcb01d08dc2` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:20.470397 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9277114c51d44613a6535fcb01d08dc2)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:20.472330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:20.575854 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:20.587994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9277114c51d44613a6535fcb01d08dc2', 'request_id': 'req-0329f4d7-9849-43f4-9418-4c7f95514137'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:20.666113 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9277114c51d44613a6535fcb01d08dc2', 'request_id': 'req-0329f4d7-9849-43f4-9418-4c7f95514137'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:20.672638 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9277114c51d44613a6535fcb01d08dc2', 'request_id': 'req-0329f4d7-9849-43f4-9418-4c7f95514137'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:20.684329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] The token cache is being invalidate because project 9277114c51d44613a6535fcb01d08dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:44:20.684622 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:20.685313 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-0329f4d7-9849-43f4-9418-4c7f95514137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:20.686901 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1387/2746] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:44:20 2022] DELETE /identity/v3/projects/9277114c51d44613a6535fcb01d08dc2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:44:20.691953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4534b22-fe6c-4612-8acb-fcf1f3919b6c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:20.692239 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4534b22-fe6c-4612-8acb-fcf1f3919b6c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:20.692517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4534b22-fe6c-4612-8acb-fcf1f3919b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:20.754830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-d4534b22-fe6c-4612-8acb-fcf1f3919b6c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:20.756127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d4534b22-fe6c-4612-8acb-fcf1f3919b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:20.815120 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1360/2747] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:44:20.824315 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af4941-9b60-4c69-81b7-7f54fb28f2f4 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:20.824603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af4941-9b60-4c69-81b7-7f54fb28f2f4 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:20.824882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af4941-9b60-4c69-81b7-7f54fb28f2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:20.845597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a3af4941-9b60-4c69-81b7-7f54fb28f2f4 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:20.846746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a3af4941-9b60-4c69-81b7-7f54fb28f2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:20.855850 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1388/2748] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:44:20.860174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4534b22-fe6c-4612-8acb-fcf1f3919b6c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:20.870771 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4534b22-fe6c-4612-8acb-fcf1f3919b6c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:20.875576 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b8982-d828-45a7-9db9-38a214476205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:20.876191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b8982-d828-45a7-9db9-38a214476205 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:20.876469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b8982-d828-45a7-9db9-38a214476205 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:20.876746 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b8982-d828-45a7-9db9-38a214476205 admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:20.877414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b8982-d828-45a7-9db9-38a214476205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:44:20.877762 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b8982-d828-45a7-9db9-38a214476205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:20.879455 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b8982-d828-45a7-9db9-38a214476205 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:20.893341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1361/2749] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 00:44:20.899019 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af4941-9b60-4c69-81b7-7f54fb28f2f4 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:20.908389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af4941-9b60-4c69-81b7-7f54fb28f2f4 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:20.913976 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34181ac-a54f-426e-a163-31463d622c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:20.914578 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34181ac-a54f-426e-a163-31463d622c51 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:20.914861 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34181ac-a54f-426e-a163-31463d622c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:20.915136 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34181ac-a54f-426e-a163-31463d622c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:20.915771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34181ac-a54f-426e-a163-31463d622c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:20.917716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34181ac-a54f-426e-a163-31463d622c51 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:21.022591 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1389/2750] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:44:20 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:44:21.027057 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b8982-d828-45a7-9db9-38a214476205 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:21.037910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b8982-d828-45a7-9db9-38a214476205 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:21.084718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:21.098511 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0d32d-1950-46fc-8525-c16ec401719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:21.099024 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0d32d-1950-46fc-8525-c16ec401719b admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:21.099307 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0d32d-1950-46fc-8525-c16ec401719b admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:21.099589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0d32d-1950-46fc-8525-c16ec401719b admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:21.100240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0d32d-1950-46fc-8525-c16ec401719b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:21.102205 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0d32d-1950-46fc-8525-c16ec401719b admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:21.238646 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1362/2751] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:44:21 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:44:21.244807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34181ac-a54f-426e-a163-31463d622c51 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:21.263901 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34181ac-a54f-426e-a163-31463d622c51 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:21.269086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33502d-e1af-4cf5-aa68-c9e1f5f65ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:21.269815 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33502d-e1af-4cf5-aa68-c9e1f5f65ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:21.270170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33502d-e1af-4cf5-aa68-c9e1f5f65ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:21.270630 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33502d-e1af-4cf5-aa68-c9e1f5f65ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:21.271426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33502d-e1af-4cf5-aa68-c9e1f5f65ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:21.273133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33502d-e1af-4cf5-aa68-c9e1f5f65ae3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:21.283859 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1390/2752] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:44:21.288800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0d32d-1950-46fc-8525-c16ec401719b admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:21.299333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0d32d-1950-46fc-8525-c16ec401719b admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:21.305889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d425e-568a-4b68-be7f-ac0ae2d19b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:21.306497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d425e-568a-4b68-be7f-ac0ae2d19b07 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:21.306784 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d425e-568a-4b68-be7f-ac0ae2d19b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:21.307188 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d425e-568a-4b68-be7f-ac0ae2d19b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:21.307846 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d425e-568a-4b68-be7f-ac0ae2d19b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:21.309618 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d425e-568a-4b68-be7f-ac0ae2d19b07 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:21.322591 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1363/2753] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:44:21.327002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33502d-e1af-4cf5-aa68-c9e1f5f65ae3 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:21.339730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33502d-e1af-4cf5-aa68-c9e1f5f65ae3 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:21.344651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a00b8c-6a64-49e1-b17f-906c449d33a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:21.345322 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a00b8c-6a64-49e1-b17f-906c449d33a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:21.345637 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a00b8c-6a64-49e1-b17f-906c449d33a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:21.345921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a00b8c-6a64-49e1-b17f-906c449d33a0 admin admin] PATH_INFO: `/v3/projects/d5c25cd5d3064fa381009025a22aa894/users/1c4cc9eae3cd45fb89e8bef0f220730f/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:21.361981 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a00b8c-6a64-49e1-b17f-906c449d33a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c25cd5d3064fa381009025a22aa894, user_id=1c4cc9eae3cd45fb89e8bef0f220730f, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:21.365348 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a00b8c-6a64-49e1-b17f-906c449d33a0 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:21.451466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1391/2754] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:44:21 2022] PUT /identity/v3/projects/d5c25cd5d3064fa381009025a22aa894/users/1c4cc9eae3cd45fb89e8bef0f220730f/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:44:21.462493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22c2f-fc30-44a6-a8bf-da7394b02cdc None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:21.462780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22c2f-fc30-44a6-a8bf-da7394b02cdc None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:21.463058 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa22c2f-fc30-44a6-a8bf-da7394b02cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:21.496341 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-4fa22c2f-fc30-44a6-a8bf-da7394b02cdc None None] MFA Rules not processed for user `1c4cc9eae3cd45fb89e8bef0f220730f`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:21.497612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4fa22c2f-fc30-44a6-a8bf-da7394b02cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:21.564595 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1364/2755] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:44:21.577442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a00b8c-6a64-49e1-b17f-906c449d33a0 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:21.579925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-25a00b8c-6a64-49e1-b17f-906c449d33a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:21.660607 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a00b8c-6a64-49e1-b17f-906c449d33a0 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:21.665225 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6d9f0-62c5-48df-a687-94e65b8a30fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:21.665900 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6d9f0-62c5-48df-a687-94e65b8a30fc service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:21.666196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6d9f0-62c5-48df-a687-94e65b8a30fc service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:21.666460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6d9f0-62c5-48df-a687-94e65b8a30fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:21.675604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6d9f0-62c5-48df-a687-94e65b8a30fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:21.677244 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6d9f0-62c5-48df-a687-94e65b8a30fc service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:21.686963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1392/2756] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:44:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:44:26.064719 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa22c2f-fc30-44a6-a8bf-da7394b02cdc None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:26.127990 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa22c2f-fc30-44a6-a8bf-da7394b02cdc None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:26.132589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:26.133251 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:26.133538 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:26.133851 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] PATH_INFO: `/v3/users/1c4cc9eae3cd45fb89e8bef0f220730f` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:26.135204 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4cc9eae3cd45fb89e8bef0f220730f)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:26.137142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:26.314458 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4cc9eae3cd45fb89e8bef0f220730f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:26.402621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4cc9eae3cd45fb89e8bef0f220730f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:26.405155 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:26.416717 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4cc9eae3cd45fb89e8bef0f220730f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:26.424127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4cc9eae3cd45fb89e8bef0f220730f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:26.425042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4cc9eae3cd45fb89e8bef0f220730f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:26.432321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1365/2757] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:44:26 2022] DELETE /identity/v3/users/1c4cc9eae3cd45fb89e8bef0f220730f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:44:26.437107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32930e6-d6a1-42aa-a1b1-1e978e1f933b None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:26.437939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32930e6-d6a1-42aa-a1b1-1e978e1f933b None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:26.437939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32930e6-d6a1-42aa-a1b1-1e978e1f933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:26.457489 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-f32930e6-d6a1-42aa-a1b1-1e978e1f933b None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:26.458835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f32930e6-d6a1-42aa-a1b1-1e978e1f933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:26.494658 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:26.521180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1393/2758] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:44:26.531749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:26.533197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:26.594665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67451e93-e5e1-427b-89b6-c4df25b893a9 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:26.599201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31baec31-1340-4a10-8936-378d6977c5dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:26.599814 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31baec31-1340-4a10-8936-378d6977c5dc service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:26.600097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31baec31-1340-4a10-8936-378d6977c5dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:26.600375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31baec31-1340-4a10-8936-378d6977c5dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:26.612007 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31baec31-1340-4a10-8936-378d6977c5dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:26.613671 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31baec31-1340-4a10-8936-378d6977c5dc service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:26.624460 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1366/2759] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:44:27.087177 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32930e6-d6a1-42aa-a1b1-1e978e1f933b None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:27.088677 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-f32930e6-d6a1-42aa-a1b1-1e978e1f933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:27.103229 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32930e6-d6a1-42aa-a1b1-1e978e1f933b None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:27.107932 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:27.108563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:27.108840 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:27.109158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] PATH_INFO: `/v3/projects/d5c25cd5d3064fa381009025a22aa894` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:27.111525 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c25cd5d3064fa381009025a22aa894)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:27.113445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:27.238388 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c25cd5d3064fa381009025a22aa894', 'request_id': 'req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:27.325704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c25cd5d3064fa381009025a22aa894', 'request_id': 'req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:27.332036 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c25cd5d3064fa381009025a22aa894', 'request_id': 'req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:27.345018 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] The token cache is being invalidate because project d5c25cd5d3064fa381009025a22aa894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:44:27.345306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:27.345998 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cf8d895a-9a5c-40e3-a9b2-cd93e78dcdcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:27.347490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1394/2760] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:44:27 2022] DELETE /identity/v3/projects/d5c25cd5d3064fa381009025a22aa894 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:44:27.353064 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db0093-ee1b-4afc-9f92-8b79366cd552 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:27.353596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db0093-ee1b-4afc-9f92-8b79366cd552 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:27.353710 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db0093-ee1b-4afc-9f92-8b79366cd552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:27.377693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-27db0093-ee1b-4afc-9f92-8b79366cd552 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:27.378975 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-27db0093-ee1b-4afc-9f92-8b79366cd552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:27.444829 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1367/2761] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:44:27.454005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adc9e0-987f-444f-9701-71946b8be795 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:27.454837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adc9e0-987f-444f-9701-71946b8be795 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:27.455016 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adc9e0-987f-444f-9701-71946b8be795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:27.475923 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-47adc9e0-987f-444f-9701-71946b8be795 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:27.477217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-47adc9e0-987f-444f-9701-71946b8be795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:27.485898 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1395/2762] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:44:27.490009 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db0093-ee1b-4afc-9f92-8b79366cd552 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:27.500589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db0093-ee1b-4afc-9f92-8b79366cd552 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:27.505400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdbfba-870f-4daf-bf8c-bec688028746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:27.506032 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdbfba-870f-4daf-bf8c-bec688028746 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:27.506306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdbfba-870f-4daf-bf8c-bec688028746 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:27.506575 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdbfba-870f-4daf-bf8c-bec688028746 admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:27.507247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdbfba-870f-4daf-bf8c-bec688028746 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:44:27.507548 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdbfba-870f-4daf-bf8c-bec688028746 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:27.510085 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdbfba-870f-4daf-bf8c-bec688028746 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:27.524785 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1368/2763] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:44:27.529913 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adc9e0-987f-444f-9701-71946b8be795 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:27.540107 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adc9e0-987f-444f-9701-71946b8be795 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:27.544903 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98e20b-2b7a-4dac-9a92-46d001e91695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:27.545507 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e20b-2b7a-4dac-9a92-46d001e91695 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:27.545825 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e20b-2b7a-4dac-9a92-46d001e91695 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:27.546156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98e20b-2b7a-4dac-9a92-46d001e91695 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:27.546802 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98e20b-2b7a-4dac-9a92-46d001e91695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:27.548723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98e20b-2b7a-4dac-9a92-46d001e91695 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:27.630050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdbfba-870f-4daf-bf8c-bec688028746 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:27.633047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bfbdbfba-870f-4daf-bf8c-bec688028746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:27.643781 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1396/2764] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:44:27 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:44:27.645171 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98e20b-2b7a-4dac-9a92-46d001e91695 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:27.703132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:27.715458 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98e20b-2b7a-4dac-9a92-46d001e91695 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:27.720302 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb66c8-b491-4787-beb0-4b69239a8556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:27.720920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb66c8-b491-4787-beb0-4b69239a8556 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:27.721199 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb66c8-b491-4787-beb0-4b69239a8556 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:27.721502 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb66c8-b491-4787-beb0-4b69239a8556 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:27.722167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb66c8-b491-4787-beb0-4b69239a8556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:27.724095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb66c8-b491-4787-beb0-4b69239a8556 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:27.731176 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdbfba-870f-4daf-bf8c-bec688028746 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:27.792601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c944d18-707f-49e2-9e98-685c588aa150 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:27.793198 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c944d18-707f-49e2-9e98-685c588aa150 service placement] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:27.793517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c944d18-707f-49e2-9e98-685c588aa150 service placement] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:27.793783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c944d18-707f-49e2-9e98-685c588aa150 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:27.795567 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8c944d18-707f-49e2-9e98-685c588aa150 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:27.807383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c944d18-707f-49e2-9e98-685c588aa150 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:27.808972 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c944d18-707f-49e2-9e98-685c588aa150 service placement] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:27.819112 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1369/2765] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:44:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:44:27.877532 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1397/2766] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:44:27 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:44:27.883616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c944d18-707f-49e2-9e98-685c588aa150 service placement] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:27.896709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c944d18-707f-49e2-9e98-685c588aa150 service placement] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:27.903109 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e797b-f8a2-4b56-9c26-0306753dd0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:27.903731 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e797b-f8a2-4b56-9c26-0306753dd0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:27.904053 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e797b-f8a2-4b56-9c26-0306753dd0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:27.904283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e797b-f8a2-4b56-9c26-0306753dd0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:27.905000 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e797b-f8a2-4b56-9c26-0306753dd0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:27.906602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e797b-f8a2-4b56-9c26-0306753dd0a3 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:27.917266 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1370/2767] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:44:27.921460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb66c8-b491-4787-beb0-4b69239a8556 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:27.932382 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb66c8-b491-4787-beb0-4b69239a8556 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:27.937841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ad5f7-2d18-4f75-ac32-983b87be7f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:27.938450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ad5f7-2d18-4f75-ac32-983b87be7f2c admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:27.938727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ad5f7-2d18-4f75-ac32-983b87be7f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:27.939003 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ad5f7-2d18-4f75-ac32-983b87be7f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:27.939675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ad5f7-2d18-4f75-ac32-983b87be7f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:27.941278 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ad5f7-2d18-4f75-ac32-983b87be7f2c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:27.953068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1398/2768] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:44:27.957504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e797b-f8a2-4b56-9c26-0306753dd0a3 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:27.968781 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e797b-f8a2-4b56-9c26-0306753dd0a3 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:27.973702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54273ffa-dbf6-4986-96bc-f264d8f237c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:27.974289 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273ffa-dbf6-4986-96bc-f264d8f237c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:27.974570 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273ffa-dbf6-4986-96bc-f264d8f237c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:27.974848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54273ffa-dbf6-4986-96bc-f264d8f237c1 admin admin] PATH_INFO: `/v3/projects/74a0f0dd7aa74634b9239008b2df29d4/users/8cf57c8e4dc94353bfacd012b3b38176/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:27.993748 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54273ffa-dbf6-4986-96bc-f264d8f237c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74a0f0dd7aa74634b9239008b2df29d4, user_id=8cf57c8e4dc94353bfacd012b3b38176, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:27.996539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54273ffa-dbf6-4986-96bc-f264d8f237c1 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:28.097269 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1371/2769] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:44:27 2022] PUT /identity/v3/projects/74a0f0dd7aa74634b9239008b2df29d4/users/8cf57c8e4dc94353bfacd012b3b38176/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:44:28.167908 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852f17-99b5-4e95-9068-f8a81456a3bf None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:28.168196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852f17-99b5-4e95-9068-f8a81456a3bf None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:28.168343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852f17-99b5-4e95-9068-f8a81456a3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:28.198608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:28.201407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-ea852f17-99b5-4e95-9068-f8a81456a3bf None None] MFA Rules not processed for user `8cf57c8e4dc94353bfacd012b3b38176`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:28.202758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ea852f17-99b5-4e95-9068-f8a81456a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:28.270877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1399/2770] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:44:28.283873 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54273ffa-dbf6-4986-96bc-f264d8f237c1 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:28.285930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-54273ffa-dbf6-4986-96bc-f264d8f237c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:28.355306 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54273ffa-dbf6-4986-96bc-f264d8f237c1 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:28.359041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b577581-1497-46f6-9355-b9a08a2be1a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8590378b14c49cf9266a0d859db5bf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:28.359653 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b577581-1497-46f6-9355-b9a08a2be1a4 service glance] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:28.359931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b577581-1497-46f6-9355-b9a08a2be1a4 service glance] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:28.360202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b577581-1497-46f6-9355-b9a08a2be1a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:28.372474 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b577581-1497-46f6-9355-b9a08a2be1a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:28.374001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b577581-1497-46f6-9355-b9a08a2be1a4 service glance] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:28.384383 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1372/2771] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:44:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:44:38.300442 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=26 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:38.379255 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=79,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:41.017702 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea852f17-99b5-4e95-9068-f8a81456a3bf None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:41.019845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ea852f17-99b5-4e95-9068-f8a81456a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:41.105491 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea852f17-99b5-4e95-9068-f8a81456a3bf None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:41.109165 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17f544-9581-48e3-b302-7d021616c1d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:41.109802 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f544-9581-48e3-b302-7d021616c1d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:41.110086 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f544-9581-48e3-b302-7d021616c1d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:41.110361 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f544-9581-48e3-b302-7d021616c1d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:41.112196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-dc17f544-9581-48e3-b302-7d021616c1d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:41.181894 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17f544-9581-48e3-b302-7d021616c1d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:41.183357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17f544-9581-48e3-b302-7d021616c1d4 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:41.193115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1400/2772] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:44:49.252168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b577581-1497-46f6-9355-b9a08a2be1a4 service glance] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:49.255278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-0b577581-1497-46f6-9355-b9a08a2be1a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:49.280275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b577581-1497-46f6-9355-b9a08a2be1a4 service glance] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:49.285097 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:49.286203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:49.286493 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:49.286783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] PATH_INFO: `/v3/users/d2bea5c77d2a47759d4ba925630c8d54` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:49.287940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2bea5c77d2a47759d4ba925630c8d54)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:49.290695 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:49.550012 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2bea5c77d2a47759d4ba925630c8d54'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:49.688470 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2bea5c77d2a47759d4ba925630c8d54'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:49.702626 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2bea5c77d2a47759d4ba925630c8d54'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:49.710021 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2bea5c77d2a47759d4ba925630c8d54'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:49.711263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2bea5c77d2a47759d4ba925630c8d54'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:49.718332 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1373/2773] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:44:49 2022] DELETE /identity/v3/users/d2bea5c77d2a47759d4ba925630c8d54 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:44:50.011276 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17f544-9581-48e3-b302-7d021616c1d4 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:50.023830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17f544-9581-48e3-b302-7d021616c1d4 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:50.096380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:50.097412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:50.098830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:50.099297 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] PATH_INFO: `/v3/projects/64d454f048144c1cbd4f18e48e1ba50c` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:50.101795 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d454f048144c1cbd4f18e48e1ba50c)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:50.104551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:50.204565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:50.223147 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d454f048144c1cbd4f18e48e1ba50c', 'request_id': 'req-8c2c4356-cd34-4f96-b8c4-d1640835cd45'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:50.276172 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d454f048144c1cbd4f18e48e1ba50c', 'request_id': 'req-8c2c4356-cd34-4f96-b8c4-d1640835cd45'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:50.286105 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d454f048144c1cbd4f18e48e1ba50c', 'request_id': 'req-8c2c4356-cd34-4f96-b8c4-d1640835cd45'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:50.299745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] The token cache is being invalidate because project 64d454f048144c1cbd4f18e48e1ba50c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:44:50.300042 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:50.300711 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:50.302259 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1401/2774] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:44:50 2022] DELETE /identity/v3/projects/64d454f048144c1cbd4f18e48e1ba50c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:44:50.306495 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:50.308136 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:50.323133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9c06-4cf9-424a-9976-70b5f206f612 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:50.386841 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:50.387483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:50.389020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:50.389020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] PATH_INFO: `/v3/users/2d2661bea7684cb29c8b41a966af9112` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:50.389210 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d2661bea7684cb29c8b41a966af9112)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:50.391227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:50.621448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d2661bea7684cb29c8b41a966af9112'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:50.715022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d2661bea7684cb29c8b41a966af9112'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:50.730321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d2661bea7684cb29c8b41a966af9112'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:50.732465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:50.737949 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d2661bea7684cb29c8b41a966af9112'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:50.738730 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d2661bea7684cb29c8b41a966af9112'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:50.745917 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1374/2775] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:44:50 2022] DELETE /identity/v3/users/2d2661bea7684cb29c8b41a966af9112 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:44:51.010716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:51.011937 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:51.030800 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c4356-cd34-4f96-b8c4-d1640835cd45 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:51.105719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:51.111124 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:51.111124 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:51.111124 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] PATH_INFO: `/v3/projects/6a972396f9b74eaa9bebee0769f2fa8a` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:51.111124 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a972396f9b74eaa9bebee0769f2fa8a)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:51.112309 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:51.246273 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a972396f9b74eaa9bebee0769f2fa8a', 'request_id': 'req-a14a19bb-e69a-4151-ba0a-e4d7ed339095'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:51.384758 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a972396f9b74eaa9bebee0769f2fa8a', 'request_id': 'req-a14a19bb-e69a-4151-ba0a-e4d7ed339095'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:51.395440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a972396f9b74eaa9bebee0769f2fa8a', 'request_id': 'req-a14a19bb-e69a-4151-ba0a-e4d7ed339095'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:51.409510 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] The token cache is being invalidate because project 6a972396f9b74eaa9bebee0769f2fa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:44:51.409827 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:51.410517 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-a14a19bb-e69a-4151-ba0a-e4d7ed339095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:51.412017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1402/2776] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:44:51 2022] DELETE /identity/v3/projects/6a972396f9b74eaa9bebee0769f2fa8a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:44:54.260747 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:54.263185 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:54.276415 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f693e34-4c5b-426b-8b21-1fc4449ab981 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:54.339351 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:54.339895 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:54.340177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:54.340454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] PATH_INFO: `/v3/users/8cf57c8e4dc94353bfacd012b3b38176` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:54.341638 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf57c8e4dc94353bfacd012b3b38176)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:54.343617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:54.565361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf57c8e4dc94353bfacd012b3b38176'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:54.631388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf57c8e4dc94353bfacd012b3b38176'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:54.648314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf57c8e4dc94353bfacd012b3b38176'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:54.658327 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf57c8e4dc94353bfacd012b3b38176'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:54.659082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf57c8e4dc94353bfacd012b3b38176'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:54.666356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1375/2777] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:44:54 2022] DELETE /identity/v3/users/8cf57c8e4dc94353bfacd012b3b38176 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:44:54.672146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebd0ab-12da-4627-a270-ed9a84e78608 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:54.672670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebd0ab-12da-4627-a270-ed9a84e78608 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:54.672783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebd0ab-12da-4627-a270-ed9a84e78608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:54.695973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-06ebd0ab-12da-4627-a270-ed9a84e78608 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:54.697505 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-06ebd0ab-12da-4627-a270-ed9a84e78608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:54.760867 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:54.775699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1403/2778] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:44:54.786010 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:54.791516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:54.834431 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe7682-5341-4f7a-bdca-4c31a9861872 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:54.835081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe7682-5341-4f7a-bdca-4c31a9861872 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:54.835081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe7682-5341-4f7a-bdca-4c31a9861872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:54.850970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc4276-a3a5-4291-b534-80b35fa07d51 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:54.855247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132d339-73f1-450b-8699-50bdcfd03a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:54.855868 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d339-73f1-450b-8699-50bdcfd03a72 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:54.856160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d339-73f1-450b-8699-50bdcfd03a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:54.856432 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132d339-73f1-450b-8699-50bdcfd03a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:54.861363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-30fe7682-5341-4f7a-bdca-4c31a9861872 None None] MFA Rules not processed for user `014a42fa07b74ba790995d04c74c5ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:54.862602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-30fe7682-5341-4f7a-bdca-4c31a9861872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:54.875096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132d339-73f1-450b-8699-50bdcfd03a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:54.875096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132d339-73f1-450b-8699-50bdcfd03a72 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:54.886023 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1376/2779] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:44:54.936441 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1404/2780] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:44:55.409709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132d339-73f1-450b-8699-50bdcfd03a72 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:55.409709 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5132d339-73f1-450b-8699-50bdcfd03a72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:55.425613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132d339-73f1-450b-8699-50bdcfd03a72 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:55.445334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:55.446679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:55.446679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:55.446900 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] PATH_INFO: `/v3/projects/74a0f0dd7aa74634b9239008b2df29d4` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:55.448020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74a0f0dd7aa74634b9239008b2df29d4)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:55.450036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:55.463881 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:55.586174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a0f0dd7aa74634b9239008b2df29d4', 'request_id': 'req-c0f052a0-a8a7-43be-a930-dedc528a2c18'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:55.593243 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a0f0dd7aa74634b9239008b2df29d4', 'request_id': 'req-c0f052a0-a8a7-43be-a930-dedc528a2c18'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:55.599689 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a0f0dd7aa74634b9239008b2df29d4', 'request_id': 'req-c0f052a0-a8a7-43be-a930-dedc528a2c18'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:55.671016 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] The token cache is being invalidate because project 74a0f0dd7aa74634b9239008b2df29d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:44:55.671233 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:55.671852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-c0f052a0-a8a7-43be-a930-dedc528a2c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:44:55.673342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1377/2781] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:44:55 2022] DELETE /identity/v3/projects/74a0f0dd7aa74634b9239008b2df29d4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:44:55.678392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36755164-9e85-45dd-84fb-7b7c8a5f7a73 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:55.679544 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36755164-9e85-45dd-84fb-7b7c8a5f7a73 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:55.679650 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36755164-9e85-45dd-84fb-7b7c8a5f7a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:55.702643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-36755164-9e85-45dd-84fb-7b7c8a5f7a73 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:55.703991 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-36755164-9e85-45dd-84fb-7b7c8a5f7a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:55.805142 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1405/2782] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:44:55.812920 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5acb0-18a5-4429-a7d8-a616c003f39a None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:55.813212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5acb0-18a5-4429-a7d8-a616c003f39a None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:55.813519 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5acb0-18a5-4429-a7d8-a616c003f39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:55.844310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-f2f5acb0-18a5-4429-a7d8-a616c003f39a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:55.845542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-f2f5acb0-18a5-4429-a7d8-a616c003f39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:55.858750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1378/2783] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:44:55.863909 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36755164-9e85-45dd-84fb-7b7c8a5f7a73 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:55.879163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36755164-9e85-45dd-84fb-7b7c8a5f7a73 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:55.888470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b00dc5-a5ab-4d78-b651-da13b9d36515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:55.889521 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b00dc5-a5ab-4d78-b651-da13b9d36515 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:55.890091 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b00dc5-a5ab-4d78-b651-da13b9d36515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:55.890608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b00dc5-a5ab-4d78-b651-da13b9d36515 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:55.892564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b00dc5-a5ab-4d78-b651-da13b9d36515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:44:55.893184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b00dc5-a5ab-4d78-b651-da13b9d36515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:55.896027 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b00dc5-a5ab-4d78-b651-da13b9d36515 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:55.915601 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1406/2784] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:44:55.921514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5acb0-18a5-4429-a7d8-a616c003f39a None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:55.934359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5acb0-18a5-4429-a7d8-a616c003f39a None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:55.940237 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae3ac4-ef86-444c-bec8-4dabe04612ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:55.940850 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae3ac4-ef86-444c-bec8-4dabe04612ed admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:55.941124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae3ac4-ef86-444c-bec8-4dabe04612ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:55.941439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae3ac4-ef86-444c-bec8-4dabe04612ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:55.942102 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae3ac4-ef86-444c-bec8-4dabe04612ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:55.944616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae3ac4-ef86-444c-bec8-4dabe04612ed admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:56.066691 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1379/2785] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:44:55 2022] POST /identity/v3/projects => generated 363 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:44:56.071196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b00dc5-a5ab-4d78-b651-da13b9d36515 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:56.082439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b00dc5-a5ab-4d78-b651-da13b9d36515 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:56.152379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a6db9-2a42-4a73-adc5-93c0bfe35e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:56.153336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6db9-2a42-4a73-adc5-93c0bfe35e92 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:56.153852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6db9-2a42-4a73-adc5-93c0bfe35e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:56.154146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6db9-2a42-4a73-adc5-93c0bfe35e92 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:56.154787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a6db9-2a42-4a73-adc5-93c0bfe35e92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:56.156789 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a6db9-2a42-4a73-adc5-93c0bfe35e92 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:56.254341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1407/2786] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:44:56 2022] POST /identity/v3/users => generated 282 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:44:56.259440 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae3ac4-ef86-444c-bec8-4dabe04612ed admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:56.270328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae3ac4-ef86-444c-bec8-4dabe04612ed admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:56.275824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1a379-29dd-4232-943f-2154fda60221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:56.276435 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a379-29dd-4232-943f-2154fda60221 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:56.276713 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a379-29dd-4232-943f-2154fda60221 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:56.276988 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a379-29dd-4232-943f-2154fda60221 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:56.277679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1a379-29dd-4232-943f-2154fda60221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:56.279287 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1a379-29dd-4232-943f-2154fda60221 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:56.290571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1380/2787] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:44:56.295026 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a6db9-2a42-4a73-adc5-93c0bfe35e92 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:56.305841 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a6db9-2a42-4a73-adc5-93c0bfe35e92 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:56.310603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582ee6a-ff70-44f0-84d9-e1eb5fa425b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:56.311203 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ee6a-ff70-44f0-84d9-e1eb5fa425b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:56.311484 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ee6a-ff70-44f0-84d9-e1eb5fa425b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:56.311757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582ee6a-ff70-44f0-84d9-e1eb5fa425b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:56.312400 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582ee6a-ff70-44f0-84d9-e1eb5fa425b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:56.314184 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582ee6a-ff70-44f0-84d9-e1eb5fa425b4 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:56.327772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1408/2788] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:44:56.332241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1a379-29dd-4232-943f-2154fda60221 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:56.344848 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1a379-29dd-4232-943f-2154fda60221 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:56.350857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fed623-5087-4b00-bb94-dec0b463faf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:56.351574 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed623-5087-4b00-bb94-dec0b463faf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:56.351852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed623-5087-4b00-bb94-dec0b463faf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:56.352124 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed623-5087-4b00-bb94-dec0b463faf9 admin admin] PATH_INFO: `/v3/projects/82cb10976d1e4f548b204e0a4b6111cd/users/94849a2a03e0425fb5c4a0df775aa14e/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:56.373503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fed623-5087-4b00-bb94-dec0b463faf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82cb10976d1e4f548b204e0a4b6111cd, user_id=94849a2a03e0425fb5c4a0df775aa14e, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:56.376223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fed623-5087-4b00-bb94-dec0b463faf9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:56.454740 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1381/2789] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:44:56 2022] PUT /identity/v3/projects/82cb10976d1e4f548b204e0a4b6111cd/users/94849a2a03e0425fb5c4a0df775aa14e/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:44:56.466692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aaa7f-f9f3-47b7-b41f-eb31ec54ffe5 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:56.466995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aaa7f-f9f3-47b7-b41f-eb31ec54ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:56.467258 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aaa7f-f9f3-47b7-b41f-eb31ec54ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:56.474646 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:44:56.497643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-435aaa7f-f9f3-47b7-b41f-eb31ec54ffe5 None None] MFA Rules not processed for user `94849a2a03e0425fb5c4a0df775aa14e`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:44:56.498938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-435aaa7f-f9f3-47b7-b41f-eb31ec54ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:56.568538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1409/2790] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:44:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:44:56.583778 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fed623-5087-4b00-bb94-dec0b463faf9 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:44:56.585886 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-19fed623-5087-4b00-bb94-dec0b463faf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:44:56.672611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fed623-5087-4b00-bb94-dec0b463faf9 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:44:56.676604 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c47e1-96d2-463b-b3d9-af377451a7e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:44:56.677240 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c47e1-96d2-463b-b3d9-af377451a7e0 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:44:56.677518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c47e1-96d2-463b-b3d9-af377451a7e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:44:56.677816 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c47e1-96d2-463b-b3d9-af377451a7e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:44:56.687952 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c47e1-96d2-463b-b3d9-af377451a7e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:44:56.689338 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c47e1-96d2-463b-b3d9-af377451a7e0 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:44:56.699561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1382/2791] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:44:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:45:06.693663 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=31 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:06.694296 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:32.408438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aaa7f-f9f3-47b7-b41f-eb31ec54ffe5 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:45:32.475573 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aaa7f-f9f3-47b7-b41f-eb31ec54ffe5 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:45:32.480254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:45:32.480892 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:45:32.481173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:45:32.481456 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] PATH_INFO: `/v3/users/94849a2a03e0425fb5c4a0df775aa14e` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:45:32.482690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=94849a2a03e0425fb5c4a0df775aa14e)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:45:32.484584 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:45:32.695784 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94849a2a03e0425fb5c4a0df775aa14e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:45:32.708485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94849a2a03e0425fb5c4a0df775aa14e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:45:32.715407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94849a2a03e0425fb5c4a0df775aa14e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:45:32.790125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94849a2a03e0425fb5c4a0df775aa14e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:45:32.790776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94849a2a03e0425fb5c4a0df775aa14e'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:45:32.797363 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1410/2792] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:45:32 2022] DELETE /identity/v3/users/94849a2a03e0425fb5c4a0df775aa14e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:45:32.801929 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ed16-ea62-47a4-b3a3-7fdf5a50d5a8 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:45:32.802434 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ed16-ea62-47a4-b3a3-7fdf5a50d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:45:32.802544 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ed16-ea62-47a4-b3a3-7fdf5a50d5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:45:32.826510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-5752ed16-ea62-47a4-b3a3-7fdf5a50d5a8 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:45:32.827994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5752ed16-ea62-47a4-b3a3-7fdf5a50d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:45:32.889308 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1383/2793] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:45:32.899351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:45:32.900771 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:45:32.959608 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e782b5-67f3-4ced-b7dc-eba4162f0a4b admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:45:32.963058 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fff643-4859-4509-b0f3-59aadd38a12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:45:32.963974 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fff643-4859-4509-b0f3-59aadd38a12b service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:45:32.964263 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fff643-4859-4509-b0f3-59aadd38a12b service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:45:32.964540 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fff643-4859-4509-b0f3-59aadd38a12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:45:32.973914 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fff643-4859-4509-b0f3-59aadd38a12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:45:32.975497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fff643-4859-4509-b0f3-59aadd38a12b service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:45:32.985369 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1411/2794] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:45:33.392856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ed16-ea62-47a4-b3a3-7fdf5a50d5a8 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:45:33.394426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-5752ed16-ea62-47a4-b3a3-7fdf5a50d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:45:33.408834 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ed16-ea62-47a4-b3a3-7fdf5a50d5a8 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:45:33.413890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:45:33.414667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:45:33.415008 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:45:33.415354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] PATH_INFO: `/v3/projects/82cb10976d1e4f548b204e0a4b6111cd` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:45:33.416833 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=82cb10976d1e4f548b204e0a4b6111cd)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:45:33.418938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:45:33.521852 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82cb10976d1e4f548b204e0a4b6111cd', 'request_id': 'req-b4909a84-5aa6-480d-8218-5be2bcdca36c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:45:33.527651 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82cb10976d1e4f548b204e0a4b6111cd', 'request_id': 'req-b4909a84-5aa6-480d-8218-5be2bcdca36c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:45:33.534681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82cb10976d1e4f548b204e0a4b6111cd', 'request_id': 'req-b4909a84-5aa6-480d-8218-5be2bcdca36c'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:45:33.635570 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] The token cache is being invalidate because project 82cb10976d1e4f548b204e0a4b6111cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:45:33.635856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:45:33.636483 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:45:33.638070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1384/2795] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:45:33 2022] DELETE /identity/v3/projects/82cb10976d1e4f548b204e0a4b6111cd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:45:42.980959 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:45:43.632275 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:02.878405 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facccb71-e90c-4d93-8328-71307eb37084 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:46:02.879002 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facccb71-e90c-4d93-8328-71307eb37084 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:46:02.879129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facccb71-e90c-4d93-8328-71307eb37084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:46:02.901242 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-facccb71-e90c-4d93-8328-71307eb37084 None None] MFA Rules not processed for user `014a42fa07b74ba790995d04c74c5ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:46:02.902565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-facccb71-e90c-4d93-8328-71307eb37084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:46:02.959461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1412/2796] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:46:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:46:12.951924 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=25 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:46:51.891518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:46:51.892932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:46:51.955358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4909a84-5aa6-480d-8218-5be2bcdca36c admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:46:51.959362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075b496-9d20-47fe-85c7-0c5eb56cedcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:46:51.962467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b496-9d20-47fe-85c7-0c5eb56cedcc service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:46:51.962467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b496-9d20-47fe-85c7-0c5eb56cedcc service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:46:51.962467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075b496-9d20-47fe-85c7-0c5eb56cedcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:46:51.962467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6075b496-9d20-47fe-85c7-0c5eb56cedcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:46:52.055908 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075b496-9d20-47fe-85c7-0c5eb56cedcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:46:52.057262 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075b496-9d20-47fe-85c7-0c5eb56cedcc service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:46:52.078585 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1385/2797] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:46:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:46:55.162012 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facccb71-e90c-4d93-8328-71307eb37084 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:46:55.163475 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-facccb71-e90c-4d93-8328-71307eb37084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:46:55.176457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facccb71-e90c-4d93-8328-71307eb37084 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:46:55.179955 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c331d6-c027-439b-87cd-6c67f773f569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:46:55.180554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c331d6-c027-439b-87cd-6c67f773f569 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:46:55.180830 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c331d6-c027-439b-87cd-6c67f773f569 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:46:55.181100 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c331d6-c027-439b-87cd-6c67f773f569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:46:55.183082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b7c331d6-c027-439b-87cd-6c67f773f569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:46:55.200699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c331d6-c027-439b-87cd-6c67f773f569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:46:55.202289 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c331d6-c027-439b-87cd-6c67f773f569 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:46:55.214407 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1413/2798] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:46:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:47:02.075935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=66 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:05.070210 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68a1fe-b062-4388-95f4-7a93d39555de None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:47:05.071166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68a1fe-b062-4388-95f4-7a93d39555de None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:47:05.071166 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68a1fe-b062-4388-95f4-7a93d39555de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:47:05.091532 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-4e68a1fe-b062-4388-95f4-7a93d39555de None None] MFA Rules not processed for user `014a42fa07b74ba790995d04c74c5ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:47:05.092768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4e68a1fe-b062-4388-95f4-7a93d39555de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:47:05.101410 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1386/2799] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:47:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:47:05.209244 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=6 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:15.085037 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:15.408261 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c331d6-c027-439b-87cd-6c67f773f569 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:47:15.411331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-b7c331d6-c027-439b-87cd-6c67f773f569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:47:15.429929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c331d6-c027-439b-87cd-6c67f773f569 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:47:15.435803 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc67ee-0106-415b-96ad-b14f39acdd2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:47:15.436425 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc67ee-0106-415b-96ad-b14f39acdd2c service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:47:15.436710 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc67ee-0106-415b-96ad-b14f39acdd2c service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:47:15.436986 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc67ee-0106-415b-96ad-b14f39acdd2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:47:15.438794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-68fc67ee-0106-415b-96ad-b14f39acdd2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:47:15.456762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc67ee-0106-415b-96ad-b14f39acdd2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:47:15.462623 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc67ee-0106-415b-96ad-b14f39acdd2c service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:47:15.471216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1414/2800] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:47:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:47:25.466087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=6 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:47:30.280436 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68a1fe-b062-4388-95f4-7a93d39555de None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:47:30.281934 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4e68a1fe-b062-4388-95f4-7a93d39555de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:47:30.340521 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68a1fe-b062-4388-95f4-7a93d39555de None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:47:30.344216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbdff8-49bd-4c1c-b847-6cd3acd233c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:47:30.344817 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbdff8-49bd-4c1c-b847-6cd3acd233c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:47:30.345101 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbdff8-49bd-4c1c-b847-6cd3acd233c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:47:30.345377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbdff8-49bd-4c1c-b847-6cd3acd233c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:47:30.347937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6dbbdff8-49bd-4c1c-b847-6cd3acd233c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:47:30.357776 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbdff8-49bd-4c1c-b847-6cd3acd233c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:47:30.359229 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbdff8-49bd-4c1c-b847-6cd3acd233c4 service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:47:30.368578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1387/2801] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:47:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:47:40.364598 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=26 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:04.768329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc67ee-0106-415b-96ad-b14f39acdd2c service nova] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:04.782216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc67ee-0106-415b-96ad-b14f39acdd2c service nova] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:04.788472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5cf96-74bb-47d6-8e6d-10973018c864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90147848fe604ca9912d10a214a45227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:04.789102 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5cf96-74bb-47d6-8e6d-10973018c864 service nova] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:04.789387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5cf96-74bb-47d6-8e6d-10973018c864 service nova] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:04.789725 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5cf96-74bb-47d6-8e6d-10973018c864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:04.791542 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-67e5cf96-74bb-47d6-8e6d-10973018c864 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:04.805939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5cf96-74bb-47d6-8e6d-10973018c864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:04.816535 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5cf96-74bb-47d6-8e6d-10973018c864 service nova] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:04.821518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1415/2802] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:48:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:48:14.818062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=6 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:15.325665 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbdff8-49bd-4c1c-b847-6cd3acd233c4 service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:15.327559 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6dbbdff8-49bd-4c1c-b847-6cd3acd233c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:15.425331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbdff8-49bd-4c1c-b847-6cd3acd233c4 service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:15.433608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d99a3-8f31-4c43-884d-a48571dc3f98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:15.434344 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d99a3-8f31-4c43-884d-a48571dc3f98 service placement] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:15.434564 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d99a3-8f31-4c43-884d-a48571dc3f98 service placement] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:15.434861 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d99a3-8f31-4c43-884d-a48571dc3f98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:15.437020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-c21d99a3-8f31-4c43-884d-a48571dc3f98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:15.451693 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d99a3-8f31-4c43-884d-a48571dc3f98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:15.453766 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d99a3-8f31-4c43-884d-a48571dc3f98 service placement] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:15.469608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1388/2803] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:48:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:48:15.477972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5cf96-74bb-47d6-8e6d-10973018c864 service nova] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:15.479462 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-67e5cf96-74bb-47d6-8e6d-10973018c864 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:15.562364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5cf96-74bb-47d6-8e6d-10973018c864 service nova] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:15.567082 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628ffd2-7f46-49f3-99e8-5782136a2483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:15.567742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628ffd2-7f46-49f3-99e8-5782136a2483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:15.568087 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628ffd2-7f46-49f3-99e8-5782136a2483 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:15.568364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628ffd2-7f46-49f3-99e8-5782136a2483 admin admin] PATH_INFO: `/v3/users/014a42fa07b74ba790995d04c74c5ea5` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:15.569666 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628ffd2-7f46-49f3-99e8-5782136a2483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014a42fa07b74ba790995d04c74c5ea5)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:15.571643 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628ffd2-7f46-49f3-99e8-5782136a2483 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:15.746029 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7628ffd2-7f46-49f3-99e8-5782136a2483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014a42fa07b74ba790995d04c74c5ea5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:15.763129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7628ffd2-7f46-49f3-99e8-5782136a2483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014a42fa07b74ba790995d04c74c5ea5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:15.775201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7628ffd2-7f46-49f3-99e8-5782136a2483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014a42fa07b74ba790995d04c74c5ea5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:15.827228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7628ffd2-7f46-49f3-99e8-5782136a2483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014a42fa07b74ba790995d04c74c5ea5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:15.828044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-7628ffd2-7f46-49f3-99e8-5782136a2483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014a42fa07b74ba790995d04c74c5ea5'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:15.835776 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1416/2804] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:48:15 2022] DELETE /identity/v3/users/014a42fa07b74ba790995d04c74c5ea5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:48:16.086200 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d99a3-8f31-4c43-884d-a48571dc3f98 service placement] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:16.100761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d99a3-8f31-4c43-884d-a48571dc3f98 service placement] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:16.165177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:16.165847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:16.166127 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:16.166398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] PATH_INFO: `/v3/projects/70c673fa396141f28dc81bd20e682e70` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:16.167541 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c673fa396141f28dc81bd20e682e70)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:16.169439 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:16.273914 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c673fa396141f28dc81bd20e682e70', 'request_id': 'req-84e8d5e6-7026-4faa-908e-45bc73e481aa'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:16.279659 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c673fa396141f28dc81bd20e682e70', 'request_id': 'req-84e8d5e6-7026-4faa-908e-45bc73e481aa'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:16.289082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c673fa396141f28dc81bd20e682e70', 'request_id': 'req-84e8d5e6-7026-4faa-908e-45bc73e481aa'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:16.370969 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] The token cache is being invalidate because project 70c673fa396141f28dc81bd20e682e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:48:16.371628 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:16.371886 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-84e8d5e6-7026-4faa-908e-45bc73e481aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:16.373386 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1389/2805] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:48:16 2022] DELETE /identity/v3/projects/70c673fa396141f28dc81bd20e682e70 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:48:16.378744 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae60d-572f-4ff8-8f8f-35729619d064 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:16.379070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae60d-572f-4ff8-8f8f-35729619d064 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:16.379434 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae60d-572f-4ff8-8f8f-35729619d064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:16.399176 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a44ae60d-572f-4ff8-8f8f-35729619d064 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:48:16.400380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a44ae60d-572f-4ff8-8f8f-35729619d064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:16.462284 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1417/2806] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:48:16.470241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f654d7-b9e4-49db-a2a9-8e36971c49f1 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:16.470518 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f654d7-b9e4-49db-a2a9-8e36971c49f1 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:16.470797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f654d7-b9e4-49db-a2a9-8e36971c49f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:16.492718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-90f654d7-b9e4-49db-a2a9-8e36971c49f1 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:48:16.493971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-90f654d7-b9e4-49db-a2a9-8e36971c49f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:16.502130 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1390/2807] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:48:16.506747 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ae60d-572f-4ff8-8f8f-35729619d064 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:16.517075 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ae60d-572f-4ff8-8f8f-35729619d064 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:16.522589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c46d8-28db-4ce9-95b0-b2ea39cd77c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:16.523196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c46d8-28db-4ce9-95b0-b2ea39cd77c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:16.523479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c46d8-28db-4ce9-95b0-b2ea39cd77c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:16.523754 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c46d8-28db-4ce9-95b0-b2ea39cd77c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:16.524618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c46d8-28db-4ce9-95b0-b2ea39cd77c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:48:16.524926 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c46d8-28db-4ce9-95b0-b2ea39cd77c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:16.526604 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c46d8-28db-4ce9-95b0-b2ea39cd77c3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:16.539553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1418/2808] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:48:16.544387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f654d7-b9e4-49db-a2a9-8e36971c49f1 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:16.556293 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f654d7-b9e4-49db-a2a9-8e36971c49f1 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:16.561527 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806bb52-9f93-4a2c-90bb-47c5b0d2fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:16.562174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806bb52-9f93-4a2c-90bb-47c5b0d2fd91 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:16.562453 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806bb52-9f93-4a2c-90bb-47c5b0d2fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:16.562725 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806bb52-9f93-4a2c-90bb-47c5b0d2fd91 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:16.563384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806bb52-9f93-4a2c-90bb-47c5b0d2fd91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:16.565308 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806bb52-9f93-4a2c-90bb-47c5b0d2fd91 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:16.579807 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:16.727084 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1391/2809] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:48:16 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:48:16.731437 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c46d8-28db-4ce9-95b0-b2ea39cd77c3 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:16.742420 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c46d8-28db-4ce9-95b0-b2ea39cd77c3 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:16.746538 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:16.803554 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71b152-bd7d-443b-a106-fc6685dc42c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:16.804167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71b152-bd7d-443b-a106-fc6685dc42c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:16.804450 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71b152-bd7d-443b-a106-fc6685dc42c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:16.804723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71b152-bd7d-443b-a106-fc6685dc42c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:16.805373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71b152-bd7d-443b-a106-fc6685dc42c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:16.807346 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71b152-bd7d-443b-a106-fc6685dc42c3 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:16.914476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1419/2810] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:48:16 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:48:16.918629 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806bb52-9f93-4a2c-90bb-47c5b0d2fd91 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:16.934973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806bb52-9f93-4a2c-90bb-47c5b0d2fd91 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:16.940890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad7a9-29fc-4d0b-a029-cf14edaf8ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:16.941863 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad7a9-29fc-4d0b-a029-cf14edaf8ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:16.942148 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad7a9-29fc-4d0b-a029-cf14edaf8ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:16.942421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad7a9-29fc-4d0b-a029-cf14edaf8ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:16.943177 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad7a9-29fc-4d0b-a029-cf14edaf8ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:16.944714 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad7a9-29fc-4d0b-a029-cf14edaf8ba6 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:16.956396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1392/2811] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:48:16.960904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71b152-bd7d-443b-a106-fc6685dc42c3 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:16.971204 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71b152-bd7d-443b-a106-fc6685dc42c3 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:16.977466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7c7f6-e88a-4e40-920d-f519743ebbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:16.978110 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7c7f6-e88a-4e40-920d-f519743ebbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:16.978393 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7c7f6-e88a-4e40-920d-f519743ebbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:16.978745 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7c7f6-e88a-4e40-920d-f519743ebbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:16.979730 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7c7f6-e88a-4e40-920d-f519743ebbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:16.981515 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7c7f6-e88a-4e40-920d-f519743ebbd7 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:16.994915 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1420/2812] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:48:16.999133 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad7a9-29fc-4d0b-a029-cf14edaf8ba6 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:17.009530 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad7a9-29fc-4d0b-a029-cf14edaf8ba6 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:17.014209 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104050-342d-4476-a372-8fb1e667eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:17.014963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104050-342d-4476-a372-8fb1e667eb53 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:17.015241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104050-342d-4476-a372-8fb1e667eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:17.015510 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41104050-342d-4476-a372-8fb1e667eb53 admin admin] PATH_INFO: `/v3/projects/6a0a8c164fea42f78ab4135efafb59e0/users/2f4f0b3f5c55479ba77500c93070ba9c/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:17.030903 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41104050-342d-4476-a372-8fb1e667eb53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0a8c164fea42f78ab4135efafb59e0, user_id=2f4f0b3f5c55479ba77500c93070ba9c, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:17.033716 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41104050-342d-4476-a372-8fb1e667eb53 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:17.124804 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1393/2813] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:48:16 2022] PUT /identity/v3/projects/6a0a8c164fea42f78ab4135efafb59e0/users/2f4f0b3f5c55479ba77500c93070ba9c/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:48:17.135886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181964ad-8d94-488d-88ad-fd5c3e85749a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:17.136173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181964ad-8d94-488d-88ad-fd5c3e85749a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:17.140219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181964ad-8d94-488d-88ad-fd5c3e85749a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:17.165940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-181964ad-8d94-488d-88ad-fd5c3e85749a None None] MFA Rules not processed for user `2f4f0b3f5c55479ba77500c93070ba9c`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:48:17.167158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-181964ad-8d94-488d-88ad-fd5c3e85749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:17.242670 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1421/2814] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:48:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:48:17.248902 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104050-342d-4476-a372-8fb1e667eb53 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:17.315722 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41104050-342d-4476-a372-8fb1e667eb53 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:17.321600 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ad600-3dd7-4fbc-9fa8-4222ffb48781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:17.322223 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ad600-3dd7-4fbc-9fa8-4222ffb48781 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:17.322508 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ad600-3dd7-4fbc-9fa8-4222ffb48781 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:17.322782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ad600-3dd7-4fbc-9fa8-4222ffb48781 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:17.323704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ad600-3dd7-4fbc-9fa8-4222ffb48781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:17.325656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ad600-3dd7-4fbc-9fa8-4222ffb48781 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:17.423196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1394/2815] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:48:17 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:48:17.427534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181964ad-8d94-488d-88ad-fd5c3e85749a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:17.442905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181964ad-8d94-488d-88ad-fd5c3e85749a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:17.517836 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec68656-1e9a-45a1-a251-38e841fd4d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:17.518495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec68656-1e9a-45a1-a251-38e841fd4d51 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:17.518787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec68656-1e9a-45a1-a251-38e841fd4d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:17.519054 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec68656-1e9a-45a1-a251-38e841fd4d51 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:17.519741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec68656-1e9a-45a1-a251-38e841fd4d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:17.522360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec68656-1e9a-45a1-a251-38e841fd4d51 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:17.606133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1422/2816] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:48:17 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:48:17.610290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ad600-3dd7-4fbc-9fa8-4222ffb48781 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:17.623588 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ad600-3dd7-4fbc-9fa8-4222ffb48781 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:17.632624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88934d2-3bc1-4560-8e98-caad154f532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:17.633514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88934d2-3bc1-4560-8e98-caad154f532e admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:17.633831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88934d2-3bc1-4560-8e98-caad154f532e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:17.634145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88934d2-3bc1-4560-8e98-caad154f532e admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:17.634876 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88934d2-3bc1-4560-8e98-caad154f532e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:17.636503 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88934d2-3bc1-4560-8e98-caad154f532e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:17.648969 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1395/2817] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:48:17.653668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec68656-1e9a-45a1-a251-38e841fd4d51 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:17.664432 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:17.671135 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec68656-1e9a-45a1-a251-38e841fd4d51 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:17.676722 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3583793-e36b-496b-b4e8-683be0801a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:17.678011 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3583793-e36b-496b-b4e8-683be0801a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:17.678303 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3583793-e36b-496b-b4e8-683be0801a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:17.678566 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3583793-e36b-496b-b4e8-683be0801a52 admin admin] PATH_INFO: `/v3/projects/d9aee02658734500a85845c6c1b9da22/users/bcd2f93d18cc498390a22a433589f978/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:17.697603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3583793-e36b-496b-b4e8-683be0801a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9aee02658734500a85845c6c1b9da22, user_id=bcd2f93d18cc498390a22a433589f978, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:17.700849 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3583793-e36b-496b-b4e8-683be0801a52 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:17.784819 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1423/2818] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:48:17 2022] PUT /identity/v3/projects/d9aee02658734500a85845c6c1b9da22/users/bcd2f93d18cc498390a22a433589f978/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:48:17.790626 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88934d2-3bc1-4560-8e98-caad154f532e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:17.809350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88934d2-3bc1-4560-8e98-caad154f532e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:17.888189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee5b03-c986-4b6e-bd50-786f97201173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:17.888857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5b03-c986-4b6e-bd50-786f97201173 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:17.889417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5b03-c986-4b6e-bd50-786f97201173 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:17.889417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee5b03-c986-4b6e-bd50-786f97201173 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:17.891096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee5b03-c986-4b6e-bd50-786f97201173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:17.891615 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee5b03-c986-4b6e-bd50-786f97201173 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:17.907143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1396/2819] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:48:17.914217 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3583793-e36b-496b-b4e8-683be0801a52 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:17.928746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3583793-e36b-496b-b4e8-683be0801a52 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:17.934975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f294e10-db2b-40e9-a29a-04fde678ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:17.935646 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294e10-db2b-40e9-a29a-04fde678ddbe admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:17.935952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294e10-db2b-40e9-a29a-04fde678ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:17.936228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f294e10-db2b-40e9-a29a-04fde678ddbe admin admin] PATH_INFO: `/v3/projects/d9aee02658734500a85845c6c1b9da22/users/bcd2f93d18cc498390a22a433589f978/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:17.938339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f294e10-db2b-40e9-a29a-04fde678ddbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9aee02658734500a85845c6c1b9da22, user_id=bcd2f93d18cc498390a22a433589f978, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:17.941129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f294e10-db2b-40e9-a29a-04fde678ddbe admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:17.955848 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1424/2820] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:48:17 2022] PUT /identity/v3/projects/d9aee02658734500a85845c6c1b9da22/users/bcd2f93d18cc498390a22a433589f978/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:48:17.971701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5be83-9956-4a8e-9b2e-0e05d1d7f02b None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:17.972045 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5be83-9956-4a8e-9b2e-0e05d1d7f02b None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:17.972400 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5be83-9956-4a8e-9b2e-0e05d1d7f02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:18.008398 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-2fc5be83-9956-4a8e-9b2e-0e05d1d7f02b None None] MFA Rules not processed for user `bcd2f93d18cc498390a22a433589f978`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:48:18.009963 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-2fc5be83-9956-4a8e-9b2e-0e05d1d7f02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:18.016812 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:18.102960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1397/2821] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:48:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:48:18.118441 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f294e10-db2b-40e9-a29a-04fde678ddbe admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:18.120267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4f294e10-db2b-40e9-a29a-04fde678ddbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:18.196438 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f294e10-db2b-40e9-a29a-04fde678ddbe admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:18.200996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0b6df-addf-4239-8554-8cdf9809f46f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:18.201763 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0b6df-addf-4239-8554-8cdf9809f46f service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:18.202057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0b6df-addf-4239-8554-8cdf9809f46f service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:18.202543 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0b6df-addf-4239-8554-8cdf9809f46f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:18.216869 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0b6df-addf-4239-8554-8cdf9809f46f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:18.219038 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0b6df-addf-4239-8554-8cdf9809f46f service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:18.236942 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1425/2822] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:48:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:48:18.437327 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5be83-9956-4a8e-9b2e-0e05d1d7f02b None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:18.449204 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5be83-9956-4a8e-9b2e-0e05d1d7f02b None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:18.453116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa86e4c-8c9d-4a99-8e1b-cc323c6ae1bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:18.453749 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa86e4c-8c9d-4a99-8e1b-cc323c6ae1bd service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:18.454030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa86e4c-8c9d-4a99-8e1b-cc323c6ae1bd service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:18.454377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa86e4c-8c9d-4a99-8e1b-cc323c6ae1bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:18.514824 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa86e4c-8c9d-4a99-8e1b-cc323c6ae1bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:18.516271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa86e4c-8c9d-4a99-8e1b-cc323c6ae1bd service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:18.526787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1398/2823] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:48:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:48:28.228439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:28.523336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=54 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:55.585306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0b6df-addf-4239-8554-8cdf9809f46f service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:55.650870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0b6df-addf-4239-8554-8cdf9809f46f service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:55.655534 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:55.656163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:55.656445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:55.656720 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] PATH_INFO: `/v3/users/2f4f0b3f5c55479ba77500c93070ba9c` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:55.657889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4f0b3f5c55479ba77500c93070ba9c)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:55.659864 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:55.852857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4f0b3f5c55479ba77500c93070ba9c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:55.866351 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4f0b3f5c55479ba77500c93070ba9c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:55.873308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4f0b3f5c55479ba77500c93070ba9c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:55.947282 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4f0b3f5c55479ba77500c93070ba9c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:55.948034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4f0b3f5c55479ba77500c93070ba9c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:55.955376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1426/2824] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:48:55 2022] DELETE /identity/v3/users/2f4f0b3f5c55479ba77500c93070ba9c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:48:55.960088 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a6fe-6db5-462c-b1b4-e8bb1a327e29 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:55.960577 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a6fe-6db5-462c-b1b4-e8bb1a327e29 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:55.962331 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a6fe-6db5-462c-b1b4-e8bb1a327e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:55.980681 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-32e1a6fe-6db5-462c-b1b4-e8bb1a327e29 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:48:55.981964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-32e1a6fe-6db5-462c-b1b4-e8bb1a327e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:56.041456 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1399/2825] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:48:56.052212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:56.053870 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:56.111715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c6eb2-f95b-4ae9-a0cc-82b8ccccaece admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:56.116115 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b52cf-1660-4083-bcfb-0f0d0e73e699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:56.116738 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b52cf-1660-4083-bcfb-0f0d0e73e699 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:56.117128 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b52cf-1660-4083-bcfb-0f0d0e73e699 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:56.117411 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b52cf-1660-4083-bcfb-0f0d0e73e699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:56.126678 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b52cf-1660-4083-bcfb-0f0d0e73e699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:56.128112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b52cf-1660-4083-bcfb-0f0d0e73e699 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:56.137897 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1427/2826] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:48:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:48:56.577017 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a6fe-6db5-462c-b1b4-e8bb1a327e29 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:56.580794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-32e1a6fe-6db5-462c-b1b4-e8bb1a327e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:56.593362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a6fe-6db5-462c-b1b4-e8bb1a327e29 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:56.598080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:56.600030 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:56.600321 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:56.600799 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] PATH_INFO: `/v3/projects/6a0a8c164fea42f78ab4135efafb59e0` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:56.602212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0a8c164fea42f78ab4135efafb59e0)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:56.604145 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:56.718468 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0a8c164fea42f78ab4135efafb59e0', 'request_id': 'req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:56.724897 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0a8c164fea42f78ab4135efafb59e0', 'request_id': 'req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:56.731140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0a8c164fea42f78ab4135efafb59e0', 'request_id': 'req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:56.843285 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] The token cache is being invalidate because project 6a0a8c164fea42f78ab4135efafb59e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:48:56.843566 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:56.844182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:56.845690 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1400/2827] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:48:56 2022] DELETE /identity/v3/projects/6a0a8c164fea42f78ab4135efafb59e0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:48:56.850905 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b52cf-1660-4083-bcfb-0f0d0e73e699 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:56.864863 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b52cf-1660-4083-bcfb-0f0d0e73e699 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:56.885835 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:56.925245 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f282968-d38b-475f-a289-8768c65894be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:56.925911 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f282968-d38b-475f-a289-8768c65894be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:56.926196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f282968-d38b-475f-a289-8768c65894be admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:56.926524 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f282968-d38b-475f-a289-8768c65894be admin admin] PATH_INFO: `/v3/users/bcd2f93d18cc498390a22a433589f978` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:56.927671 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f282968-d38b-475f-a289-8768c65894be admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd2f93d18cc498390a22a433589f978)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:56.929639 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f282968-d38b-475f-a289-8768c65894be admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:57.184826 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1f282968-d38b-475f-a289-8768c65894be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd2f93d18cc498390a22a433589f978'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:57.198021 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1f282968-d38b-475f-a289-8768c65894be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd2f93d18cc498390a22a433589f978'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:57.205345 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1f282968-d38b-475f-a289-8768c65894be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd2f93d18cc498390a22a433589f978'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:57.289493 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1f282968-d38b-475f-a289-8768c65894be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd2f93d18cc498390a22a433589f978'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:57.290146 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1f282968-d38b-475f-a289-8768c65894be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd2f93d18cc498390a22a433589f978'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:57.296511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1428/2828] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:48:56 2022] DELETE /identity/v3/users/bcd2f93d18cc498390a22a433589f978 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:48:57.697167 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:57.698970 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:57.714856 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637571b0-b719-4c0c-b09d-eca7fb3b5eaa admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:57.775638 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:57.776280 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:57.776539 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:57.776808 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] PATH_INFO: `/v3/projects/d9aee02658734500a85845c6c1b9da22` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:57.777956 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9aee02658734500a85845c6c1b9da22)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:57.779858 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:57.960797 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:57.977526 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9aee02658734500a85845c6c1b9da22', 'request_id': 'req-45425ef6-1d18-4acf-a182-2c8b08534752'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:57.983052 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9aee02658734500a85845c6c1b9da22', 'request_id': 'req-45425ef6-1d18-4acf-a182-2c8b08534752'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:57.989080 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9aee02658734500a85845c6c1b9da22', 'request_id': 'req-45425ef6-1d18-4acf-a182-2c8b08534752'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:58.079174 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] The token cache is being invalidate because project d9aee02658734500a85845c6c1b9da22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:48:58.079465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:58.080119 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-45425ef6-1d18-4acf-a182-2c8b08534752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:48:58.081743 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1401/2829] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:48:57 2022] DELETE /identity/v3/projects/d9aee02658734500a85845c6c1b9da22 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:48:58.087727 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bffc1-398e-4ae7-80ea-27f945b31915 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:58.088387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bffc1-398e-4ae7-80ea-27f945b31915 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:58.088387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295bffc1-398e-4ae7-80ea-27f945b31915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:58.109817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-295bffc1-398e-4ae7-80ea-27f945b31915 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:48:58.116439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-295bffc1-398e-4ae7-80ea-27f945b31915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:58.234954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1429/2830] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:48:58.242791 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95e306-2f60-485f-9842-262bdfffdf91 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:58.243079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95e306-2f60-485f-9842-262bdfffdf91 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:58.243361 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95e306-2f60-485f-9842-262bdfffdf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:58.270854 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-7e95e306-2f60-485f-9842-262bdfffdf91 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:48:58.272111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7e95e306-2f60-485f-9842-262bdfffdf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:58.281449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1402/2831] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:48:58.286053 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bffc1-398e-4ae7-80ea-27f945b31915 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:58.296137 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295bffc1-398e-4ae7-80ea-27f945b31915 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:58.301283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed93ee-541f-4424-83b9-3e550329fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:58.301917 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed93ee-541f-4424-83b9-3e550329fa12 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:58.302188 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed93ee-541f-4424-83b9-3e550329fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:58.302461 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed93ee-541f-4424-83b9-3e550329fa12 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:58.303123 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed93ee-541f-4424-83b9-3e550329fa12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:48:58.303426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed93ee-541f-4424-83b9-3e550329fa12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:58.305017 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed93ee-541f-4424-83b9-3e550329fa12 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:58.316853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1430/2832] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:48:58.322047 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95e306-2f60-485f-9842-262bdfffdf91 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:58.331804 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95e306-2f60-485f-9842-262bdfffdf91 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:58.337422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc2360-927d-4926-8ad8-e1026635f12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:58.338060 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc2360-927d-4926-8ad8-e1026635f12f admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:58.338343 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc2360-927d-4926-8ad8-e1026635f12f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:58.338612 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc2360-927d-4926-8ad8-e1026635f12f admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:58.339257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc2360-927d-4926-8ad8-e1026635f12f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:58.341168 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc2360-927d-4926-8ad8-e1026635f12f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:58.445967 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1403/2833] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:48:58 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:48:58.450379 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed93ee-541f-4424-83b9-3e550329fa12 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:58.461268 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed93ee-541f-4424-83b9-3e550329fa12 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:58.487530 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:58.519043 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c60c-0100-4b6d-8b28-89c7582fa6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:58.519661 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c60c-0100-4b6d-8b28-89c7582fa6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:58.519943 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c60c-0100-4b6d-8b28-89c7582fa6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:58.520218 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c60c-0100-4b6d-8b28-89c7582fa6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:58.520860 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c60c-0100-4b6d-8b28-89c7582fa6a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:58.523498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c60c-0100-4b6d-8b28-89c7582fa6a5 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:58.598359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1431/2834] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:48:58 2022] POST /identity/v3/users => generated 283 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:48:58.602798 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc2360-927d-4926-8ad8-e1026635f12f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:58.613039 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc2360-927d-4926-8ad8-e1026635f12f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:58.618783 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d8e8f-1d95-4360-ba93-1db1e4a02ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:58.619384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d8e8f-1d95-4360-ba93-1db1e4a02ced admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:58.619658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d8e8f-1d95-4360-ba93-1db1e4a02ced admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:58.619932 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d8e8f-1d95-4360-ba93-1db1e4a02ced admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:58.620582 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d8e8f-1d95-4360-ba93-1db1e4a02ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:58.622202 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d8e8f-1d95-4360-ba93-1db1e4a02ced admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:58.633273 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1404/2835] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:48:58.637376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c60c-0100-4b6d-8b28-89c7582fa6a5 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:58.647581 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c60c-0100-4b6d-8b28-89c7582fa6a5 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:58.652366 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98248e7-7abc-44e8-9201-93e432af99e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:58.652965 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98248e7-7abc-44e8-9201-93e432af99e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:58.653241 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98248e7-7abc-44e8-9201-93e432af99e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:58.653504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98248e7-7abc-44e8-9201-93e432af99e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:58.654167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98248e7-7abc-44e8-9201-93e432af99e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:58.655760 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98248e7-7abc-44e8-9201-93e432af99e5 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:58.665978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1432/2836] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:48:58.670419 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d8e8f-1d95-4360-ba93-1db1e4a02ced admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:58.680992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d8e8f-1d95-4360-ba93-1db1e4a02ced admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:58.685704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef8b50-98e7-458e-ab6f-92bfb82c76ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:58.686353 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8b50-98e7-458e-ab6f-92bfb82c76ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:58.686636 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8b50-98e7-458e-ab6f-92bfb82c76ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:58.686942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef8b50-98e7-458e-ab6f-92bfb82c76ec admin admin] PATH_INFO: `/v3/projects/08cef4b58b144ff797d301dd5fd92df1/users/000236a1fda4447482be2fa3e87522e2/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:58.702523 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef8b50-98e7-458e-ab6f-92bfb82c76ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=08cef4b58b144ff797d301dd5fd92df1, user_id=000236a1fda4447482be2fa3e87522e2, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:58.705201 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef8b50-98e7-458e-ab6f-92bfb82c76ec admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:58.764354 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1405/2837] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:48:58 2022] PUT /identity/v3/projects/08cef4b58b144ff797d301dd5fd92df1/users/000236a1fda4447482be2fa3e87522e2/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:48:58.776640 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2beb-3c9b-4683-9808-b0f89e6c374d None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:58.776947 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2beb-3c9b-4683-9808-b0f89e6c374d None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:58.777339 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae2beb-3c9b-4683-9808-b0f89e6c374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:58.809952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-4eae2beb-3c9b-4683-9808-b0f89e6c374d None None] MFA Rules not processed for user `000236a1fda4447482be2fa3e87522e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:48:58.811447 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-4eae2beb-3c9b-4683-9808-b0f89e6c374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:58.879856 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1433/2838] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:48:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:48:58.886215 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef8b50-98e7-458e-ab6f-92bfb82c76ec admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:58.953094 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef8b50-98e7-458e-ab6f-92bfb82c76ec admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:58.958103 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baab8d-5eb2-4491-b2fc-64d1aec63a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:58.958736 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baab8d-5eb2-4491-b2fc-64d1aec63a3d admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:58.959022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baab8d-5eb2-4491-b2fc-64d1aec63a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:58.959300 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baab8d-5eb2-4491-b2fc-64d1aec63a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:58.960930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baab8d-5eb2-4491-b2fc-64d1aec63a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:58.962960 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baab8d-5eb2-4491-b2fc-64d1aec63a3d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:59.079988 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1406/2839] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:48:58 2022] POST /identity/v3/projects => generated 363 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:48:59.084255 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae2beb-3c9b-4683-9808-b0f89e6c374d None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:59.095706 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae2beb-3c9b-4683-9808-b0f89e6c374d None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:59.153476 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b71c2b-f3ea-4173-8075-c8bc743761bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:59.154130 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b71c2b-f3ea-4173-8075-c8bc743761bf admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:59.154415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b71c2b-f3ea-4173-8075-c8bc743761bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:59.154693 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b71c2b-f3ea-4173-8075-c8bc743761bf admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:59.155347 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b71c2b-f3ea-4173-8075-c8bc743761bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:59.157287 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b71c2b-f3ea-4173-8075-c8bc743761bf admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:59.233372 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1434/2840] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:48:59 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:48:59.237469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baab8d-5eb2-4491-b2fc-64d1aec63a3d admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:59.247977 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baab8d-5eb2-4491-b2fc-64d1aec63a3d admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:59.252649 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0dd0-857c-4a16-9423-13292faddfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:59.253246 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0dd0-857c-4a16-9423-13292faddfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:59.253561 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0dd0-857c-4a16-9423-13292faddfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:59.254108 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db0dd0-857c-4a16-9423-13292faddfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:59.254469 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db0dd0-857c-4a16-9423-13292faddfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:59.256082 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db0dd0-857c-4a16-9423-13292faddfa8 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:59.267072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1407/2841] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:48:59.273035 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b71c2b-f3ea-4173-8075-c8bc743761bf admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:59.283423 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b71c2b-f3ea-4173-8075-c8bc743761bf admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:59.288996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7969a3-0ddd-4104-99f9-ece49b10e574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:59.290412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7969a3-0ddd-4104-99f9-ece49b10e574 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:59.290692 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7969a3-0ddd-4104-99f9-ece49b10e574 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:59.291490 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7969a3-0ddd-4104-99f9-ece49b10e574 admin admin] PATH_INFO: `/v3/projects/05d65a0dfb34414ca8cb6e79ca5158c3/users/7ae1902b270843e795a267b50e0519e2/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:59.306600 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7969a3-0ddd-4104-99f9-ece49b10e574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d65a0dfb34414ca8cb6e79ca5158c3, user_id=7ae1902b270843e795a267b50e0519e2, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:59.309240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7969a3-0ddd-4104-99f9-ece49b10e574 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:59.393364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1435/2842] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:48:59 2022] PUT /identity/v3/projects/05d65a0dfb34414ca8cb6e79ca5158c3/users/7ae1902b270843e795a267b50e0519e2/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:48:59.398197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0dd0-857c-4a16-9423-13292faddfa8 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:59.410634 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db0dd0-857c-4a16-9423-13292faddfa8 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:59.433855 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:59.473152 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e1800-1b81-4c54-9d60-30175719847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:59.473808 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e1800-1b81-4c54-9d60-30175719847f admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:59.474092 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e1800-1b81-4c54-9d60-30175719847f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:59.474365 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e1800-1b81-4c54-9d60-30175719847f admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:59.475545 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e1800-1b81-4c54-9d60-30175719847f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:59.477516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e1800-1b81-4c54-9d60-30175719847f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:59.487637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1408/2843] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:48:59.492539 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7969a3-0ddd-4104-99f9-ece49b10e574 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:59.498108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:48:59.503430 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7969a3-0ddd-4104-99f9-ece49b10e574 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:59.508515 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3034e-0191-4b95-a5d3-24233eb013d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:59.509170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3034e-0191-4b95-a5d3-24233eb013d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:59.509453 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3034e-0191-4b95-a5d3-24233eb013d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:59.509763 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3034e-0191-4b95-a5d3-24233eb013d0 admin admin] PATH_INFO: `/v3/projects/05d65a0dfb34414ca8cb6e79ca5158c3/users/7ae1902b270843e795a267b50e0519e2/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:59.511772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3034e-0191-4b95-a5d3-24233eb013d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d65a0dfb34414ca8cb6e79ca5158c3, user_id=7ae1902b270843e795a267b50e0519e2, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:59.514555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3034e-0191-4b95-a5d3-24233eb013d0 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:59.527014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1436/2844] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:48:59 2022] PUT /identity/v3/projects/05d65a0dfb34414ca8cb6e79ca5158c3/users/7ae1902b270843e795a267b50e0519e2/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:48:59.537414 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49b71-0099-4fb8-b10e-a6d001da8e8e None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:59.538418 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49b71-0099-4fb8-b10e-a6d001da8e8e None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:59.538700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49b71-0099-4fb8-b10e-a6d001da8e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:59.569733 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-13c49b71-0099-4fb8-b10e-a6d001da8e8e None None] MFA Rules not processed for user `7ae1902b270843e795a267b50e0519e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:48:59.571099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-13c49b71-0099-4fb8-b10e-a6d001da8e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:59.644334 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1409/2845] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:48:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:48:59.655140 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3034e-0191-4b95-a5d3-24233eb013d0 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:59.656858 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-02b3034e-0191-4b95-a5d3-24233eb013d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:48:59.715360 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3034e-0191-4b95-a5d3-24233eb013d0 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:59.719009 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d318b2c-4f22-4163-aa2f-a0b1dd62a9c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:59.719598 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d318b2c-4f22-4163-aa2f-a0b1dd62a9c4 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:59.719875 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d318b2c-4f22-4163-aa2f-a0b1dd62a9c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:59.720144 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d318b2c-4f22-4163-aa2f-a0b1dd62a9c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:48:59.729818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d318b2c-4f22-4163-aa2f-a0b1dd62a9c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:48:59.731246 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d318b2c-4f22-4163-aa2f-a0b1dd62a9c4 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:48:59.742240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1437/2846] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:48:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:48:59.966896 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c49b71-0099-4fb8-b10e-a6d001da8e8e None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:48:59.977907 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c49b71-0099-4fb8-b10e-a6d001da8e8e None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:48:59.982542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1348953-fc4d-400b-aa07-6fae704461c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:48:59.983368 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348953-fc4d-400b-aa07-6fae704461c2 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:48:59.983699 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348953-fc4d-400b-aa07-6fae704461c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:48:59.984046 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348953-fc4d-400b-aa07-6fae704461c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:00.043142 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1348953-fc4d-400b-aa07-6fae704461c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:00.044589 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1348953-fc4d-400b-aa07-6fae704461c2 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:00.054444 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1410/2847] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:48:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:49:08.984376 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d318b2c-4f22-4163-aa2f-a0b1dd62a9c4 service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:09.047078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d318b2c-4f22-4163-aa2f-a0b1dd62a9c4 service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:09.051752 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:09.052371 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:09.052666 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:09.053660 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] PATH_INFO: `/v3/users/000236a1fda4447482be2fa3e87522e2` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:09.054748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=000236a1fda4447482be2fa3e87522e2)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:09.056655 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:09.246523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000236a1fda4447482be2fa3e87522e2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:09.259043 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000236a1fda4447482be2fa3e87522e2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:09.266039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000236a1fda4447482be2fa3e87522e2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:09.346470 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000236a1fda4447482be2fa3e87522e2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:09.347101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000236a1fda4447482be2fa3e87522e2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:09.354169 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1438/2848] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:49:08 2022] DELETE /identity/v3/users/000236a1fda4447482be2fa3e87522e2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:49:09.358780 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d4ad2-eee5-49fc-a05d-bc023d415451 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:09.359277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d4ad2-eee5-49fc-a05d-bc023d415451 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:09.359409 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d4ad2-eee5-49fc-a05d-bc023d415451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:09.379782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-4e5d4ad2-eee5-49fc-a05d-bc023d415451 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:09.381257 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4e5d4ad2-eee5-49fc-a05d-bc023d415451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:09.423857 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=100 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:09.443422 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1411/2849] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:09.453987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:09.455798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:09.469129 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:09.514498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26bb28-076e-462b-8782-024f371cd521 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:09.518385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26d85e-c5c3-40df-b464-0fb1d9ea7bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:09.524494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26d85e-c5c3-40df-b464-0fb1d9ea7bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:09.524494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26d85e-c5c3-40df-b464-0fb1d9ea7bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:09.524494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26d85e-c5c3-40df-b464-0fb1d9ea7bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:09.529005 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26d85e-c5c3-40df-b464-0fb1d9ea7bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:09.530465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26d85e-c5c3-40df-b464-0fb1d9ea7bd7 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:09.540469 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1439/2850] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:49:10.102704 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d4ad2-eee5-49fc-a05d-bc023d415451 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:10.111964 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-4e5d4ad2-eee5-49fc-a05d-bc023d415451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:10.116915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d4ad2-eee5-49fc-a05d-bc023d415451 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:10.121971 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:10.122608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:10.122885 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:10.123158 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] PATH_INFO: `/v3/projects/08cef4b58b144ff797d301dd5fd92df1` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:10.124356 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08cef4b58b144ff797d301dd5fd92df1)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:10.126316 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:10.296255 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08cef4b58b144ff797d301dd5fd92df1', 'request_id': 'req-01dd92a7-a494-45d7-9fed-d4f300384d67'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:10.302040 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08cef4b58b144ff797d301dd5fd92df1', 'request_id': 'req-01dd92a7-a494-45d7-9fed-d4f300384d67'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:10.308910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08cef4b58b144ff797d301dd5fd92df1', 'request_id': 'req-01dd92a7-a494-45d7-9fed-d4f300384d67'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:10.392391 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] The token cache is being invalidate because project 08cef4b58b144ff797d301dd5fd92df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:49:10.393063 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:10.393242 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:10.395419 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1412/2851] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:49:10 2022] DELETE /identity/v3/projects/08cef4b58b144ff797d301dd5fd92df1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:10.400097 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26d85e-c5c3-40df-b464-0fb1d9ea7bd7 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:10.410073 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26d85e-c5c3-40df-b464-0fb1d9ea7bd7 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:10.481648 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e781783-1adb-48e3-910a-f4e7a898c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:10.482284 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e781783-1adb-48e3-910a-f4e7a898c377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:10.482563 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e781783-1adb-48e3-910a-f4e7a898c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:10.482837 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e781783-1adb-48e3-910a-f4e7a898c377 admin admin] PATH_INFO: `/v3/users/7ae1902b270843e795a267b50e0519e2` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:10.483967 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e781783-1adb-48e3-910a-f4e7a898c377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae1902b270843e795a267b50e0519e2)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:10.485929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e781783-1adb-48e3-910a-f4e7a898c377 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:10.668877 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5e781783-1adb-48e3-910a-f4e7a898c377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae1902b270843e795a267b50e0519e2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:10.681259 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5e781783-1adb-48e3-910a-f4e7a898c377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae1902b270843e795a267b50e0519e2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:10.688332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5e781783-1adb-48e3-910a-f4e7a898c377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae1902b270843e795a267b50e0519e2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:10.735095 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5e781783-1adb-48e3-910a-f4e7a898c377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae1902b270843e795a267b50e0519e2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:10.735715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-5e781783-1adb-48e3-910a-f4e7a898c377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae1902b270843e795a267b50e0519e2'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:10.743079 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1440/2852] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:49:10 2022] DELETE /identity/v3/users/7ae1902b270843e795a267b50e0519e2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:11.183028 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:11.184531 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:11.200148 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd92a7-a494-45d7-9fed-d4f300384d67 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:11.272983 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:11.273654 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:11.273938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:11.274212 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] PATH_INFO: `/v3/projects/05d65a0dfb34414ca8cb6e79ca5158c3` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:11.275375 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d65a0dfb34414ca8cb6e79ca5158c3)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:11.277295 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:11.381034 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d65a0dfb34414ca8cb6e79ca5158c3', 'request_id': 'req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:11.386772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d65a0dfb34414ca8cb6e79ca5158c3', 'request_id': 'req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:11.392940 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d65a0dfb34414ca8cb6e79ca5158c3', 'request_id': 'req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:11.467958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:11.472750 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] The token cache is being invalidate because project 05d65a0dfb34414ca8cb6e79ca5158c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:49:11.473038 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:11.473727 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-32f5a3c8-a2be-4ba6-befc-a424b1d02dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:11.479314 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1413/2853] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:49:11 2022] DELETE /identity/v3/projects/05d65a0dfb34414ca8cb6e79ca5158c3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:11.481046 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2676d6-4a75-4e71-b5b9-1e0ef40b8f58 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:11.481555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2676d6-4a75-4e71-b5b9-1e0ef40b8f58 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:11.481691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2676d6-4a75-4e71-b5b9-1e0ef40b8f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:11.503304 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-8e2676d6-4a75-4e71-b5b9-1e0ef40b8f58 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:11.504509 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-8e2676d6-4a75-4e71-b5b9-1e0ef40b8f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:11.535243 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:11.570329 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1441/2854] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:11.580005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae996a-e4e1-44fc-bdb1-871b08c0c153 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:11.580294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae996a-e4e1-44fc-bdb1-871b08c0c153 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:11.580617 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae996a-e4e1-44fc-bdb1-871b08c0c153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:11.602342 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-10ae996a-e4e1-44fc-bdb1-871b08c0c153 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:11.605633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-10ae996a-e4e1-44fc-bdb1-871b08c0c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:11.611772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1414/2855] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:11.616340 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2676d6-4a75-4e71-b5b9-1e0ef40b8f58 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:11.626579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2676d6-4a75-4e71-b5b9-1e0ef40b8f58 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:11.645262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf51b66-4a70-4d12-9ee1-b91ee70c6909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:11.645262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51b66-4a70-4d12-9ee1-b91ee70c6909 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:11.645262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51b66-4a70-4d12-9ee1-b91ee70c6909 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:11.645262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51b66-4a70-4d12-9ee1-b91ee70c6909 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:11.645787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf51b66-4a70-4d12-9ee1-b91ee70c6909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:49:11.645787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf51b66-4a70-4d12-9ee1-b91ee70c6909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:11.645787 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf51b66-4a70-4d12-9ee1-b91ee70c6909 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:11.647564 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1442/2856] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:49:11.652022 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae996a-e4e1-44fc-bdb1-871b08c0c153 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:11.664042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae996a-e4e1-44fc-bdb1-871b08c0c153 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:11.668836 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc0757-a9c8-412e-9a0c-1a8d36f4e91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:11.669465 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0757-a9c8-412e-9a0c-1a8d36f4e91a admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:11.672180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0757-a9c8-412e-9a0c-1a8d36f4e91a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:11.672180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc0757-a9c8-412e-9a0c-1a8d36f4e91a admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:11.672180 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc0757-a9c8-412e-9a0c-1a8d36f4e91a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:11.672742 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc0757-a9c8-412e-9a0c-1a8d36f4e91a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:11.758471 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1415/2857] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:49:11 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:11.762571 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf51b66-4a70-4d12-9ee1-b91ee70c6909 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:11.774628 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf51b66-4a70-4d12-9ee1-b91ee70c6909 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:11.833632 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87455-ec2f-44dc-9e00-4f44b41ce073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:11.834271 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87455-ec2f-44dc-9e00-4f44b41ce073 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:11.834548 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87455-ec2f-44dc-9e00-4f44b41ce073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:11.834817 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87455-ec2f-44dc-9e00-4f44b41ce073 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:11.835651 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb87455-ec2f-44dc-9e00-4f44b41ce073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:11.837406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb87455-ec2f-44dc-9e00-4f44b41ce073 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:11.930719 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1443/2858] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:49:11 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:11.935111 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc0757-a9c8-412e-9a0c-1a8d36f4e91a admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:11.946426 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc0757-a9c8-412e-9a0c-1a8d36f4e91a admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:11.951486 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c510cb8-2ba0-4061-a318-2105f5c3e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:11.952079 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c510cb8-2ba0-4061-a318-2105f5c3e0fa admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:11.952362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c510cb8-2ba0-4061-a318-2105f5c3e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:11.952633 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c510cb8-2ba0-4061-a318-2105f5c3e0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:11.953616 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c510cb8-2ba0-4061-a318-2105f5c3e0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:11.955218 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c510cb8-2ba0-4061-a318-2105f5c3e0fa admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:11.966729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1416/2859] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:11.978121 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87455-ec2f-44dc-9e00-4f44b41ce073 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:11.988327 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87455-ec2f-44dc-9e00-4f44b41ce073 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:11.993389 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc5e5e-494f-4fbd-9b66-64969ec3b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:11.994081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc5e5e-494f-4fbd-9b66-64969ec3b62d admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:11.994374 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc5e5e-494f-4fbd-9b66-64969ec3b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:11.994634 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc5e5e-494f-4fbd-9b66-64969ec3b62d admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:11.995267 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc5e5e-494f-4fbd-9b66-64969ec3b62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:11.996865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc5e5e-494f-4fbd-9b66-64969ec3b62d admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:12.007814 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1444/2860] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:12.013182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c510cb8-2ba0-4061-a318-2105f5c3e0fa admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:12.025267 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c510cb8-2ba0-4061-a318-2105f5c3e0fa admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:12.030637 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba4063-5996-4bfb-8042-c3daf7236fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:12.031516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba4063-5996-4bfb-8042-c3daf7236fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:12.031516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba4063-5996-4bfb-8042-c3daf7236fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:12.032140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba4063-5996-4bfb-8042-c3daf7236fc1 admin admin] PATH_INFO: `/v3/projects/a72993094aff49669e1c2f3e7cecd46f/users/0036b0fc52a845dba8dd68ba283dde5f/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:12.048346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba4063-5996-4bfb-8042-c3daf7236fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72993094aff49669e1c2f3e7cecd46f, user_id=0036b0fc52a845dba8dd68ba283dde5f, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:12.051175 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba4063-5996-4bfb-8042-c3daf7236fc1 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:12.147192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1417/2861] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:49:12 2022] PUT /identity/v3/projects/a72993094aff49669e1c2f3e7cecd46f/users/0036b0fc52a845dba8dd68ba283dde5f/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:12.214984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7c998-b46b-4eba-8f25-65c5ca51c446 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:12.215253 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7c998-b46b-4eba-8f25-65c5ca51c446 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:12.215523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7c998-b46b-4eba-8f25-65c5ca51c446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:12.243350 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-05e7c998-b46b-4eba-8f25-65c5ca51c446 None None] MFA Rules not processed for user `0036b0fc52a845dba8dd68ba283dde5f`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:12.244560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-05e7c998-b46b-4eba-8f25-65c5ca51c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:12.310228 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1445/2862] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:12.314757 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba4063-5996-4bfb-8042-c3daf7236fc1 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:12.379274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba4063-5996-4bfb-8042-c3daf7236fc1 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:12.385187 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2ba8f-0383-4a8e-955b-f05ee22cc11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:12.385825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2ba8f-0383-4a8e-955b-f05ee22cc11f admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:12.388745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2ba8f-0383-4a8e-955b-f05ee22cc11f admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:12.388745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2ba8f-0383-4a8e-955b-f05ee22cc11f admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:12.388745 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2ba8f-0383-4a8e-955b-f05ee22cc11f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:12.389099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2ba8f-0383-4a8e-955b-f05ee22cc11f admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:12.534377 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1418/2863] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:49:12 2022] POST /identity/v3/projects => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:49:12.539020 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7c998-b46b-4eba-8f25-65c5ca51c446 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:12.549972 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7c998-b46b-4eba-8f25-65c5ca51c446 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:12.577283 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:12.608533 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8dea-c097-4e18-98bd-a0dc897aac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:12.609186 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8dea-c097-4e18-98bd-a0dc897aac31 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:12.609466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8dea-c097-4e18-98bd-a0dc897aac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:12.609770 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a8dea-c097-4e18-98bd-a0dc897aac31 admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:12.610497 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a8dea-c097-4e18-98bd-a0dc897aac31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:12.612336 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a8dea-c097-4e18-98bd-a0dc897aac31 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:12.724675 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1446/2864] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:49:12 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:12.729888 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2ba8f-0383-4a8e-955b-f05ee22cc11f admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:12.740624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2ba8f-0383-4a8e-955b-f05ee22cc11f admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:12.745392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288df5f3-f72c-4308-a45a-6bb09f34580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:12.746025 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288df5f3-f72c-4308-a45a-6bb09f34580b admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:12.746302 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288df5f3-f72c-4308-a45a-6bb09f34580b admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:12.746571 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288df5f3-f72c-4308-a45a-6bb09f34580b admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:12.747219 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288df5f3-f72c-4308-a45a-6bb09f34580b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:12.748810 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288df5f3-f72c-4308-a45a-6bb09f34580b admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:12.759921 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1419/2865] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:12.764306 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8dea-c097-4e18-98bd-a0dc897aac31 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:12.775234 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a8dea-c097-4e18-98bd-a0dc897aac31 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:12.779938 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07df452-c724-4eb2-af46-41ab901963a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:12.780612 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07df452-c724-4eb2-af46-41ab901963a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:12.780878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07df452-c724-4eb2-af46-41ab901963a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:12.781163 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07df452-c724-4eb2-af46-41ab901963a1 admin admin] PATH_INFO: `/v3/projects/cd439872bcc44518aee73e5ae7d3fee7/users/bba36c31b5aa4e9faba32f06008e662e/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:12.799679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07df452-c724-4eb2-af46-41ab901963a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd439872bcc44518aee73e5ae7d3fee7, user_id=bba36c31b5aa4e9faba32f06008e662e, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:12.803759 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07df452-c724-4eb2-af46-41ab901963a1 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:12.924496 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1447/2866] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:49:12 2022] PUT /identity/v3/projects/cd439872bcc44518aee73e5ae7d3fee7/users/bba36c31b5aa4e9faba32f06008e662e/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:12.928679 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288df5f3-f72c-4308-a45a-6bb09f34580b admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:12.939950 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288df5f3-f72c-4308-a45a-6bb09f34580b admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:13.000170 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a9107-e555-4923-ad3d-41f02eac094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:13.000773 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9107-e555-4923-ad3d-41f02eac094d admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:13.001050 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9107-e555-4923-ad3d-41f02eac094d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:13.001320 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a9107-e555-4923-ad3d-41f02eac094d admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:13.001994 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a9107-e555-4923-ad3d-41f02eac094d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:13.003586 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a9107-e555-4923-ad3d-41f02eac094d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:13.014132 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1420/2867] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:13.018871 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07df452-c724-4eb2-af46-41ab901963a1 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:13.030778 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07df452-c724-4eb2-af46-41ab901963a1 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:13.035610 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e00f2-037a-4b05-bd3d-a4af37621a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:13.036269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e00f2-037a-4b05-bd3d-a4af37621a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:13.036553 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e00f2-037a-4b05-bd3d-a4af37621a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:13.036831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e00f2-037a-4b05-bd3d-a4af37621a3c admin admin] PATH_INFO: `/v3/projects/cd439872bcc44518aee73e5ae7d3fee7/users/bba36c31b5aa4e9faba32f06008e662e/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:13.038987 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e00f2-037a-4b05-bd3d-a4af37621a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd439872bcc44518aee73e5ae7d3fee7, user_id=bba36c31b5aa4e9faba32f06008e662e, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:13.041807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e00f2-037a-4b05-bd3d-a4af37621a3c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:13.052214 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1448/2868] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:49:13 2022] PUT /identity/v3/projects/cd439872bcc44518aee73e5ae7d3fee7/users/bba36c31b5aa4e9faba32f06008e662e/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:13.062620 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de29da-bdf7-4cdc-9422-babd2011e9d6 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:13.067974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de29da-bdf7-4cdc-9422-babd2011e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:13.067974 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de29da-bdf7-4cdc-9422-babd2011e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:13.071951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:13.093271 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-a5de29da-bdf7-4cdc-9422-babd2011e9d6 None None] MFA Rules not processed for user `bba36c31b5aa4e9faba32f06008e662e`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:13.100305 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-a5de29da-bdf7-4cdc-9422-babd2011e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:13.169083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1421/2869] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:13.180685 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e00f2-037a-4b05-bd3d-a4af37621a3c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:13.182426 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-055e00f2-037a-4b05-bd3d-a4af37621a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:13.246511 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e00f2-037a-4b05-bd3d-a4af37621a3c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:13.253240 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cad98b-263d-40da-90b0-1fe2cf989e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:13.253487 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cad98b-263d-40da-90b0-1fe2cf989e84 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:13.253798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cad98b-263d-40da-90b0-1fe2cf989e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:13.254070 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cad98b-263d-40da-90b0-1fe2cf989e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:13.264960 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cad98b-263d-40da-90b0-1fe2cf989e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:13.266453 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cad98b-263d-40da-90b0-1fe2cf989e84 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:13.277373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1449/2870] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:49:16.267509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de29da-bdf7-4cdc-9422-babd2011e9d6 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:16.330937 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de29da-bdf7-4cdc-9422-babd2011e9d6 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:16.335596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:16.336425 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:16.338512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:16.338512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] PATH_INFO: `/v3/users/0036b0fc52a845dba8dd68ba283dde5f` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:16.338512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0036b0fc52a845dba8dd68ba283dde5f)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:16.340035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:16.520578 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0036b0fc52a845dba8dd68ba283dde5f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:16.672195 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0036b0fc52a845dba8dd68ba283dde5f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:16.685968 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0036b0fc52a845dba8dd68ba283dde5f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:16.693217 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0036b0fc52a845dba8dd68ba283dde5f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:16.693901 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0036b0fc52a845dba8dd68ba283dde5f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:16.701222 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1422/2871] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:49:16 2022] DELETE /identity/v3/users/0036b0fc52a845dba8dd68ba283dde5f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:49:16.705818 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a59c-7f17-481e-9cb3-fb6180f8f0e0 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:16.706286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a59c-7f17-481e-9cb3-fb6180f8f0e0 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:16.706392 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426a59c-7f17-481e-9cb3-fb6180f8f0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:16.726377 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-9426a59c-7f17-481e-9cb3-fb6180f8f0e0 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:16.727939 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9426a59c-7f17-481e-9cb3-fb6180f8f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:16.790551 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1450/2872] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:16.801263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:16.802724 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:16.814310 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:16.860462 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac010a9-1152-4e9d-9876-5f40fe629436 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:16.864099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a857a35-cfba-40a0-81f8-b1df0486b2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:16.864700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a857a35-cfba-40a0-81f8-b1df0486b2ed service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:16.864980 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a857a35-cfba-40a0-81f8-b1df0486b2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:16.865254 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a857a35-cfba-40a0-81f8-b1df0486b2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:16.875423 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a857a35-cfba-40a0-81f8-b1df0486b2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:16.876847 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a857a35-cfba-40a0-81f8-b1df0486b2ed service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:16.886772 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1423/2873] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:49:17.361420 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426a59c-7f17-481e-9cb3-fb6180f8f0e0 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:17.363557 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-9426a59c-7f17-481e-9cb3-fb6180f8f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:17.380592 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426a59c-7f17-481e-9cb3-fb6180f8f0e0 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:17.387555 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:17.388696 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:17.392723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:17.392723 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] PATH_INFO: `/v3/projects/a72993094aff49669e1c2f3e7cecd46f` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:17.394504 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72993094aff49669e1c2f3e7cecd46f)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:17.399305 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:17.425387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:17.528159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72993094aff49669e1c2f3e7cecd46f', 'request_id': 'req-1898ea49-5200-40f9-b1bd-c856df8b4cbe'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:17.603809 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72993094aff49669e1c2f3e7cecd46f', 'request_id': 'req-1898ea49-5200-40f9-b1bd-c856df8b4cbe'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:17.610249 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72993094aff49669e1c2f3e7cecd46f', 'request_id': 'req-1898ea49-5200-40f9-b1bd-c856df8b4cbe'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:17.627929 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] The token cache is being invalidate because project a72993094aff49669e1c2f3e7cecd46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:49:17.628224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:17.628888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:17.630481 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1451/2874] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:49:17 2022] DELETE /identity/v3/projects/a72993094aff49669e1c2f3e7cecd46f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:17.635261 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a857a35-cfba-40a0-81f8-b1df0486b2ed service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:17.645421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a857a35-cfba-40a0-81f8-b1df0486b2ed service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:17.720878 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4afc2d-bd62-441c-876d-1ae1f3ea388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:17.721514 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4afc2d-bd62-441c-876d-1ae1f3ea388a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:17.721825 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4afc2d-bd62-441c-876d-1ae1f3ea388a admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:17.722099 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4afc2d-bd62-441c-876d-1ae1f3ea388a admin admin] PATH_INFO: `/v3/users/bba36c31b5aa4e9faba32f06008e662e` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:17.724335 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4afc2d-bd62-441c-876d-1ae1f3ea388a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba36c31b5aa4e9faba32f06008e662e)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:17.726372 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4afc2d-bd62-441c-876d-1ae1f3ea388a admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:17.949631 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4c4afc2d-bd62-441c-876d-1ae1f3ea388a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba36c31b5aa4e9faba32f06008e662e'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:18.037999 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4c4afc2d-bd62-441c-876d-1ae1f3ea388a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba36c31b5aa4e9faba32f06008e662e'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:18.056977 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4c4afc2d-bd62-441c-876d-1ae1f3ea388a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba36c31b5aa4e9faba32f06008e662e'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:18.067635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4c4afc2d-bd62-441c-876d-1ae1f3ea388a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba36c31b5aa4e9faba32f06008e662e'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:18.068393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-4c4afc2d-bd62-441c-876d-1ae1f3ea388a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba36c31b5aa4e9faba32f06008e662e'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:18.076801 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1424/2875] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:49:17 2022] DELETE /identity/v3/users/bba36c31b5aa4e9faba32f06008e662e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:18.511793 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:18.513269 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:18.529154 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898ea49-5200-40f9-b1bd-c856df8b4cbe admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:18.598579 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:18.599668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:18.600148 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:18.600620 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] PATH_INFO: `/v3/projects/cd439872bcc44518aee73e5ae7d3fee7` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:18.602174 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd439872bcc44518aee73e5ae7d3fee7)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:18.604180 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:18.724767 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd439872bcc44518aee73e5ae7d3fee7', 'request_id': 'req-2895a88b-4ed1-4c31-9c08-3203866c3a18'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:18.821619 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd439872bcc44518aee73e5ae7d3fee7', 'request_id': 'req-2895a88b-4ed1-4c31-9c08-3203866c3a18'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:18.827975 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd439872bcc44518aee73e5ae7d3fee7', 'request_id': 'req-2895a88b-4ed1-4c31-9c08-3203866c3a18'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:18.839112 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] The token cache is being invalidate because project cd439872bcc44518aee73e5ae7d3fee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:49:18.839395 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:18.840039 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-2895a88b-4ed1-4c31-9c08-3203866c3a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:18.841523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1452/2876] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:49:18 2022] DELETE /identity/v3/projects/cd439872bcc44518aee73e5ae7d3fee7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:18.846599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c555512-41dc-4fae-bfe8-530753cab7e0 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:18.847067 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c555512-41dc-4fae-bfe8-530753cab7e0 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:18.847182 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c555512-41dc-4fae-bfe8-530753cab7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:18.867865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-6c555512-41dc-4fae-bfe8-530753cab7e0 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:18.869118 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-6c555512-41dc-4fae-bfe8-530753cab7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:18.896190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:18.928782 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1425/2877] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:18.938853 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3469-a3c8-43b9-bfbd-631503475fbc None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:18.939182 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3469-a3c8-43b9-bfbd-631503475fbc None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:18.939445 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d3469-a3c8-43b9-bfbd-631503475fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:18.960668 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-451d3469-a3c8-43b9-bfbd-631503475fbc None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:18.962109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-451d3469-a3c8-43b9-bfbd-631503475fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:18.970373 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1453/2878] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:49:18.974635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c555512-41dc-4fae-bfe8-530753cab7e0 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:18.985741 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c555512-41dc-4fae-bfe8-530753cab7e0 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:18.991090 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d4857-ca5b-4b62-89c9-d20aedcdf42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:18.992290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4857-ca5b-4b62-89c9-d20aedcdf42e admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:18.992546 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4857-ca5b-4b62-89c9-d20aedcdf42e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:18.992823 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4857-ca5b-4b62-89c9-d20aedcdf42e admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:18.993467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d4857-ca5b-4b62-89c9-d20aedcdf42e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:49:18.993830 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d4857-ca5b-4b62-89c9-d20aedcdf42e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:18.995454 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d4857-ca5b-4b62-89c9-d20aedcdf42e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:19.007415 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1426/2879] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:49:19.011794 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d3469-a3c8-43b9-bfbd-631503475fbc None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:19.021170 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d3469-a3c8-43b9-bfbd-631503475fbc None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:19.026060 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2b9a1-4de2-43de-82a9-12f88e103308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:19.026700 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2b9a1-4de2-43de-82a9-12f88e103308 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:19.026983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2b9a1-4de2-43de-82a9-12f88e103308 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:19.027262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2b9a1-4de2-43de-82a9-12f88e103308 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:19.027907 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2b9a1-4de2-43de-82a9-12f88e103308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:19.029872 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2b9a1-4de2-43de-82a9-12f88e103308 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:19.112798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1454/2880] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:49:19 2022] POST /identity/v3/projects => generated 401 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:19.117467 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d4857-ca5b-4b62-89c9-d20aedcdf42e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:19.127800 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d4857-ca5b-4b62-89c9-d20aedcdf42e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:19.185143 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478fd34-2a4e-43d9-a274-4df4612792e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:19.185787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478fd34-2a4e-43d9-a274-4df4612792e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:19.186072 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478fd34-2a4e-43d9-a274-4df4612792e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:19.186350 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478fd34-2a4e-43d9-a274-4df4612792e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:19.187002 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478fd34-2a4e-43d9-a274-4df4612792e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:19.188989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478fd34-2a4e-43d9-a274-4df4612792e3 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:19.267195 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1427/2881] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:49:19 2022] POST /identity/v3/users => generated 301 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 00:49:19.271665 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2b9a1-4de2-43de-82a9-12f88e103308 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:19.282704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2b9a1-4de2-43de-82a9-12f88e103308 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:19.287428 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a605d1-e3d8-4b09-a3ac-af01dbfd5e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:19.288063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a605d1-e3d8-4b09-a3ac-af01dbfd5e91 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:19.288801 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a605d1-e3d8-4b09-a3ac-af01dbfd5e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:19.289078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a605d1-e3d8-4b09-a3ac-af01dbfd5e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:19.289746 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a605d1-e3d8-4b09-a3ac-af01dbfd5e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:19.291341 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a605d1-e3d8-4b09-a3ac-af01dbfd5e91 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:19.293755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:19.304573 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1455/2882] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:19.309096 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478fd34-2a4e-43d9-a274-4df4612792e3 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:19.319744 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478fd34-2a4e-43d9-a274-4df4612792e3 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:19.325197 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dc88b-dd07-42b0-9eaa-1bce2d40ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:19.325831 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc88b-dd07-42b0-9eaa-1bce2d40ae56 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:19.326114 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc88b-dd07-42b0-9eaa-1bce2d40ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:19.326393 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc88b-dd07-42b0-9eaa-1bce2d40ae56 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:19.327035 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dc88b-dd07-42b0-9eaa-1bce2d40ae56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:19.328682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dc88b-dd07-42b0-9eaa-1bce2d40ae56 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:19.340998 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1428/2883] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:19.349077 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a605d1-e3d8-4b09-a3ac-af01dbfd5e91 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:19.358843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a605d1-e3d8-4b09-a3ac-af01dbfd5e91 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:19.365062 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdae56-c5fe-4391-9566-a0c7fc58c1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:19.365690 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdae56-c5fe-4391-9566-a0c7fc58c1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:19.365978 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdae56-c5fe-4391-9566-a0c7fc58c1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:19.366254 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdae56-c5fe-4391-9566-a0c7fc58c1b5 admin admin] PATH_INFO: `/v3/projects/411c09b3c426425999be88eba79271bc/users/bb882c785769431f83130c5f7ff29f9b/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:19.382633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdae56-c5fe-4391-9566-a0c7fc58c1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411c09b3c426425999be88eba79271bc, user_id=bb882c785769431f83130c5f7ff29f9b, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:19.385537 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdae56-c5fe-4391-9566-a0c7fc58c1b5 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:19.542494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1456/2884] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:49:19 2022] PUT /identity/v3/projects/411c09b3c426425999be88eba79271bc/users/bb882c785769431f83130c5f7ff29f9b/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:49:19.553093 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac0ac-2726-4c94-8241-26b5fcb6b338 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:19.553362 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac0ac-2726-4c94-8241-26b5fcb6b338 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:19.553676 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac0ac-2726-4c94-8241-26b5fcb6b338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:19.583337 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-835ac0ac-2726-4c94-8241-26b5fcb6b338 None None] MFA Rules not processed for user `bb882c785769431f83130c5f7ff29f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:19.584590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-835ac0ac-2726-4c94-8241-26b5fcb6b338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:19.654555 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1429/2885] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:19 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 00:49:19.659410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdae56-c5fe-4391-9566-a0c7fc58c1b5 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:19.725798 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdae56-c5fe-4391-9566-a0c7fc58c1b5 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:19.730523 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9bae6-4eba-494c-a594-9582163e88e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:19.731133 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9bae6-4eba-494c-a594-9582163e88e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:19.731415 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9bae6-4eba-494c-a594-9582163e88e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:19.731686 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9bae6-4eba-494c-a594-9582163e88e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:19.732317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9bae6-4eba-494c-a594-9582163e88e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:19.734479 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9bae6-4eba-494c-a594-9582163e88e4 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:19.829117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1457/2886] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:49:19 2022] POST /identity/v3/projects => generated 399 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:19.833608 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac0ac-2726-4c94-8241-26b5fcb6b338 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:19.845804 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac0ac-2726-4c94-8241-26b5fcb6b338 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:19.876290 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:19.910419 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6e79-b715-4b15-9d9a-ba7f9665e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:19.910958 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6e79-b715-4b15-9d9a-ba7f9665e8de admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:19.911237 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6e79-b715-4b15-9d9a-ba7f9665e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:19.911512 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ab6e79-b715-4b15-9d9a-ba7f9665e8de admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:19.912149 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6e79-b715-4b15-9d9a-ba7f9665e8de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:19.914889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ab6e79-b715-4b15-9d9a-ba7f9665e8de admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:20.056450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1430/2887] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:49:19 2022] POST /identity/v3/users => generated 306 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:20.060444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9bae6-4eba-494c-a594-9582163e88e4 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:20.071007 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9bae6-4eba-494c-a594-9582163e88e4 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:20.075831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b0a0e-b661-49ce-9b67-c55ed3b76e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:20.076422 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b0a0e-b661-49ce-9b67-c55ed3b76e1f admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:20.076699 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b0a0e-b661-49ce-9b67-c55ed3b76e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:20.076966 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b0a0e-b661-49ce-9b67-c55ed3b76e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:20.077618 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b0a0e-b661-49ce-9b67-c55ed3b76e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:20.079334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b0a0e-b661-49ce-9b67-c55ed3b76e1f admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:20.090602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1458/2888] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:20.094930 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6e79-b715-4b15-9d9a-ba7f9665e8de admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:20.106018 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ab6e79-b715-4b15-9d9a-ba7f9665e8de admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:20.110768 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbed062-14d1-4fee-87ab-134b7f787b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:20.111419 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed062-14d1-4fee-87ab-134b7f787b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:20.111702 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed062-14d1-4fee-87ab-134b7f787b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:20.111979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbed062-14d1-4fee-87ab-134b7f787b85 admin admin] PATH_INFO: `/v3/projects/0178741a41ac4b98b86e248f0b1e2afa/users/85cef1bac94c41f3b7c4494351539a3f/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:20.127105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbed062-14d1-4fee-87ab-134b7f787b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0178741a41ac4b98b86e248f0b1e2afa, user_id=85cef1bac94c41f3b7c4494351539a3f, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:20.129871 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbed062-14d1-4fee-87ab-134b7f787b85 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:20.227827 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1431/2889] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:49:20 2022] PUT /identity/v3/projects/0178741a41ac4b98b86e248f0b1e2afa/users/85cef1bac94c41f3b7c4494351539a3f/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:20.232109 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b0a0e-b661-49ce-9b67-c55ed3b76e1f admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:20.242823 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b0a0e-b661-49ce-9b67-c55ed3b76e1f admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:20.299674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5247a2a-9fb4-4f9b-8174-32af41ab14f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:20.300285 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5247a2a-9fb4-4f9b-8174-32af41ab14f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:20.300565 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5247a2a-9fb4-4f9b-8174-32af41ab14f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:20.300845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5247a2a-9fb4-4f9b-8174-32af41ab14f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:20.301485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5247a2a-9fb4-4f9b-8174-32af41ab14f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:20.303111 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5247a2a-9fb4-4f9b-8174-32af41ab14f8 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:20.312954 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1459/2890] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 00:49:20.318044 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbed062-14d1-4fee-87ab-134b7f787b85 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:20.329020 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbed062-14d1-4fee-87ab-134b7f787b85 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:20.333774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c55b58-530b-49e9-8286-b79c32f7f208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:20.334421 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c55b58-530b-49e9-8286-b79c32f7f208 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:20.334701 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c55b58-530b-49e9-8286-b79c32f7f208 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:20.334979 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c55b58-530b-49e9-8286-b79c32f7f208 admin admin] PATH_INFO: `/v3/projects/0178741a41ac4b98b86e248f0b1e2afa/users/85cef1bac94c41f3b7c4494351539a3f/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:20.337796 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c55b58-530b-49e9-8286-b79c32f7f208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0178741a41ac4b98b86e248f0b1e2afa, user_id=85cef1bac94c41f3b7c4494351539a3f, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:20.340449 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c55b58-530b-49e9-8286-b79c32f7f208 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:20.351658 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1432/2891] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:49:20 2022] PUT /identity/v3/projects/0178741a41ac4b98b86e248f0b1e2afa/users/85cef1bac94c41f3b7c4494351539a3f/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:20.363122 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668677-09ef-4c66-9398-96cf8c39745c None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:20.363412 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668677-09ef-4c66-9398-96cf8c39745c None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:20.363694 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6668677-09ef-4c66-9398-96cf8c39745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:20.393166 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-c6668677-09ef-4c66-9398-96cf8c39745c None None] MFA Rules not processed for user `85cef1bac94c41f3b7c4494351539a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:20.394821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-c6668677-09ef-4c66-9398-96cf8c39745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:20.427806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:20.473828 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1460/2892] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:20 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:20.486515 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c55b58-530b-49e9-8286-b79c32f7f208 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:20.488698 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-92c55b58-530b-49e9-8286-b79c32f7f208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:20.553089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c55b58-530b-49e9-8286-b79c32f7f208 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:20.557238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d2554-f763-4301-867f-2f6cd4bb55e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:20.557890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d2554-f763-4301-867f-2f6cd4bb55e1 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:20.558172 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d2554-f763-4301-867f-2f6cd4bb55e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:20.558446 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d2554-f763-4301-867f-2f6cd4bb55e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:20.568153 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d2554-f763-4301-867f-2f6cd4bb55e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:20.570189 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d2554-f763-4301-867f-2f6cd4bb55e1 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:20.580602 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1433/2893] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:20 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:49:20.818882 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6668677-09ef-4c66-9398-96cf8c39745c None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:20.830104 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6668677-09ef-4c66-9398-96cf8c39745c None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:20.833743 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd5455-e306-4879-936c-bdedf7b946a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:20.834335 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd5455-e306-4879-936c-bdedf7b946a7 service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:20.834611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd5455-e306-4879-936c-bdedf7b946a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:20.834883 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd5455-e306-4879-936c-bdedf7b946a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:20.894888 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd5455-e306-4879-936c-bdedf7b946a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:20.896480 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd5455-e306-4879-936c-bdedf7b946a7 service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:20.906014 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1461/2894] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:20 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:49:26.092929 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d2554-f763-4301-867f-2f6cd4bb55e1 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:26.156581 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d2554-f763-4301-867f-2f6cd4bb55e1 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:26.161247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:26.161923 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:26.162204 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:26.162476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] PATH_INFO: `/v3/users/bb882c785769431f83130c5f7ff29f9b` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:26.164667 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb882c785769431f83130c5f7ff29f9b)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:26.166640 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:26.189183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:26.424042 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb882c785769431f83130c5f7ff29f9b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:26.500890 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb882c785769431f83130c5f7ff29f9b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:26.514385 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb882c785769431f83130c5f7ff29f9b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:26.521551 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb882c785769431f83130c5f7ff29f9b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:26.522255 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb882c785769431f83130c5f7ff29f9b'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:26.529163 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1434/2895] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:49:26 2022] DELETE /identity/v3/users/bb882c785769431f83130c5f7ff29f9b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:26.533902 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725dd48-10e4-41f5-8116-6e605b201336 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:26.534402 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725dd48-10e4-41f5-8116-6e605b201336 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:26.534506 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725dd48-10e4-41f5-8116-6e605b201336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:26.554455 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-2725dd48-10e4-41f5-8116-6e605b201336 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:26.556034 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2725dd48-10e4-41f5-8116-6e605b201336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:26.616762 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1462/2896] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:26.626484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:26.627931 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:26.686312 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea545b3-9e20-41db-a27c-bd6fc45d7bbe admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:26.689927 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e97c49-168c-41a1-9f5e-8e13f5ccdbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:26.690540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97c49-168c-41a1-9f5e-8e13f5ccdbfc service neutron] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:26.690820 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97c49-168c-41a1-9f5e-8e13f5ccdbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:26.691095 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e97c49-168c-41a1-9f5e-8e13f5ccdbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:26.701624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e97c49-168c-41a1-9f5e-8e13f5ccdbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:26.703073 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e97c49-168c-41a1-9f5e-8e13f5ccdbfc service neutron] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:26.713382 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1435/2897] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:49:27.176742 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725dd48-10e4-41f5-8116-6e605b201336 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:27.178235 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-2725dd48-10e4-41f5-8116-6e605b201336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:27.191332 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725dd48-10e4-41f5-8116-6e605b201336 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:27.197200 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:27.197807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:27.198093 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:27.198370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] PATH_INFO: `/v3/projects/411c09b3c426425999be88eba79271bc` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:27.199775 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] RBAC: Authorizing `identity:delete_project(project_id=411c09b3c426425999be88eba79271bc)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:27.201865 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:27.312921 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411c09b3c426425999be88eba79271bc', 'request_id': 'req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:27.398843 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411c09b3c426425999be88eba79271bc', 'request_id': 'req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:27.404728 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:27.406175 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411c09b3c426425999be88eba79271bc', 'request_id': 'req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:27.418994 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] The token cache is being invalidate because project 411c09b3c426425999be88eba79271bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:49:27.419317 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:27.419963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:27.421466 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1463/2898] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:49:27 2022] DELETE /identity/v3/projects/411c09b3c426425999be88eba79271bc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:27.425672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e97c49-168c-41a1-9f5e-8e13f5ccdbfc service neutron] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:27.436631 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e97c49-168c-41a1-9f5e-8e13f5ccdbfc service neutron] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:27.495645 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2261b18-97bf-43ba-a4cc-c231ec119caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:27.496276 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2261b18-97bf-43ba-a4cc-c231ec119caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:27.496557 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2261b18-97bf-43ba-a4cc-c231ec119caa admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:27.496835 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2261b18-97bf-43ba-a4cc-c231ec119caa admin admin] PATH_INFO: `/v3/users/85cef1bac94c41f3b7c4494351539a3f` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:27.497992 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2261b18-97bf-43ba-a4cc-c231ec119caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cef1bac94c41f3b7c4494351539a3f)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:27.499910 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2261b18-97bf-43ba-a4cc-c231ec119caa admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:27.806263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:27.807870 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d2261b18-97bf-43ba-a4cc-c231ec119caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cef1bac94c41f3b7c4494351539a3f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:27.980347 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d2261b18-97bf-43ba-a4cc-c231ec119caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cef1bac94c41f3b7c4494351539a3f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:27.993213 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d2261b18-97bf-43ba-a4cc-c231ec119caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cef1bac94c41f3b7c4494351539a3f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:28.014668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d2261b18-97bf-43ba-a4cc-c231ec119caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cef1bac94c41f3b7c4494351539a3f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:28.014668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-d2261b18-97bf-43ba-a4cc-c231ec119caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cef1bac94c41f3b7c4494351539a3f'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:28.014668 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1436/2899] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:49:27 2022] DELETE /identity/v3/users/85cef1bac94c41f3b7c4494351539a3f => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:28.439414 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:28.441028 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:28.456585 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6bca0-feab-4d1a-9d82-06ebfd67a3db admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:28.515050 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:28.515674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:28.515952 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:28.516439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] PATH_INFO: `/v3/projects/0178741a41ac4b98b86e248f0b1e2afa` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:28.517440 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0178741a41ac4b98b86e248f0b1e2afa)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:28.519364 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:28.628810 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0178741a41ac4b98b86e248f0b1e2afa', 'request_id': 'req-946c6c9e-9b23-42e6-89d0-999d05eabd87'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:28.707044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0178741a41ac4b98b86e248f0b1e2afa', 'request_id': 'req-946c6c9e-9b23-42e6-89d0-999d05eabd87'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:28.713127 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0178741a41ac4b98b86e248f0b1e2afa', 'request_id': 'req-946c6c9e-9b23-42e6-89d0-999d05eabd87'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:28.724597 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] The token cache is being invalidate because project 0178741a41ac4b98b86e248f0b1e2afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:49:28.726081 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:28.726224 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-946c6c9e-9b23-42e6-89d0-999d05eabd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:28.727599 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1464/2900] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:49:28 2022] DELETE /identity/v3/projects/0178741a41ac4b98b86e248f0b1e2afa => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:28.732763 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6430c6-db44-405c-add0-e487a8f9399c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:28.733336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6430c6-db44-405c-add0-e487a8f9399c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:28.733336 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6430c6-db44-405c-add0-e487a8f9399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:28.754283 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-8e6430c6-db44-405c-add0-e487a8f9399c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:28.755488 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-8e6430c6-db44-405c-add0-e487a8f9399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:28.817135 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1437/2901] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:28.825465 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33deddd-841b-4d87-a093-8a9d0902e75a None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:28.825852 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33deddd-841b-4d87-a093-8a9d0902e75a None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:28.826134 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33deddd-841b-4d87-a093-8a9d0902e75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:28.845983 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-a33deddd-841b-4d87-a093-8a9d0902e75a None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:28.847207 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-a33deddd-841b-4d87-a093-8a9d0902e75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:28.855777 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1465/2902] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:28.861001 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6430c6-db44-405c-add0-e487a8f9399c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:28.872556 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6430c6-db44-405c-add0-e487a8f9399c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:28.878236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60456f-0fe7-4753-8cc8-3b7a4e69893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:28.878919 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60456f-0fe7-4753-8cc8-3b7a4e69893e admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:28.879203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60456f-0fe7-4753-8cc8-3b7a4e69893e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:28.879480 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60456f-0fe7-4753-8cc8-3b7a4e69893e admin admin] PATH_INFO: `/v3/domains` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:28.880151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60456f-0fe7-4753-8cc8-3b7a4e69893e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:49:28.880517 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60456f-0fe7-4753-8cc8-3b7a4e69893e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:28.882779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60456f-0fe7-4753-8cc8-3b7a4e69893e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:28.895596 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1438/2903] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:49:28.900674 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33deddd-841b-4d87-a093-8a9d0902e75a None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:28.910227 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33deddd-841b-4d87-a093-8a9d0902e75a None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:28.915989 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7945-b83f-42ed-9fbe-c42a9e07c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:28.916605 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7945-b83f-42ed-9fbe-c42a9e07c1de admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:28.916889 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7945-b83f-42ed-9fbe-c42a9e07c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:28.917167 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee7945-b83f-42ed-9fbe-c42a9e07c1de admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:28.917845 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee7945-b83f-42ed-9fbe-c42a9e07c1de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:28.919844 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee7945-b83f-42ed-9fbe-c42a9e07c1de admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:29.022757 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1466/2904] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:49:28 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:29.027396 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60456f-0fe7-4753-8cc8-3b7a4e69893e admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:29.037670 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60456f-0fe7-4753-8cc8-3b7a4e69893e admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:29.097277 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7227e-44c7-4bef-93fd-859cd0c43352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:29.097917 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7227e-44c7-4bef-93fd-859cd0c43352 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:29.098235 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7227e-44c7-4bef-93fd-859cd0c43352 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:29.098509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7227e-44c7-4bef-93fd-859cd0c43352 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:29.099173 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7227e-44c7-4bef-93fd-859cd0c43352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:29.101700 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7227e-44c7-4bef-93fd-859cd0c43352 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:29.186411 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1439/2905] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:49:29 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:29.190838 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7945-b83f-42ed-9fbe-c42a9e07c1de admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:29.201783 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee7945-b83f-42ed-9fbe-c42a9e07c1de admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:29.207328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1223578-a773-4989-a944-39b5df8e42d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:29.207328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1223578-a773-4989-a944-39b5df8e42d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:29.207820 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1223578-a773-4989-a944-39b5df8e42d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:29.208044 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1223578-a773-4989-a944-39b5df8e42d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:29.208695 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1223578-a773-4989-a944-39b5df8e42d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:29.211015 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1223578-a773-4989-a944-39b5df8e42d6 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:29.221755 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1467/2906] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:29.227381 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7227e-44c7-4bef-93fd-859cd0c43352 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:29.237774 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7227e-44c7-4bef-93fd-859cd0c43352 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:29.242872 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085aed0-5929-4214-986e-a6c08aec4af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:29.243476 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085aed0-5929-4214-986e-a6c08aec4af2 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:29.243786 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085aed0-5929-4214-986e-a6c08aec4af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:29.244068 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085aed0-5929-4214-986e-a6c08aec4af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:29.244707 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085aed0-5929-4214-986e-a6c08aec4af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:29.246392 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085aed0-5929-4214-986e-a6c08aec4af2 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:29.258083 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1440/2907] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:29.262292 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1223578-a773-4989-a944-39b5df8e42d6 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:29.273054 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1223578-a773-4989-a944-39b5df8e42d6 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:29.277925 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a57e71-9b69-4884-ba42-509ba019544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:29.278636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57e71-9b69-4884-ba42-509ba019544c admin admin] REQUEST_METHOD: `PUT` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:29.278920 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57e71-9b69-4884-ba42-509ba019544c admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:29.279196 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57e71-9b69-4884-ba42-509ba019544c admin admin] PATH_INFO: `/v3/projects/b6c6d0bec60d4b72817ccf80b195e5df/users/2b9d00664f6149bc99f47b0105d68f4c/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:29.295125 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a57e71-9b69-4884-ba42-509ba019544c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c6d0bec60d4b72817ccf80b195e5df, user_id=2b9d00664f6149bc99f47b0105d68f4c, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:29.297880 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a57e71-9b69-4884-ba42-509ba019544c admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:29.392380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1468/2908] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:49:29 2022] PUT /identity/v3/projects/b6c6d0bec60d4b72817ccf80b195e5df/users/2b9d00664f6149bc99f47b0105d68f4c/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:29.404160 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2c26-8c4d-4a53-80b0-c9e855122d7d None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:29.404497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2c26-8c4d-4a53-80b0-c9e855122d7d None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:29.404779 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb2c26-8c4d-4a53-80b0-c9e855122d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:29.433315 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-35fb2c26-8c4d-4a53-80b0-c9e855122d7d None None] MFA Rules not processed for user `2b9d00664f6149bc99f47b0105d68f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:29.434627 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-35fb2c26-8c4d-4a53-80b0-c9e855122d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:29.452509 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:29.502688 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1441/2909] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:29.508627 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a57e71-9b69-4884-ba42-509ba019544c admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:29.539406 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:29.575365 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a57e71-9b69-4884-ba42-509ba019544c admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:29.580444 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489344a-d087-46f2-9889-3eb6b3b4a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:29.581089 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489344a-d087-46f2-9889-3eb6b3b4a6fc admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:29.581403 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489344a-d087-46f2-9889-3eb6b3b4a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:29.581772 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489344a-d087-46f2-9889-3eb6b3b4a6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:29.582498 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489344a-d087-46f2-9889-3eb6b3b4a6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:29.584427 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489344a-d087-46f2-9889-3eb6b3b4a6fc admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:29.748709 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1469/2910] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:49:29 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:29.752862 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb2c26-8c4d-4a53-80b0-c9e855122d7d None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:29.763504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb2c26-8c4d-4a53-80b0-c9e855122d7d None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:29.828036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d4670-dd32-4312-8d60-f28839ada964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:29.828036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d4670-dd32-4312-8d60-f28839ada964 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:29.828036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d4670-dd32-4312-8d60-f28839ada964 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:29.828036 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d4670-dd32-4312-8d60-f28839ada964 admin admin] PATH_INFO: `/v3/users` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:29.828590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d4670-dd32-4312-8d60-f28839ada964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:29.829611 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d4670-dd32-4312-8d60-f28839ada964 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:29.924227 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1442/2911] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:49:29 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:29.928345 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489344a-d087-46f2-9889-3eb6b3b4a6fc admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:29.939472 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489344a-d087-46f2-9889-3eb6b3b4a6fc admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:29.944189 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f948-6ed0-4b68-9970-85e08ec5e60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:29.944847 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f948-6ed0-4b68-9970-85e08ec5e60a admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:29.945173 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f948-6ed0-4b68-9970-85e08ec5e60a admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:29.945451 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23f948-6ed0-4b68-9970-85e08ec5e60a admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:29.946156 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23f948-6ed0-4b68-9970-85e08ec5e60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:29.947768 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23f948-6ed0-4b68-9970-85e08ec5e60a admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:29.960679 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1470/2912] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:29.964758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d4670-dd32-4312-8d60-f28839ada964 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:29.974837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d4670-dd32-4312-8d60-f28839ada964 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:29.980260 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6d14b-40b8-4f39-bf92-4698e18c0dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:29.980915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6d14b-40b8-4f39-bf92-4698e18c0dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:29.981191 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6d14b-40b8-4f39-bf92-4698e18c0dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:29.981497 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6d14b-40b8-4f39-bf92-4698e18c0dc4 admin admin] PATH_INFO: `/v3/projects/b2681afaf6474a80a6c74f211afe697d/users/f3f5fd69a6464b96b0a833d2dc1d6c8d/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:29.996682 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6d14b-40b8-4f39-bf92-4698e18c0dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2681afaf6474a80a6c74f211afe697d, user_id=f3f5fd69a6464b96b0a833d2dc1d6c8d, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:29.999417 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6d14b-40b8-4f39-bf92-4698e18c0dc4 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:30.090288 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1443/2913] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:49:29 2022] PUT /identity/v3/projects/b2681afaf6474a80a6c74f211afe697d/users/f3f5fd69a6464b96b0a833d2dc1d6c8d/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:30.094387 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f948-6ed0-4b68-9970-85e08ec5e60a admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:30.105108 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23f948-6ed0-4b68-9970-85e08ec5e60a admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:30.160219 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc462a6-3e06-4cb3-9b10-06212672e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:30.160821 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc462a6-3e06-4cb3-9b10-06212672e177 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:30.161101 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc462a6-3e06-4cb3-9b10-06212672e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:30.161370 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc462a6-3e06-4cb3-9b10-06212672e177 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:30.162041 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc462a6-3e06-4cb3-9b10-06212672e177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:30.164443 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc462a6-3e06-4cb3-9b10-06212672e177 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:30.179527 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1471/2914] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:30.185333 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6d14b-40b8-4f39-bf92-4698e18c0dc4 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:30.196323 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6d14b-40b8-4f39-bf92-4698e18c0dc4 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:30.201221 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b34bb9-9d5f-4c49-b2e2-6392af1ffcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:30.201906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b34bb9-9d5f-4c49-b2e2-6392af1ffcf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:30.202181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b34bb9-9d5f-4c49-b2e2-6392af1ffcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:30.202450 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b34bb9-9d5f-4c49-b2e2-6392af1ffcf6 admin admin] PATH_INFO: `/v3/projects/b2681afaf6474a80a6c74f211afe697d/users/f3f5fd69a6464b96b0a833d2dc1d6c8d/roles/ee97cd77207b4be8aa55a8eb6093bb75` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:30.204384 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b34bb9-9d5f-4c49-b2e2-6392af1ffcf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2681afaf6474a80a6c74f211afe697d, user_id=f3f5fd69a6464b96b0a833d2dc1d6c8d, role_id=ee97cd77207b4be8aa55a8eb6093bb75)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:30.207107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b34bb9-9d5f-4c49-b2e2-6392af1ffcf6 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:30.218203 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1444/2915] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:49:30 2022] PUT /identity/v3/projects/b2681afaf6474a80a6c74f211afe697d/users/f3f5fd69a6464b96b0a833d2dc1d6c8d/roles/ee97cd77207b4be8aa55a8eb6093bb75 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:30.229812 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41507-e78d-44c2-a490-bd96dead5874 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:30.230096 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41507-e78d-44c2-a490-bd96dead5874 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:30.230367 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb41507-e78d-44c2-a490-bd96dead5874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:30.258449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-aeb41507-e78d-44c2-a490-bd96dead5874 None None] MFA Rules not processed for user `f3f5fd69a6464b96b0a833d2dc1d6c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:30.259654 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-aeb41507-e78d-44c2-a490-bd96dead5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:30.328569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1472/2916] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:30.340183 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b34bb9-9d5f-4c49-b2e2-6392af1ffcf6 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:30.342070 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-07b34bb9-9d5f-4c49-b2e2-6392af1ffcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:30.402193 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b34bb9-9d5f-4c49-b2e2-6392af1ffcf6 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:30.405911 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e903c8-3ce0-42e0-9ad6-2927e33c41e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:30.406516 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e903c8-3ce0-42e0-9ad6-2927e33c41e6 service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:30.406795 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e903c8-3ce0-42e0-9ad6-2927e33c41e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:30.407066 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e903c8-3ce0-42e0-9ad6-2927e33c41e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:30.417074 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e903c8-3ce0-42e0-9ad6-2927e33c41e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:30.418540 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e903c8-3ce0-42e0-9ad6-2927e33c41e6 service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:30.427987 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1445/2917] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:49:30.533030 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41507-e78d-44c2-a490-bd96dead5874 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:30.543449 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb41507-e78d-44c2-a490-bd96dead5874 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:30.547209 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94f907-0d61-4239-ba0a-958db1f4d3bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:30.547811 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94f907-0d61-4239-ba0a-958db1f4d3bd service cinder] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:30.548090 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94f907-0d61-4239-ba0a-958db1f4d3bd service cinder] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:30.548359 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94f907-0d61-4239-ba0a-958db1f4d3bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:30.558380 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:30.608855 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94f907-0d61-4239-ba0a-958db1f4d3bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:30.610331 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94f907-0d61-4239-ba0a-958db1f4d3bd service cinder] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:30.620433 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1473/2918] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:49:32.578328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e903c8-3ce0-42e0-9ad6-2927e33c41e6 service cinder] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:32.579794 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-76e903c8-3ce0-42e0-9ad6-2927e33c41e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:32.595938 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:32.652116 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e903c8-3ce0-42e0-9ad6-2927e33c41e6 service cinder] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:32.658325 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c918e-1300-4ecf-9f2f-7b3f5dd28dd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:32.658942 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c918e-1300-4ecf-9f2f-7b3f5dd28dd9 service placement] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:32.659225 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c918e-1300-4ecf-9f2f-7b3f5dd28dd9 service placement] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:32.659504 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c918e-1300-4ecf-9f2f-7b3f5dd28dd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:32.661236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-267c918e-1300-4ecf-9f2f-7b3f5dd28dd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:32.673660 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c918e-1300-4ecf-9f2f-7b3f5dd28dd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:32.675238 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c918e-1300-4ecf-9f2f-7b3f5dd28dd9 service placement] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:32.685395 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1446/2919] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:49:33.874222 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94f907-0d61-4239-ba0a-958db1f4d3bd service cinder] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:33.962205 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94f907-0d61-4239-ba0a-958db1f4d3bd service cinder] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:33.967716 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:33.968352 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:33.968631 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:33.968904 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] PATH_INFO: `/v3/users/2b9d00664f6149bc99f47b0105d68f4c` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:33.970057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b9d00664f6149bc99f47b0105d68f4c)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:33.971973 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:34.190633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b9d00664f6149bc99f47b0105d68f4c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:34.205567 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b9d00664f6149bc99f47b0105d68f4c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:34.213613 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b9d00664f6149bc99f47b0105d68f4c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:34.295237 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b9d00664f6149bc99f47b0105d68f4c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:34.295857 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b9d00664f6149bc99f47b0105d68f4c'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:34.302321 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1474/2920] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:49:33 2022] DELETE /identity/v3/users/2b9d00664f6149bc99f47b0105d68f4c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:34.306889 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade7cc-c234-499b-862a-94411e396b69 None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:34.307610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade7cc-c234-499b-862a-94411e396b69 None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:34.307610 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ade7cc-c234-499b-862a-94411e396b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:34.327552 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-d4ade7cc-c234-499b-862a-94411e396b69 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:34.328787 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d4ade7cc-c234-499b-862a-94411e396b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:34.387953 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1447/2921] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:34.397731 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:34.399143 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:34.435152 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:34.458602 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627abb94-bd33-4f63-93a1-825092bea8a1 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:34.462161 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2cca-80d4-434a-8ecc-bf967bc5e789 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:34.462802 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2cca-80d4-434a-8ecc-bf967bc5e789 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:34.463596 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2cca-80d4-434a-8ecc-bf967bc5e789 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:34.463741 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2cca-80d4-434a-8ecc-bf967bc5e789 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:34.472878 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c2cca-80d4-434a-8ecc-bf967bc5e789 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:34.474357 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c2cca-80d4-434a-8ecc-bf967bc5e789 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:34.484996 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1475/2922] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:49:35.000059 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ade7cc-c234-499b-862a-94411e396b69 None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:35.001484 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-d4ade7cc-c234-499b-862a-94411e396b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:35.016329 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ade7cc-c234-499b-862a-94411e396b69 None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:35.022656 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:35.023309 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:35.023590 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:35.023865 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] PATH_INFO: `/v3/projects/b6c6d0bec60d4b72817ccf80b195e5df` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:35.025278 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c6d0bec60d4b72817ccf80b195e5df)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:35.027346 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:35.172146 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c6d0bec60d4b72817ccf80b195e5df', 'request_id': 'req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:35.177939 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c6d0bec60d4b72817ccf80b195e5df', 'request_id': 'req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:35.185029 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c6d0bec60d4b72817ccf80b195e5df', 'request_id': 'req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:35.306294 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] The token cache is being invalidate because project b6c6d0bec60d4b72817ccf80b195e5df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:49:35.306601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:35.307224 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:35.308729 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1448/2923] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:49:34 2022] DELETE /identity/v3/projects/b6c6d0bec60d4b72817ccf80b195e5df => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:35.313068 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2cca-80d4-434a-8ecc-bf967bc5e789 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:35.323494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2cca-80d4-434a-8ecc-bf967bc5e789 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:35.380439 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50837ba-fb1d-425e-8b7e-fc8cc7f6189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:35.381063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50837ba-fb1d-425e-8b7e-fc8cc7f6189a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:35.381333 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50837ba-fb1d-425e-8b7e-fc8cc7f6189a admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:35.381633 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50837ba-fb1d-425e-8b7e-fc8cc7f6189a admin admin] PATH_INFO: `/v3/users/f3f5fd69a6464b96b0a833d2dc1d6c8d` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:35.382736 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50837ba-fb1d-425e-8b7e-fc8cc7f6189a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f5fd69a6464b96b0a833d2dc1d6c8d)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:35.385286 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50837ba-fb1d-425e-8b7e-fc8cc7f6189a admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:35.639308 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c50837ba-fb1d-425e-8b7e-fc8cc7f6189a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f5fd69a6464b96b0a833d2dc1d6c8d'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:35.654071 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c50837ba-fb1d-425e-8b7e-fc8cc7f6189a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f5fd69a6464b96b0a833d2dc1d6c8d'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:35.662385 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c50837ba-fb1d-425e-8b7e-fc8cc7f6189a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f5fd69a6464b96b0a833d2dc1d6c8d'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:35.746326 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c50837ba-fb1d-425e-8b7e-fc8cc7f6189a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f5fd69a6464b96b0a833d2dc1d6c8d'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:35.747057 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-c50837ba-fb1d-425e-8b7e-fc8cc7f6189a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f5fd69a6464b96b0a833d2dc1d6c8d'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:35.753519 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1476/2924] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:49:35 2022] DELETE /identity/v3/users/f3f5fd69a6464b96b0a833d2dc1d6c8d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:36.188064 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:36.189623 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:36.205969 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57eee3-7d7e-4c8e-830e-3ca1a0630601 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:36.240706 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:36.274049 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:36.274672 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:36.274947 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:36.275216 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] PATH_INFO: `/v3/projects/b2681afaf6474a80a6c74f211afe697d` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:36.276388 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2681afaf6474a80a6c74f211afe697d)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:36.278441 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:36.392906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2681afaf6474a80a6c74f211afe697d', 'request_id': 'req-8593b1be-a660-458d-84b1-f4706137118d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:36.398613 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2681afaf6474a80a6c74f211afe697d', 'request_id': 'req-8593b1be-a660-458d-84b1-f4706137118d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:36.405775 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2681afaf6474a80a6c74f211afe697d', 'request_id': 'req-8593b1be-a660-458d-84b1-f4706137118d'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:36.518671 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] The token cache is being invalidate because project b2681afaf6474a80a6c74f211afe697d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:49:36.522748 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:36.522748 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-8593b1be-a660-458d-84b1-f4706137118d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:36.522748 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1449/2925] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:49:36 2022] DELETE /identity/v3/projects/b2681afaf6474a80a6c74f211afe697d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 00:49:36.526159 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292698-ac60-4aac-b98e-57c5c1cab090 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:36.526635 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292698-ac60-4aac-b98e-57c5c1cab090 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:36.526748 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d292698-ac60-4aac-b98e-57c5c1cab090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:36.547704 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-0d292698-ac60-4aac-b98e-57c5c1cab090 None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:36.548910 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-0d292698-ac60-4aac-b98e-57c5c1cab090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:36.598067 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:36.610712 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1477/2926] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:36.618621 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e71de-1190-4583-b58e-055a77b511ee None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:36.618915 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e71de-1190-4583-b58e-055a77b511ee None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:36.619199 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e71de-1190-4583-b58e-055a77b511ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:36.642005 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-628e71de-1190-4583-b58e-055a77b511ee None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:36.643247 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-628e71de-1190-4583-b58e-055a77b511ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:36.651387 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1450/2927] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:36.656589 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d292698-ac60-4aac-b98e-57c5c1cab090 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:36.666457 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d292698-ac60-4aac-b98e-57c5c1cab090 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:36.672362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be6320-4fdb-414f-8384-58f09b9b2e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:36.672963 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be6320-4fdb-414f-8384-58f09b9b2e40 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:36.673250 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be6320-4fdb-414f-8384-58f09b9b2e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:36.673526 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be6320-4fdb-414f-8384-58f09b9b2e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:36.674212 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be6320-4fdb-414f-8384-58f09b9b2e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 00:49:36.674514 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be6320-4fdb-414f-8384-58f09b9b2e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:36.676120 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be6320-4fdb-414f-8384-58f09b9b2e40 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:36.688078 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1478/2928] 10.222.0.74 () {58 vars in 1153 bytes} [Wed Aug 31 00:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 00:49:36.692352 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e71de-1190-4583-b58e-055a77b511ee None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:36.704635 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e71de-1190-4583-b58e-055a77b511ee None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:36.709359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea511c-252c-437b-9c69-0749049a47c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:36.709993 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea511c-252c-437b-9c69-0749049a47c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:36.710273 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea511c-252c-437b-9c69-0749049a47c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:36.710547 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea511c-252c-437b-9c69-0749049a47c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:36.711190 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea511c-252c-437b-9c69-0749049a47c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:36.713100 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea511c-252c-437b-9c69-0749049a47c9 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:36.811359 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1451/2929] 10.222.0.74 () {60 vars in 1153 bytes} [Wed Aug 31 00:49:36 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:36.815358 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be6320-4fdb-414f-8384-58f09b9b2e40 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:36.826636 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be6320-4fdb-414f-8384-58f09b9b2e40 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:36.883995 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dd329-ff47-43ed-b353-484778cacfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:36.884609 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dd329-ff47-43ed-b353-484778cacfcb admin admin] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:36.885362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dd329-ff47-43ed-b353-484778cacfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:36.885362 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dd329-ff47-43ed-b353-484778cacfcb admin admin] PATH_INFO: `/v3/users` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:36.885813 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dd329-ff47-43ed-b353-484778cacfcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:36.887740 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dd329-ff47-43ed-b353-484778cacfcb admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:36.992473 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1479/2930] 10.222.0.74 () {60 vars in 1144 bytes} [Wed Aug 31 00:49:36 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 00:49:36.996935 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea511c-252c-437b-9c69-0749049a47c9 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:37.008089 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea511c-252c-437b-9c69-0749049a47c9 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:37.012790 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e031b6-2363-46a9-948e-8b3f4cd22d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:37.014041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e031b6-2363-46a9-948e-8b3f4cd22d88 admin admin] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:37.014327 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e031b6-2363-46a9-948e-8b3f4cd22d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:37.014599 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e031b6-2363-46a9-948e-8b3f4cd22d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:37.015241 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e031b6-2363-46a9-948e-8b3f4cd22d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:37.016840 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e031b6-2363-46a9-948e-8b3f4cd22d88 admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:37.026962 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1452/2931] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:37.031454 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dd329-ff47-43ed-b353-484778cacfcb admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:37.041806 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dd329-ff47-43ed-b353-484778cacfcb admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:37.046691 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba5fa0-8ecd-419e-9175-de270283cb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:37.047328 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5fa0-8ecd-419e-9175-de270283cb50 admin admin] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:37.047611 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5fa0-8ecd-419e-9175-de270283cb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:37.047886 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5fa0-8ecd-419e-9175-de270283cb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:37.048518 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba5fa0-8ecd-419e-9175-de270283cb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:37.050158 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba5fa0-8ecd-419e-9175-de270283cb50 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:37.061550 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1480/2932] 10.222.0.74 () {58 vars in 1122 bytes} [Wed Aug 31 00:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 00:49:37.065718 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e031b6-2363-46a9-948e-8b3f4cd22d88 admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:37.076607 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e031b6-2363-46a9-948e-8b3f4cd22d88 admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:37.081274 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a81a95-3e6e-4efc-a2f8-851b54689dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:37.081973 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a81a95-3e6e-4efc-a2f8-851b54689dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:37.082366 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a81a95-3e6e-4efc-a2f8-851b54689dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:37.082644 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a81a95-3e6e-4efc-a2f8-851b54689dcf admin admin] PATH_INFO: `/v3/projects/2b0ca5500def4b2ea5c1e7e68c540c5a/users/d6cd13ee93b94d8f980129a3bb55d38b/roles/bec3ab91aff841e286162327678e1cc6` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:37.097181 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a81a95-3e6e-4efc-a2f8-851b54689dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0ca5500def4b2ea5c1e7e68c540c5a, user_id=d6cd13ee93b94d8f980129a3bb55d38b, role_id=bec3ab91aff841e286162327678e1cc6)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:37.099906 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a81a95-3e6e-4efc-a2f8-851b54689dcf admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:37.238981 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1453/2933] 10.222.0.74 () {60 vars in 1483 bytes} [Wed Aug 31 00:49:37 2022] PUT /identity/v3/projects/2b0ca5500def4b2ea5c1e7e68c540c5a/users/d6cd13ee93b94d8f980129a3bb55d38b/roles/bec3ab91aff841e286162327678e1cc6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:37.250262 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a65e4e-01d2-48ef-b606-8e984be03bc1 None None] REQUEST_METHOD: `POST` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:37.250552 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a65e4e-01d2-48ef-b606-8e984be03bc1 None None] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:37.250831 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a65e4e-01d2-48ef-b606-8e984be03bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:37.280000 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.auth.core [None req-44a65e4e-01d2-48ef-b606-8e984be03bc1 None None] MFA Rules not processed for user `d6cd13ee93b94d8f980129a3bb55d38b`. Rule list: `[]` (Enabled: `True`). {{(pid=88177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:37.281215 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-44a65e4e-01d2-48ef-b606-8e984be03bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:37.347247 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1481/2934] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:37.359107 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a81a95-3e6e-4efc-a2f8-851b54689dcf admin admin] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:37.360811 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-25a81a95-3e6e-4efc-a2f8-851b54689dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:37.416898 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a81a95-3e6e-4efc-a2f8-851b54689dcf admin admin] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:37.421328 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb088164-5f5e-4442-a803-443616a2bc7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75f62fa62f2d420a998f236ff7f9b6b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:37.421951 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb088164-5f5e-4442-a803-443616a2bc7d service cinder] REQUEST_METHOD: `GET` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:37.422236 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb088164-5f5e-4442-a803-443616a2bc7d service cinder] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:37.422505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb088164-5f5e-4442-a803-443616a2bc7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:37.428837 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:37.431196 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb088164-5f5e-4442-a803-443616a2bc7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:37.432624 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb088164-5f5e-4442-a803-443616a2bc7d service cinder] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:37.442192 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1454/2935] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 00:49:40.871984 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a65e4e-01d2-48ef-b606-8e984be03bc1 None None] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:40.926063 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:40.940494 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a65e4e-01d2-48ef-b606-8e984be03bc1 None None] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:40.945117 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:40.945788 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:40.946069 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:40.946343 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] PATH_INFO: `/v3/users/d6cd13ee93b94d8f980129a3bb55d38b` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:40.947488 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6cd13ee93b94d8f980129a3bb55d38b)` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:40.949715 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:41.178499 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6cd13ee93b94d8f980129a3bb55d38b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:41.191603 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6cd13ee93b94d8f980129a3bb55d38b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:41.199383 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6cd13ee93b94d8f980129a3bb55d38b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:41.271750 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6cd13ee93b94d8f980129a3bb55d38b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:41.272410 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.notifications [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6cd13ee93b94d8f980129a3bb55d38b'} {{(pid=88177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:41.281208 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1482/2936] 10.222.0.74 () {58 vars in 1224 bytes} [Wed Aug 31 00:49:40 2022] DELETE /identity/v3/users/d6cd13ee93b94d8f980129a3bb55d38b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:41.288919 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6643c-ec5a-4d6e-8b43-4012a244774c None None] REQUEST_METHOD: `POST` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:41.289448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6643c-ec5a-4d6e-8b43-4012a244774c None None] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:41.289448 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6643c-ec5a-4d6e-8b43-4012a244774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:41.312151 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.auth.core [None req-7da6643c-ec5a-4d6e-8b43-4012a244774c None None] MFA Rules not processed for user `3409d9d3d7e54fb283ab6923355f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=88178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 00:49:41.313105 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7da6643c-ec5a-4d6e-8b43-4012a244774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:41.375505 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1455/2937] 10.222.0.74 () {58 vars in 958 bytes} [Wed Aug 31 00:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 00:49:41.385644 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:41.387141 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:41.451149 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc585d3f-3188-4fd8-8e4b-a5c48e93d966 admin admin] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:41.455334 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432b8e8-8ab4-496c-b10b-9b567918c764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5149b369e34afca6dd41a0082701e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:41.455940 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432b8e8-8ab4-496c-b10b-9b567918c764 service neutron] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:41.456216 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432b8e8-8ab4-496c-b10b-9b567918c764 service neutron] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:41.456485 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432b8e8-8ab4-496c-b10b-9b567918c764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:41.465560 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432b8e8-8ab4-496c-b10b-9b567918c764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:41.467239 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432b8e8-8ab4-496c-b10b-9b567918c764 service neutron] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:41.476569 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1483/2938] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 00:49:41.937542 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6643c-ec5a-4d6e-8b43-4012a244774c None None] Authenticating user token {{(pid=88178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:49:41.939263 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.fernet_utils [None req-7da6643c-ec5a-4d6e-8b43-4012a244774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:49:41.953041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6643c-ec5a-4d6e-8b43-4012a244774c None None] Validating token access rules against request {{(pid=88178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:49:41.958413 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3409d9d3d7e54fb283ab6923355f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd01cbdba4ce42c9aba3127e81a7cb7f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:49:41.959041 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:49:41.959324 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:49:41.959601 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] PATH_INFO: `/v3/projects/2b0ca5500def4b2ea5c1e7e68c540c5a` {{(pid=88178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:49:41.960761 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0ca5500def4b2ea5c1e7e68c540c5a)` {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:49:41.962758 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] RBAC: Authorization granted {{(pid=88178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:49:42.089989 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0ca5500def4b2ea5c1e7e68c540c5a', 'request_id': 'req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:42.096492 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0ca5500def4b2ea5c1e7e68c540c5a', 'request_id': 'req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:42.102882 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0ca5500def4b2ea5c1e7e68c540c5a', 'request_id': 'req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e'} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:42.208884 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] The token cache is being invalidate because project 2b0ca5500def4b2ea5c1e7e68c540c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 00:49:42.209164 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:42.209818 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG keystone.notifications [None req-862a00f8-ce99-41d7-b482-0e8f6f02cc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 00:49:42.211358 dv-cinder-852211-6-smb devstack@keystone.service[88178]: [pid: 88178|app: 0|req: 1456/2939] 10.222.0.74 () {58 vars in 1233 bytes} [Wed Aug 31 00:49:41 2022] DELETE /identity/v3/projects/2b0ca5500def4b2ea5c1e7e68c540c5a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 00:49:51.472330 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG dbcounter [-] [88177] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:49:52.206140 dv-cinder-852211-6-smb devstack@keystone.service[88178]: DEBUG dbcounter [-] [88178] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 00:54:35.586807 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432b8e8-8ab4-496c-b10b-9b567918c764 service neutron] Authenticating user token {{(pid=88177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 00:54:35.588201 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-6432b8e8-8ab4-496c-b10b-9b567918c764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:35.732914 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432b8e8-8ab4-496c-b10b-9b567918c764 service neutron] Validating token access rules against request {{(pid=88177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 00:54:35.795881 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac022d35-47bc-4a31-95e8-73b4ff7b8668 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8c004b9fe2402fbe94cfd7c2bf949e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a1465dcc65f9440bae8263a2e2904fab', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 00:54:35.796495 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022d35-47bc-4a31-95e8-73b4ff7b8668 service placement] REQUEST_METHOD: `GET` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 00:54:35.797522 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022d35-47bc-4a31-95e8-73b4ff7b8668 service placement] SCRIPT_NAME: `/identity` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 00:54:35.798104 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022d35-47bc-4a31-95e8-73b4ff7b8668 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 00:54:35.799885 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.fernet_utils [None req-ac022d35-47bc-4a31-95e8-73b4ff7b8668 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 00:54:35.811460 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac022d35-47bc-4a31-95e8-73b4ff7b8668 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 00:54:35.813588 dv-cinder-852211-6-smb devstack@keystone.service[88177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac022d35-47bc-4a31-95e8-73b4ff7b8668 service placement] RBAC: Authorization granted {{(pid=88177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 00:54:35.823912 dv-cinder-852211-6-smb devstack@keystone.service[88177]: [pid: 88177|app: 0|req: 1484/2940] 10.222.0.74 () {60 vars in 1365 bytes} [Wed Aug 31 00:54:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)